2022-05-11T13:50:03.231 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-11T13:50:03.233 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2022-05-11_08:21:56-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi --owner scheduled_vshankar@teuthology --verbose --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} --archive /home/teuthworker/archive/vshankar-2022-05-11_08:21:56-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi/6830413 -- /home/teuthworker/archive/vshankar-2022-05-11_08:21:56-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi/6830413/orig.config.yaml 2022-05-11T14:28:56.240 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-05-11T14:28:56.316 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2022-05-11_08:21:56-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi/6830413 branch: wip-vshankar-testing-20220509-125847 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} email: vshankar@redhat.com first_in_suite: false job_id: '6830413' kernel: client: sha1: distro flavor: default kdb: true sha1: 9d1d97e0574f2f6f861b59a6eefcf986dcf94fa7 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2022-05-11_08:21:56-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.5' overrides: admin_socket: branch: wip-vshankar-testing-20220509-125847 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 4a6f09b69a2cce44f2caeba09a373309e0e0ba2e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4a6f09b69a2cce44f2caeba09a373309e0e0ba2e kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20220509-125847 sha1: 4a6f09b69a2cce44f2caeba09a373309e0e0ba2e owner: scheduled_vshankar@teuthology priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 4a6f09b69a2cce44f2caeba09a373309e0e0ba2e sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20220509-125847 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 4a6f09b69a2cce44f2caeba09a373309e0e0ba2e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD652hhuIIOKpJe8b1jtVSSLVtrRe3TmbkR6YfhaOwFJcES8lVa8JH85CX/wgAVTTYQ4O9xQ9UUybkATCg9FrNURrHiQuvwLQof/G4mhZ80C4yRMdRwLDK22ss9O9lQOHqx5y0KznXnzZ+kp6dq55ypLfEEL4ww+NNzFm1ZOFQRamEgRddrB4a8QouOzRElTvIH3u1QGGmThzHxP+/UEdngVymYkC2bUdRosuRi0eDC5JoCkbNcK6QsA+ET3T6eKtC6gnjzlOzKEVazW5+QO4doEkRbeBOXyu7uN6vRyVe53tLSqNus//avDaJEiSPnbtTs3xsXQVkni2kp1bk3fZik4uLnAStM1/1+Bxc98Tn/TF+87E4S0gjPxFXBGiVz9lhIrG54lqLogZpA+qxwpxY/LFFpu0zPy4q3UZob9pJ9sl97dPa4k0Rs27oYQg/k6GvaoJ4j9F36tvzT6RmQg/t/BYA+/wwf7KcPdkdShoUWHUTkMJnO76u2krttL2QFqhs= smithi166.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsvpNRqjsbybNpCO4HRA9bQaQ3xZ5eEZspd5nLjjBrq4RqB6idibb/uFV4wgaNKDCBpQgex8PDnSOJoW0R6UUmIjSFH/xi+rMm4VMbdUqiwOthH0A1Z9dXl56KxHcRFZObkzP3nCDvBI0P8ZEj8+5sTfcxy7gd2Y/TtX50apsPjrY6JR7aFBHTyJCma62ryk3lu7/S3c3AtNIngxQPzbcX5tuhBiRwWjlO0juj44+eJA0bh0ByJiaP6yoH8iaIyBhMTesR3pjfim+8lExJTLG3q6QB0GbXlWrA4fjufl2chedYuHq8tmYnq7WytZoQDuXcW7dVo6bIqbnJgMQqgMt9HlFlmqciRnUth/s1keT/wQVafqv2me09uByoTsT1G2VW+ey8uFbhx6Ujrrup5eZDagjIsmQkks/foqkoKPiyosarRQaa0feIDZ0LzFX3NfcwCDKSAp5TBMgX+yOu1DCI4BF+Y4npbK81BxMAcHpgOuxeDg4GytP/jot65K4oV0M= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology_branch: master teuthology_sha1: b018fa018d3f885cbc018f839b42536477653f84 timestamp: 2022-05-11_08:21:56 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.456 2022-05-11T14:28:56.317 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/qa; will attempt to use it 2022-05-11T14:28:56.318 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/qa/tasks 2022-05-11T14:28:56.318 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-05-11T14:28:56.320 INFO:teuthology.task.internal:Checking packages... 2022-05-11T14:28:56.345 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e' 2022-05-11T14:28:56.345 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-05-11T14:28:56.346 INFO:teuthology.packaging:ref: None 2022-05-11T14:28:56.346 INFO:teuthology.packaging:tag: None 2022-05-11T14:28:56.347 INFO:teuthology.packaging:branch: wip-vshankar-testing-20220509-125847 2022-05-11T14:28:56.347 INFO:teuthology.packaging:sha1: 4a6f09b69a2cce44f2caeba09a373309e0e0ba2e 2022-05-11T14:28:56.347 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20220509-125847 2022-05-11T14:28:56.548 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-12109.g4a6f09b6 2022-05-11T14:28:56.549 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-05-11T14:47:58.432 INFO:teuthology.task.internal:no buildpackages task found 2022-05-11T14:47:58.433 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-05-11T15:04:00.691 INFO:teuthology.task.internal:Saving configuration 2022-05-11T15:04:00.714 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-05-11T15:17:24.544 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-11T15:17:24.572 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-05-11_08:21:56-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi/6830413', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.5', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-05-11 13:38:55.455743', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNtT0jKzmTdtqs0vskRO2cVVb9lUKQ6V7J3SRuy2BF2yF/r056uv1RvmEqeP7qH0IQzG2X8Fj7+0+PZnHSzt80='} 2022-05-11T15:17:24.593 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi166.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-05-11_08:21:56-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi/6830413', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.5', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-05-11 13:38:55.457435', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKEVKFfo8jEeY0F5rIsd7yFfPvu+9SaJM9XJ9uakB8vetYZZHZ9OWyUU0In3GSfdCYV+MRYLktyqCtcCY5QGbJc='} 2022-05-11T15:17:24.594 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-05-11T17:18:54.382 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-05-11T17:18:54.385 INFO:teuthology.task.internal:roles: ubuntu@smithi166.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-05-11T17:18:54.386 INFO:teuthology.run_tasks:Running task console_log... 2022-05-11T17:31:03.466 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9a89136f28>, signals=[15]) 2022-05-11T17:31:03.470 INFO:teuthology.run_tasks:Running task internal.connect... 2022-05-11T17:34:28.819 INFO:teuthology.task.internal:Opening connections... 2022-05-11T17:34:28.821 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2022-05-11T17:34:28.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-11T17:34:28.912 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi166.front.sepia.ceph.com 2022-05-11T17:34:28.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-11T17:34:28.992 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-05-11T17:51:14.022 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2022-05-11T17:51:14.048 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2022-05-11T17:51:14.049 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2022-05-11T17:51:14.107 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2022-05-11T17:51:14.107 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.5 (Ootpa)" 2022-05-11T17:51:14.107 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2022-05-11T17:51:14.108 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2022-05-11T17:51:14.108 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.5" 2022-05-11T17:51:14.108 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2022-05-11T17:51:14.109 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)" 2022-05-11T17:51:14.109 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2022-05-11T17:51:14.109 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-05-11T17:51:14.109 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2022-05-11T17:51:14.110 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-05-11T17:51:14.110 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-11T17:51:14.110 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T17:51:14.110 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-11T17:51:14.110 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5 2022-05-11T17:51:14.111 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-05-11T17:51:14.111 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5" 2022-05-11T17:51:14.112 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2022-05-11T17:51:14.136 DEBUG:teuthology.orchestra.run.smithi166:> uname -m 2022-05-11T17:51:14.189 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64 2022-05-11T17:51:14.189 DEBUG:teuthology.orchestra.run.smithi166:> cat /etc/os-release 2022-05-11T17:51:14.247 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="Red Hat Enterprise Linux" 2022-05-11T17:51:14.247 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="8.5 (Ootpa)" 2022-05-11T17:51:14.248 INFO:teuthology.orchestra.run.smithi166.stdout:ID="rhel" 2022-05-11T17:51:14.248 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE="fedora" 2022-05-11T17:51:14.248 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="8.5" 2022-05-11T17:51:14.248 INFO:teuthology.orchestra.run.smithi166.stdout:PLATFORM_ID="platform:el8" 2022-05-11T17:51:14.248 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)" 2022-05-11T17:51:14.249 INFO:teuthology.orchestra.run.smithi166.stdout:ANSI_COLOR="0;31" 2022-05-11T17:51:14.249 INFO:teuthology.orchestra.run.smithi166.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-05-11T17:51:14.249 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://www.redhat.com/" 2022-05-11T17:51:14.249 INFO:teuthology.orchestra.run.smithi166.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-05-11T17:51:14.249 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-11T17:51:14.250 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T17:51:14.250 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-11T17:51:14.250 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5 2022-05-11T17:51:14.250 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-05-11T17:51:14.250 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5" 2022-05-11T17:51:14.251 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2022-05-11T17:51:14.267 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-05-11T18:05:15.693 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-05-11T18:18:20.695 INFO:teuthology.task.internal:Checking for old test directory... 2022-05-11T18:18:20.706 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2022-05-11T18:18:20.726 DEBUG:teuthology.orchestra.run.smithi166:> test '!' -e /home/ubuntu/cephtest 2022-05-11T18:18:20.749 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-05-11T18:35:20.196 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-05-11T18:35:20.198 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2022-05-11T18:35:20.204 DEBUG:teuthology.orchestra.run.smithi166:> test -z $(ls -A /var/lib/ceph) 2022-05-11T18:35:20.301 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-05-11T19:12:43.596 INFO:teuthology.run_tasks:Running task kernel... 2022-05-11T19:16:14.420 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '9d1d97e0574f2f6f861b59a6eefcf986dcf94fa7'} 2022-05-11T19:16:14.421 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2022-05-11T19:16:14.421 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2022-05-11T19:16:14.422 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2022-05-11T19:16:14.424 DEBUG:teuthology.orchestra.run.smithi166:> test -f /run/.containerenv -o -f /.dockerenv 2022-05-11T19:16:14.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-11T19:16:14.444 DEBUG:teuthology.orchestra.run.smithi166:> uname -r 2022-05-11T19:16:14.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-11T19:16:14.445 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2022-05-11T19:16:14.502 INFO:teuthology.orchestra.run.smithi166.stdout:4.18.0-348.20.1.el8_5.x86_64 2022-05-11T19:16:14.503 INFO:teuthology.task.kernel:Running kernel on smithi166: 4.18.0-348.20.1.el8_5.x86_64 2022-05-11T19:16:14.503 DEBUG:teuthology.orchestra.run.smithi166:> sudo yum install -y kernel 2022-05-11T19:16:14.505 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-348.20.1.el8_5.x86_64 2022-05-11T19:16:14.505 INFO:teuthology.task.kernel:Running kernel on smithi134: 4.18.0-348.20.1.el8_5.x86_64 2022-05-11T19:16:14.505 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2022-05-11T19:16:15.131 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2022-05-11T19:16:15.132 INFO:teuthology.orchestra.run.smithi166.stdout:Unable to read consumer identity 2022-05-11T19:16:15.183 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2022-05-11T19:16:15.183 INFO:teuthology.orchestra.run.smithi134.stdout:Unable to read consumer identity 2022-05-11T19:16:15.207 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:16:15.208 INFO:teuthology.orchestra.run.smithi166.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-05-11T19:16:15.208 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:16:15.210 INFO:teuthology.orchestra.run.smithi166.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:15.211 INFO:teuthology.orchestra.run.smithi166.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:15.274 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:16:15.274 INFO:teuthology.orchestra.run.smithi134.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-05-11T19:16:15.275 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:16:15.277 INFO:teuthology.orchestra.run.smithi134.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:15.278 INFO:teuthology.orchestra.run.smithi134.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:16.383 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2022-05-11T19:16:16.384 INFO:teuthology.orchestra.run.smithi166.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2022-05-11T19:16:40.217 INFO:teuthology.orchestra.run.smithi166.stdout:Extra Packages for Enterprise Linux 477 kB/s | 11 MB 00:23 2022-05-11T19:16:40.571 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 470 kB/s | 11 MB 00:24 2022-05-11T19:16:42.857 INFO:teuthology.orchestra.run.smithi166.stdout:lab-extras 180 kB/s | 24 kB 00:00 2022-05-11T19:16:43.669 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 172 kB/s | 24 kB 00:00 2022-05-11T19:16:43.671 INFO:teuthology.orchestra.run.smithi166.stdout:Package kernel-4.18.0-348.20.1.el8_5.x86_64 is already installed. 2022-05-11T19:16:43.671 INFO:teuthology.orchestra.run.smithi166.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2022-05-11T19:16:43.671 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2022-05-11T19:16:43.672 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2022-05-11T19:16:43.672 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2022-05-11T19:16:43.673 DEBUG:teuthology.orchestra.run.smithi166:> echo no | sudo yum reinstall kernel || true 2022-05-11T19:16:43.788 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-348.20.1.el8_5.x86_64 is already installed. 2022-05-11T19:16:43.788 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2022-05-11T19:16:43.833 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2022-05-11T19:16:43.833 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2022-05-11T19:16:43.833 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2022-05-11T19:16:43.948 DEBUG:teuthology.orchestra.run.smithi134:> echo no | sudo yum reinstall kernel || true 2022-05-11T19:16:43.989 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2022-05-11T19:16:43.989 INFO:teuthology.orchestra.run.smithi166.stdout:Unable to read consumer identity 2022-05-11T19:16:44.041 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:16:44.042 INFO:teuthology.orchestra.run.smithi166.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-05-11T19:16:44.042 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:16:44.043 INFO:teuthology.orchestra.run.smithi166.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:44.051 INFO:teuthology.orchestra.run.smithi166.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:44.267 INFO:teuthology.orchestra.run.smithi166.stdout:Last metadata expiration check: 0:00:02 ago on Wed 11 May 2022 07:16:42 PM UTC. 2022-05-11T19:16:46.775 INFO:teuthology.orchestra.run.smithi166.stdout:Installed package kernel-4.18.0-348.20.1.el8_5.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2022-05-11T19:16:46.776 INFO:teuthology.orchestra.run.smithi166.stdout:Installed package kernel-4.18.0-348.el8.x86_64 (from anaconda) not available. 2022-05-11T19:16:46.776 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2022-05-11T19:16:46.776 INFO:teuthology.orchestra.run.smithi134.stdout:Unable to read consumer identity 2022-05-11T19:16:46.777 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:16:46.777 INFO:teuthology.orchestra.run.smithi134.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-05-11T19:16:46.778 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:16:46.778 INFO:teuthology.orchestra.run.smithi134.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:46.779 INFO:teuthology.orchestra.run.smithi134.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:46.780 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:01 ago on Wed 11 May 2022 07:16:43 PM UTC. 2022-05-11T19:16:46.780 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-348.20.1.el8_5.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2022-05-11T19:16:46.780 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-348.el8.x86_64 (from anaconda) not available. 2022-05-11T19:16:46.781 INFO:teuthology.orchestra.run.smithi166.stderr:Error: No packages marked for reinstall. 2022-05-11T19:16:46.782 DEBUG:teuthology.orchestra.run.smithi166:> sudo yum reinstall -y kernel || true 2022-05-11T19:16:46.784 INFO:teuthology.orchestra.run.smithi134.stderr:Error: No packages marked for reinstall. 2022-05-11T19:16:46.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum reinstall -y kernel || true 2022-05-11T19:16:47.123 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2022-05-11T19:16:47.124 INFO:teuthology.orchestra.run.smithi166.stdout:Unable to read consumer identity 2022-05-11T19:16:47.136 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2022-05-11T19:16:47.137 INFO:teuthology.orchestra.run.smithi134.stdout:Unable to read consumer identity 2022-05-11T19:16:47.159 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:16:47.161 INFO:teuthology.orchestra.run.smithi166.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-05-11T19:16:47.162 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:16:47.173 INFO:teuthology.orchestra.run.smithi166.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:47.190 INFO:teuthology.orchestra.run.smithi166.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:47.263 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:16:47.264 INFO:teuthology.orchestra.run.smithi134.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-05-11T19:16:47.264 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:16:47.264 INFO:teuthology.orchestra.run.smithi134.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:47.265 INFO:teuthology.orchestra.run.smithi134.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-05-11T19:16:47.384 INFO:teuthology.orchestra.run.smithi166.stdout:Last metadata expiration check: 0:00:05 ago on Wed 11 May 2022 07:16:42 PM UTC. 2022-05-11T19:16:47.425 INFO:teuthology.orchestra.run.smithi166.stdout:Installed package kernel-4.18.0-348.20.1.el8_5.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2022-05-11T19:16:47.425 INFO:teuthology.orchestra.run.smithi166.stdout:Installed package kernel-4.18.0-348.el8.x86_64 (from anaconda) not available. 2022-05-11T19:16:47.448 INFO:teuthology.orchestra.run.smithi166.stderr:Error: No packages marked for reinstall. 2022-05-11T19:16:47.490 DEBUG:teuthology.orchestra.run.smithi166:> rpm -q kernel --last | head -n 1 2022-05-11T19:16:47.496 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:04 ago on Wed 11 May 2022 07:16:43 PM UTC. 2022-05-11T19:16:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-348.20.1.el8_5.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2022-05-11T19:16:47.538 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-348.el8.x86_64 (from anaconda) not available. 2022-05-11T19:16:47.586 INFO:teuthology.orchestra.run.smithi134.stderr:Error: No packages marked for reinstall. 2022-05-11T19:16:47.614 INFO:teuthology.orchestra.run.smithi166.stdout:kernel-4.18.0-348.20.1.el8_5.x86_64 Thu 31 Mar 2022 06:39:24 PM UTC 2022-05-11T19:16:47.616 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.20.1.el8_5.x86_64 2022-05-11T19:16:47.617 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-05-11T19:16:47.617 DEBUG:teuthology.parallel:result is None 2022-05-11T19:16:47.629 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel --last | head -n 1 2022-05-11T19:16:47.749 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-348.20.1.el8_5.x86_64 Thu 31 Mar 2022 06:39:24 PM UTC 2022-05-11T19:16:47.751 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.20.1.el8_5.x86_64 2022-05-11T19:16:47.752 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-05-11T19:16:47.752 DEBUG:teuthology.parallel:result is None 2022-05-11T19:16:47.753 INFO:teuthology.run_tasks:Running task internal.base... 2022-05-11T19:16:47.839 INFO:teuthology.task.internal:Creating test directory... 2022-05-11T19:16:47.844 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-05-11T19:16:47.865 DEBUG:teuthology.orchestra.run.smithi166:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-05-11T19:16:47.900 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-05-11T19:16:52.529 INFO:teuthology.run_tasks:Running task internal.archive... 2022-05-11T19:16:54.804 INFO:teuthology.task.internal:Creating archive directory... 2022-05-11T19:16:54.805 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-05-11T19:16:54.809 DEBUG:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-05-11T19:16:55.253 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-05-11T19:16:56.121 INFO:teuthology.task.internal:Enabling coredump saving... 2022-05-11T19:16:56.122 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-05-11T19:16:56.129 DEBUG:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-05-11T19:16:56.251 INFO:teuthology.orchestra.run.smithi166.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-11T19:16:56.271 INFO:teuthology.orchestra.run.smithi166.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-11T19:16:56.321 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-11T19:16:56.343 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-05-11T19:16:56.344 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-05-11T19:17:00.842 INFO:teuthology.task.internal:Configuring sudo... 2022-05-11T19:17:00.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-05-11T19:17:00.851 DEBUG:teuthology.orchestra.run.smithi166:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-05-11T19:17:00.885 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-05-11T19:17:04.219 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-05-11T19:17:04.220 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-05-11T19:17:04.241 DEBUG:teuthology.orchestra.run.smithi166:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-05-11T19:17:04.283 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-11T19:17:04.364 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-11T19:17:04.505 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-11T19:17:04.580 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-11T19:17:04.634 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:17:04.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-05-11T19:17:04.712 DEBUG:teuthology.orchestra.run.smithi166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-11T19:17:04.805 DEBUG:teuthology.orchestra.run.smithi166:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-05-11T19:17:04.909 DEBUG:teuthology.orchestra.run.smithi166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-11T19:17:04.969 DEBUG:teuthology.orchestra.run.smithi166:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-05-11T19:17:05.005 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:17:05.006 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-05-11T19:17:05.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2022-05-11T19:17:05.119 DEBUG:teuthology.orchestra.run.smithi166:> sudo service rsyslog restart 2022-05-11T19:17:05.165 INFO:teuthology.orchestra.run.smithi166.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-05-11T19:17:05.166 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-05-11T19:17:05.636 INFO:teuthology.run_tasks:Running task internal.timer... 2022-05-11T19:17:05.732 INFO:teuthology.task.internal:Starting timer... 2022-05-11T19:17:05.733 INFO:teuthology.run_tasks:Running task pcp... 2022-05-11T19:17:10.591 INFO:teuthology.run_tasks:Running task selinux... 2022-05-11T19:17:12.884 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-05-11T19:17:12.884 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2022-05-11T19:17:12.940 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: [ OK ] 2022-05-11T19:17:12.941 DEBUG:teuthology.orchestra.run.smithi166:> sudo service auditd rotate 2022-05-11T19:17:13.033 INFO:teuthology.orchestra.run.smithi166.stdout:Rotating logs: [ OK ] 2022-05-11T19:17:13.034 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-05-11T19:17:13.034 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2022-05-11T19:17:13.059 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2022-05-11T19:17:13.059 DEBUG:teuthology.orchestra.run.smithi166:> /usr/sbin/getenforce 2022-05-11T19:17:13.092 INFO:teuthology.orchestra.run.smithi166.stdout:Permissive 2022-05-11T19:17:13.092 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi166.front.sepia.ceph.com': 'permissive'} 2022-05-11T19:17:13.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-05-11T19:17:13.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-11T19:17:13.129 DEBUG:teuthology.orchestra.run.smithi166:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-05-11T19:17:13.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-05-11T19:17:13.162 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-05-11T19:17:13.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2022-05-11T19:17:13.199 DEBUG:teuthology.orchestra.run.smithi166:> sudo /usr/sbin/setenforce permissive 2022-05-11T19:17:13.231 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-05-11T19:17:13.918 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2022-05-11T19:17:13.919 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-05-11T19:17:14.025 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-05-11T19:17:14.027 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi134.front.sepia.ceph.com,smithi166.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2022-05-11T19:40:01.112 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi166.front.sepia.ceph.com')] 2022-05-11T19:40:02.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2022-05-11T19:40:02.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-11T19:40:02.176 DEBUG:teuthology.orchestra.run.smithi134:> true 2022-05-11T19:40:02.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com' 2022-05-11T19:40:02.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-05-11T19:40:02.337 DEBUG:teuthology.orchestra.run.smithi166:> true 2022-05-11T19:40:02.405 INFO:teuthology.run_tasks:Running task clock... 2022-05-11T19:40:02.434 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-05-11T19:40:02.434 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-05-11T19:40:02.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-05-11T19:40:02.441 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-05-11T19:40:02.441 DEBUG:teuthology.orchestra.run.smithi166:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-05-11T19:40:02.474 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-05-11T19:40:02.481 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-05-11T19:40:02.491 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-05-11T19:40:02.497 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-05-11T19:40:02.578 INFO:teuthology.orchestra.run.smithi166.stderr:sudo: ntpd: command not found 2022-05-11T19:40:02.582 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2022-05-11T19:40:02.590 INFO:teuthology.orchestra.run.smithi166.stdout:506 Cannot talk to daemon 2022-05-11T19:40:02.594 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2022-05-11T19:40:02.605 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-05-11T19:40:02.609 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-05-11T19:40:02.619 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-05-11T19:40:02.624 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-05-11T19:40:02.687 INFO:teuthology.orchestra.run.smithi166.stderr:bash: ntpq: command not found 2022-05-11T19:40:02.688 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2022-05-11T19:40:02.692 INFO:teuthology.orchestra.run.smithi166.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-05-11T19:40:02.692 INFO:teuthology.orchestra.run.smithi166.stdout:=============================================================================== 2022-05-11T19:40:02.692 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-11T19:40:02.692 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-11T19:40:02.693 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-11T19:40:02.693 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-11T19:40:02.694 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-05-11T19:40:02.694 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2022-05-11T19:40:02.695 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-11T19:40:02.695 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-11T19:40:02.695 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-11T19:40:02.695 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-05-11T19:40:02.696 INFO:teuthology.run_tasks:Running task install... 2022-05-11T19:40:06.713 DEBUG:teuthology.task.install:project ceph 2022-05-11T19:40:06.714 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e'}} 2022-05-11T19:40:06.714 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e'} 2022-05-11T19:40:06.715 INFO:teuthology.task.install:Using flavor: default 2022-05-11T19:40:06.722 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-05-11T19:40:06.723 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-05-11T19:40:06.724 DEBUG:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2022-05-11T19:40:06.771 INFO:teuthology.orchestra.run.smithi134.stdout:RedHatEnterprise 2022-05-11T19:40:06.773 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-05-11T19:40:06.774 DEBUG:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2022-05-11T19:40:06.775 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e', 'tag': None, 'wait_for_package': False} 2022-05-11T19:40:06.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2022-05-11T19:40:06.818 INFO:teuthology.orchestra.run.smithi134.stdout:RedHatEnterprise 2022-05-11T19:40:06.819 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-05-11T19:40:06.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a6f09b69a2cce44f2caeba09a373309e0e0ba2e 2022-05-11T19:40:06.826 INFO:teuthology.orchestra.run.smithi166.stdout:RedHatEnterprise 2022-05-11T19:40:06.827 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-05-11T19:40:06.827 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e', 'tag': None, 'wait_for_package': False} 2022-05-11T19:40:06.829 DEBUG:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2022-05-11T19:40:06.878 INFO:teuthology.orchestra.run.smithi166.stdout:RedHatEnterprise 2022-05-11T19:40:06.878 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-05-11T19:40:06.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a6f09b69a2cce44f2caeba09a373309e0e0ba2e 2022-05-11T19:40:06.990 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220509-125847/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/centos/8/flavors/default/ 2022-05-11T19:40:06.991 INFO:teuthology.task.install.rpm:Package version is 17.0.0-12109.g4a6f09b6 2022-05-11T19:40:07.037 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220509-125847/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/centos/8/flavors/default/ 2022-05-11T19:40:07.037 INFO:teuthology.task.install.rpm:Package version is 17.0.0-12109.g4a6f09b6 2022-05-11T19:40:07.110 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220509-125847/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220509-125847/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220509-125847/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-05-11T19:40:07.110 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:40:07.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-05-11T19:40:07.140 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-05-11T19:40:07.141 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-05-11T19:40:07.161 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220509-125847/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220509-125847/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20220509-125847/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-05-11T19:40:07.162 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:40:07.162 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-05-11T19:40:07.195 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-05-11T19:40:07.196 DEBUG:teuthology.orchestra.run.smithi166:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-05-11T19:40:07.210 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-05-11T19:40:07.265 DEBUG:teuthology.orchestra.run.smithi166:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-05-11T19:40:07.289 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-05-11T19:40:07.347 DEBUG:teuthology.orchestra.run.smithi166:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-05-11T19:40:07.355 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2022-05-11T19:40:07.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2022-05-11T19:40:07.416 INFO:teuthology.orchestra.run.smithi166.stdout:check_obsoletes = 1 2022-05-11T19:40:07.417 DEBUG:teuthology.orchestra.run.smithi166:> sudo yum clean all 2022-05-11T19:40:07.720 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2022-05-11T19:40:07.777 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2022-05-11T19:40:08.010 INFO:teuthology.orchestra.run.smithi134.stdout:46 files removed 2022-05-11T19:40:08.056 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-05-11T19:40:08.070 INFO:teuthology.orchestra.run.smithi166.stdout:46 files removed 2022-05-11T19:40:08.116 DEBUG:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-05-11T19:40:08.375 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2022-05-11T19:40:08.435 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2022-05-11T19:40:09.110 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 261 kB/s | 78 kB 00:00 2022-05-11T19:40:09.138 INFO:teuthology.orchestra.run.smithi166.stdout:ceph packages for x86_64 282 kB/s | 78 kB 00:00 2022-05-11T19:40:09.369 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 40 kB/s | 9.1 kB 00:00 2022-05-11T19:40:09.414 INFO:teuthology.orchestra.run.smithi166.stdout:ceph noarch packages 37 kB/s | 9.1 kB 00:00 2022-05-11T19:40:09.644 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 5.6 kB/s | 1.4 kB 00:00 2022-05-11T19:40:09.664 INFO:teuthology.orchestra.run.smithi166.stdout:ceph source packages 6.2 kB/s | 1.4 kB 00:00 2022-05-11T19:40:09.787 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2022-05-11T19:40:09.790 INFO:teuthology.orchestra.run.smithi166.stdout:Copr repo for python3-asyncssh owned by ceph 32 kB/s | 3.5 kB 00:00 2022-05-11T19:40:10.973 INFO:teuthology.orchestra.run.smithi166.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 11 MB 00:01 2022-05-11T19:40:11.039 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 11 MB 00:01 2022-05-11T19:40:13.521 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 431 kB/s | 24 kB 00:00 2022-05-11T19:40:13.582 INFO:teuthology.orchestra.run.smithi166.stdout:lab-extras 199 kB/s | 24 kB 00:00 2022-05-11T19:40:14.281 INFO:teuthology.orchestra.run.smithi134.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 MB/s | 46 MB 00:00 2022-05-11T19:40:14.345 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 MB/s | 46 MB 00:00 2022-05-11T19:40:21.348 INFO:teuthology.orchestra.run.smithi134.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 63 MB/s | 40 MB 00:00 2022-05-11T19:40:21.517 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 51 MB/s | 40 MB 00:00 2022-05-11T19:40:30.988 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-05-11T19:40:30.988 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-05-11T19:40:31.000 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.32.10-4.el8.x86_64 is already installed. 2022-05-11T19:40:31.001 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-5.12.0-4.el8.x86_64 is already installed. 2022-05-11T19:40:31.002 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.32.1-28.el8.x86_64 is already installed. 2022-05-11T19:40:31.003 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-05-11T19:40:31.005 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-05-11T19:40:31.007 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-05-11T19:40:31.008 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-5.0.0-9.el8.x86_64 is already installed. 2022-05-11T19:40:31.110 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2022-05-11T19:40:31.123 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================================================= 2022-05-11T19:40:31.123 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2022-05-11T19:40:31.123 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================================================= 2022-05-11T19:40:31.123 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2022-05-11T19:40:31.124 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-05-11T19:40:31.124 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 6.5 k 2022-05-11T19:40:31.124 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 5.3 M 2022-05-11T19:40:31.124 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 882 k 2022-05-11T19:40:31.125 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 169 k 2022-05-11T19:40:31.125 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 1.5 M 2022-05-11T19:40:31.125 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 106 k 2022-05-11T19:40:31.125 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 1.6 M 2022-05-11T19:40:31.126 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 7.4 M 2022-05-11T19:40:31.126 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 47 k 2022-05-11T19:40:31.126 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 16 M 2022-05-11T19:40:31.127 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 53 M 2022-05-11T19:40:31.127 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 259 k 2022-05-11T19:40:31.127 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 75 k 2022-05-11T19:40:31.128 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 272 k 2022-05-11T19:40:31.128 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 14 k 2022-05-11T19:40:31.128 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.185-1.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-05-11T19:40:31.128 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-05-11T19:40:31.128 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-05-11T19:40:31.129 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 25 k 2022-05-11T19:40:31.129 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 797 k 2022-05-11T19:40:31.129 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 125 k 2022-05-11T19:40:31.129 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-05-11T19:40:31.130 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.32.1-28.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-05-11T19:40:31.130 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:1.1.1k-6.el8_5 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-05-11T19:40:31.130 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 178 k 2022-05-11T19:40:31.134 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 367 k 2022-05-11T19:40:31.134 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 345 k 2022-05-11T19:40:31.135 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 109 k 2022-05-11T19:40:31.135 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 93 k 2022-05-11T19:40:31.135 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 3.8 M 2022-05-11T19:40:31.135 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 175 k 2022-05-11T19:40:31.135 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 5.0.0-9.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-05-11T19:40:31.136 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2022-05-11T19:40:31.136 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_64 1:1.32.10-5.el8_5 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-05-11T19:40:31.136 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_64 1:1.32.10-5.el8_5 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-05-11T19:40:31.137 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_64 1:1.32.10-5.el8_5 rhel-8-for-x86_64-baseos-rpms 149 k 2022-05-11T19:40:31.137 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_64 1:1.32.10-5.el8_5 rhel-8-for-x86_64-baseos-rpms 336 k 2022-05-11T19:40:31.137 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 3.4 M 2022-05-11T19:40:31.137 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 3.9 M 2022-05-11T19:40:31.138 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:1.1.1k-6.el8_5 rhel-8-for-x86_64-baseos-rpms 709 k 2022-05-11T19:40:31.138 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:1.1.1k-6.el8_5 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-05-11T19:40:31.138 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2022-05-11T19:40:31.138 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-05-11T19:40:31.144 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 23 M 2022-05-11T19:40:31.145 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 23 k 2022-05-11T19:40:31.145 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 2.3 M 2022-05-11T19:40:31.145 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 229 k 2022-05-11T19:40:31.145 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 3.9 M 2022-05-11T19:40:31.145 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 17 M 2022-05-11T19:40:31.146 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 15 k 2022-05-11T19:40:31.146 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 24 k 2022-05-11T19:40:31.146 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-05-11T19:40:31.147 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-05-11T19:40:31.147 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-05-11T19:40:31.147 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-05-11T19:40:31.147 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-05-11T19:40:31.147 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 170 k 2022-05-11T19:40:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel x86_64 1.45.6-2.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-05-11T19:40:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 8.5.0-4.el8_5 rhel-8-for-x86_64-baseos-rpms 643 k 2022-05-11T19:40:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-05-11T19:40:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 8.5.0-4.el8_5 rhel-8-for-x86_64-baseos-rpms 170 k 2022-05-11T19:40:31.149 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-05-11T19:40:31.149 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 484 k 2022-05-11T19:40:31.149 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-05-11T19:40:31.149 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 5.4 M 2022-05-11T19:40:31.150 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-05-11T19:40:31.150 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-05-11T19:40:31.150 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-05-11T19:40:31.151 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-05-11T19:40:31.151 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-05-11T19:40:31.151 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-05-11T19:40:31.151 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-05-11T19:40:31.152 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-05-11T19:40:31.152 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-05-11T19:40:31.152 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-05-11T19:40:31.152 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-05-11T19:40:31.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-05-11T19:40:31.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-05-11T19:40:31.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-05-11T19:40:31.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-05-11T19:40:31.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-05-11T19:40:31.154 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 45 k 2022-05-11T19:40:31.154 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 106 k 2022-05-11T19:40:31.154 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-05-11T19:40:31.154 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-05-11T19:40:31.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-05-11T19:40:31.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-05-11T19:40:31.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-05-11T19:40:31.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-05-11T19:40:31.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-05-11T19:40:31.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-05-11T19:40:31.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-05-11T19:40:31.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-05-11T19:40:31.157 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-05-11T19:40:31.157 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-05-11T19:40:31.157 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-05-11T19:40:31.157 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-05-11T19:40:31.158 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-05-11T19:40:31.158 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-05-11T19:40:31.158 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-05-11T19:40:31.159 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-05-11T19:40:31.159 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-05-11T19:40:31.159 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-05-11T19:40:31.160 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-05-11T19:40:31.160 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-05-11T19:40:31.160 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-05-11T19:40:31.161 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-05-11T19:40:31.161 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-05-11T19:40:31.161 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-05-11T19:40:31.162 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-05-11T19:40:31.162 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-05-11T19:40:31.163 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-05-11T19:40:31.163 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-05-11T19:40:31.163 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-05-11T19:40:31.164 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-05-11T19:40:31.164 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-05-11T19:40:31.164 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-05-11T19:40:31.165 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-05-11T19:40:31.165 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-05-11T19:40:31.165 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-05-11T19:40:31.165 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-05-11T19:40:31.166 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-05-11T19:40:31.166 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-05-11T19:40:31.166 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-05-11T19:40:31.167 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-05-11T19:40:31.167 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-05-11T19:40:31.167 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-05-11T19:40:31.167 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-05-11T19:40:31.168 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-05-11T19:40:31.168 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-05-11T19:40:31.168 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-05-11T19:40:31.168 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:40:31.169 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2022-05-11T19:40:31.169 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================================================= 2022-05-11T19:40:31.169 INFO:teuthology.orchestra.run.smithi134.stdout:Install 122 Packages 2022-05-11T19:40:31.169 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 8 Packages 2022-05-11T19:40:31.170 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:40:31.170 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 209 M 2022-05-11T19:40:31.171 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2022-05-11T19:40:31.267 INFO:teuthology.orchestra.run.smithi134.stdout:(1/130): ceph-17.0.0-12109.g4a6f09b6.el8.x86_64 51 kB/s | 6.5 kB 00:00 2022-05-11T19:40:31.289 INFO:teuthology.orchestra.run.smithi166.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-05-11T19:40:31.290 INFO:teuthology.orchestra.run.smithi166.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-05-11T19:40:31.302 INFO:teuthology.orchestra.run.smithi166.stdout:Package NetworkManager-1:1.32.10-4.el8.x86_64 is already installed. 2022-05-11T19:40:31.302 INFO:teuthology.orchestra.run.smithi166.stdout:Package iproute-5.12.0-4.el8.x86_64 is already installed. 2022-05-11T19:40:31.303 INFO:teuthology.orchestra.run.smithi166.stdout:Package util-linux-2.32.1-28.el8.x86_64 is already installed. 2022-05-11T19:40:31.303 INFO:teuthology.orchestra.run.smithi166.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-05-11T19:40:31.305 INFO:teuthology.orchestra.run.smithi166.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-05-11T19:40:31.309 INFO:teuthology.orchestra.run.smithi166.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-05-11T19:40:31.309 INFO:teuthology.orchestra.run.smithi166.stdout:Package xfsprogs-5.0.0-9.el8.x86_64 is already installed. 2022-05-11T19:40:31.412 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2022-05-11T19:40:31.421 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================================================= 2022-05-11T19:40:31.422 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2022-05-11T19:40:31.422 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================================================= 2022-05-11T19:40:31.422 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2022-05-11T19:40:31.423 INFO:teuthology.orchestra.run.smithi166.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-05-11T19:40:31.423 INFO:teuthology.orchestra.run.smithi166.stdout: ceph x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 6.5 k 2022-05-11T19:40:31.423 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-base x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 5.3 M 2022-05-11T19:40:31.423 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-fuse x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 882 k 2022-05-11T19:40:31.424 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 169 k 2022-05-11T19:40:31.424 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 1.5 M 2022-05-11T19:40:31.424 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-cephadm noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 106 k 2022-05-11T19:40:31.424 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-dashboard noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 1.6 M 2022-05-11T19:40:31.424 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 7.4 M 2022-05-11T19:40:31.425 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-rook noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 47 k 2022-05-11T19:40:31.425 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-radosgw x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 16 M 2022-05-11T19:40:31.425 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-test x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 53 M 2022-05-11T19:40:31.425 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-volume noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 259 k 2022-05-11T19:40:31.426 INFO:teuthology.orchestra.run.smithi166.stdout: cephadm noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 75 k 2022-05-11T19:40:31.426 INFO:teuthology.orchestra.run.smithi166.stdout: cephfs-mirror x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 272 k 2022-05-11T19:40:31.426 INFO:teuthology.orchestra.run.smithi166.stdout: cephfs-top noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 14 k 2022-05-11T19:40:31.426 INFO:teuthology.orchestra.run.smithi166.stdout: elfutils-libelf-devel x86_64 0.185-1.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2022-05-11T19:40:31.426 INFO:teuthology.orchestra.run.smithi166.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-05-11T19:40:31.427 INFO:teuthology.orchestra.run.smithi166.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-05-11T19:40:31.427 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs-devel x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 25 k 2022-05-11T19:40:31.427 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs2 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 797 k 2022-05-11T19:40:31.427 INFO:teuthology.orchestra.run.smithi166.stdout: librados-devel x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 125 k 2022-05-11T19:40:31.428 INFO:teuthology.orchestra.run.smithi166.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-05-11T19:40:31.428 INFO:teuthology.orchestra.run.smithi166.stdout: libuuid-devel x86_64 2.32.1-28.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2022-05-11T19:40:31.428 INFO:teuthology.orchestra.run.smithi166.stdout: openssl-devel x86_64 1:1.1.1k-6.el8_5 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-05-11T19:40:31.428 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cephfs x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 178 k 2022-05-11T19:40:31.428 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rados x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 367 k 2022-05-11T19:40:31.429 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rbd x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 345 k 2022-05-11T19:40:31.429 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rgw x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 109 k 2022-05-11T19:40:31.429 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-fuse x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 93 k 2022-05-11T19:40:31.429 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-mirror x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 3.8 M 2022-05-11T19:40:31.429 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-nbd x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 175 k 2022-05-11T19:40:31.430 INFO:teuthology.orchestra.run.smithi166.stdout: xfsprogs-devel x86_64 5.0.0-9.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2022-05-11T19:40:31.430 INFO:teuthology.orchestra.run.smithi166.stdout:Upgrading: 2022-05-11T19:40:31.430 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager x86_64 1:1.32.10-5.el8_5 rhel-8-for-x86_64-baseos-rpms 2.6 M 2022-05-11T19:40:31.434 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-libnm x86_64 1:1.32.10-5.el8_5 rhel-8-for-x86_64-baseos-rpms 1.8 M 2022-05-11T19:40:31.434 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-team x86_64 1:1.32.10-5.el8_5 rhel-8-for-x86_64-baseos-rpms 149 k 2022-05-11T19:40:31.434 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-tui x86_64 1:1.32.10-5.el8_5 rhel-8-for-x86_64-baseos-rpms 336 k 2022-05-11T19:40:31.434 INFO:teuthology.orchestra.run.smithi166.stdout: librados2 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 3.4 M 2022-05-11T19:40:31.435 INFO:teuthology.orchestra.run.smithi166.stdout: librbd1 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 3.9 M 2022-05-11T19:40:31.435 INFO:teuthology.orchestra.run.smithi166.stdout: openssl x86_64 1:1.1.1k-6.el8_5 rhel-8-for-x86_64-baseos-rpms 709 k 2022-05-11T19:40:31.435 INFO:teuthology.orchestra.run.smithi166.stdout: openssl-libs x86_64 1:1.1.1k-6.el8_5 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-05-11T19:40:31.435 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2022-05-11T19:40:31.436 INFO:teuthology.orchestra.run.smithi166.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-05-11T19:40:31.436 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-common x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 23 M 2022-05-11T19:40:31.436 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-grafana-dashboards noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 23 k 2022-05-11T19:40:31.436 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mds x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 2.3 M 2022-05-11T19:40:31.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-modules-core noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 229 k 2022-05-11T19:40:31.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mon x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 3.9 M 2022-05-11T19:40:31.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-osd x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 17 M 2022-05-11T19:40:31.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-prometheus-alerts noarch 2:17.0.0-12109.g4a6f09b6.el8 ceph-noarch 15 k 2022-05-11T19:40:31.437 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-selinux x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 24 k 2022-05-11T19:40:31.438 INFO:teuthology.orchestra.run.smithi166.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-05-11T19:40:31.438 INFO:teuthology.orchestra.run.smithi166.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-05-11T19:40:31.440 INFO:teuthology.orchestra.run.smithi166.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2022-05-11T19:40:31.441 INFO:teuthology.orchestra.run.smithi166.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-05-11T19:40:31.442 INFO:teuthology.orchestra.run.smithi166.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-05-11T19:40:31.442 INFO:teuthology.orchestra.run.smithi166.stdout: libcephsqlite x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 170 k 2022-05-11T19:40:31.442 INFO:teuthology.orchestra.run.smithi166.stdout: libcom_err-devel x86_64 1.45.6-2.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2022-05-11T19:40:31.442 INFO:teuthology.orchestra.run.smithi166.stdout: libgfortran x86_64 8.5.0-4.el8_5 rhel-8-for-x86_64-baseos-rpms 643 k 2022-05-11T19:40:31.443 INFO:teuthology.orchestra.run.smithi166.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-05-11T19:40:31.443 INFO:teuthology.orchestra.run.smithi166.stdout: libquadmath x86_64 8.5.0-4.el8_5 rhel-8-for-x86_64-baseos-rpms 170 k 2022-05-11T19:40:31.443 INFO:teuthology.orchestra.run.smithi166.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-05-11T19:40:31.444 INFO:teuthology.orchestra.run.smithi166.stdout: libradosstriper1 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 484 k 2022-05-11T19:40:31.444 INFO:teuthology.orchestra.run.smithi166.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2022-05-11T19:40:31.444 INFO:teuthology.orchestra.run.smithi166.stdout: librgw2 x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 5.4 M 2022-05-11T19:40:31.444 INFO:teuthology.orchestra.run.smithi166.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-05-11T19:40:31.445 INFO:teuthology.orchestra.run.smithi166.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-05-11T19:40:31.445 INFO:teuthology.orchestra.run.smithi166.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-05-11T19:40:31.445 INFO:teuthology.orchestra.run.smithi166.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-05-11T19:40:31.445 INFO:teuthology.orchestra.run.smithi166.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-05-11T19:40:31.445 INFO:teuthology.orchestra.run.smithi166.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-05-11T19:40:31.446 INFO:teuthology.orchestra.run.smithi166.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2022-05-11T19:40:31.446 INFO:teuthology.orchestra.run.smithi166.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-05-11T19:40:31.446 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-05-11T19:40:31.446 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-05-11T19:40:31.447 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-05-11T19:40:31.447 INFO:teuthology.orchestra.run.smithi166.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-05-11T19:40:31.447 INFO:teuthology.orchestra.run.smithi166.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-05-11T19:40:31.447 INFO:teuthology.orchestra.run.smithi166.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-05-11T19:40:31.447 INFO:teuthology.orchestra.run.smithi166.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-05-11T19:40:31.448 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-05-11T19:40:31.448 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-argparse x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 45 k 2022-05-11T19:40:31.448 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-common x86_64 2:17.0.0-12109.g4a6f09b6.el8 ceph 106 k 2022-05-11T19:40:31.448 INFO:teuthology.orchestra.run.smithi166.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-05-11T19:40:31.449 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-05-11T19:40:31.449 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-05-11T19:40:31.449 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-05-11T19:40:31.450 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-05-11T19:40:31.450 INFO:teuthology.orchestra.run.smithi166.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-05-11T19:40:31.450 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-05-11T19:40:31.450 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-05-11T19:40:31.451 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-05-11T19:40:31.451 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-05-11T19:40:31.451 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-05-11T19:40:31.451 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-05-11T19:40:31.453 INFO:teuthology.orchestra.run.smithi166.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-05-11T19:40:31.453 INFO:teuthology.orchestra.run.smithi166.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-05-11T19:40:31.453 INFO:teuthology.orchestra.run.smithi166.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-05-11T19:40:31.454 INFO:teuthology.orchestra.run.smithi166.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-05-11T19:40:31.454 INFO:teuthology.orchestra.run.smithi166.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-05-11T19:40:31.454 INFO:teuthology.orchestra.run.smithi166.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-05-11T19:40:31.454 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-05-11T19:40:31.455 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-05-11T19:40:31.455 INFO:teuthology.orchestra.run.smithi166.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-05-11T19:40:31.455 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-05-11T19:40:31.455 INFO:teuthology.orchestra.run.smithi166.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-05-11T19:40:31.456 INFO:teuthology.orchestra.run.smithi166.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-05-11T19:40:31.456 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-05-11T19:40:31.456 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-05-11T19:40:31.457 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-05-11T19:40:31.457 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-05-11T19:40:31.457 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-05-11T19:40:31.457 INFO:teuthology.orchestra.run.smithi166.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-05-11T19:40:31.458 INFO:teuthology.orchestra.run.smithi166.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-05-11T19:40:31.458 INFO:teuthology.orchestra.run.smithi166.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-05-11T19:40:31.458 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-05-11T19:40:31.458 INFO:teuthology.orchestra.run.smithi166.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-05-11T19:40:31.459 INFO:teuthology.orchestra.run.smithi166.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-05-11T19:40:31.461 INFO:teuthology.orchestra.run.smithi166.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-05-11T19:40:31.461 INFO:teuthology.orchestra.run.smithi166.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-05-11T19:40:31.461 INFO:teuthology.orchestra.run.smithi166.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-05-11T19:40:31.461 INFO:teuthology.orchestra.run.smithi166.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-05-11T19:40:31.462 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-05-11T19:40:31.462 INFO:teuthology.orchestra.run.smithi166.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-05-11T19:40:31.463 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-05-11T19:40:31.463 INFO:teuthology.orchestra.run.smithi166.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-05-11T19:40:31.463 INFO:teuthology.orchestra.run.smithi166.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-05-11T19:40:31.464 INFO:teuthology.orchestra.run.smithi166.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-05-11T19:40:31.464 INFO:teuthology.orchestra.run.smithi166.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-05-11T19:40:31.464 INFO:teuthology.orchestra.run.smithi166.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-05-11T19:40:31.464 INFO:teuthology.orchestra.run.smithi166.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2022-05-11T19:40:31.464 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:40:31.465 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2022-05-11T19:40:31.465 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================================================= 2022-05-11T19:40:31.465 INFO:teuthology.orchestra.run.smithi166.stdout:Install 122 Packages 2022-05-11T19:40:31.465 INFO:teuthology.orchestra.run.smithi166.stdout:Upgrade 8 Packages 2022-05-11T19:40:31.465 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:40:31.466 INFO:teuthology.orchestra.run.smithi134.stdout:(2/130): ceph-fuse-17.0.0-12109.g4a6f09b6.el8.x 4.3 MB/s | 882 kB 00:00 2022-05-11T19:40:31.467 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 209 M 2022-05-11T19:40:31.467 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2022-05-11T19:40:31.536 INFO:teuthology.orchestra.run.smithi134.stdout:(3/130): ceph-immutable-object-cache-17.0.0-121 2.5 MB/s | 169 kB 00:00 2022-05-11T19:40:31.601 INFO:teuthology.orchestra.run.smithi166.stdout:(1/130): ceph-17.0.0-12109.g4a6f09b6.el8.x86_64 40 kB/s | 6.5 kB 00:00 2022-05-11T19:40:31.907 INFO:teuthology.orchestra.run.smithi134.stdout:(4/130): ceph-base-17.0.0-12109.g4a6f09b6.el8.x 6.9 MB/s | 5.3 MB 00:00 2022-05-11T19:40:31.957 INFO:teuthology.orchestra.run.smithi134.stdout:(5/130): ceph-mds-17.0.0-12109.g4a6f09b6.el8.x8 5.4 MB/s | 2.3 MB 00:00 2022-05-11T19:40:32.095 INFO:teuthology.orchestra.run.smithi166.stdout:(2/130): ceph-fuse-17.0.0-12109.g4a6f09b6.el8.x 1.8 MB/s | 882 kB 00:00 2022-05-11T19:40:32.157 INFO:teuthology.orchestra.run.smithi134.stdout:(6/130): ceph-mgr-17.0.0-12109.g4a6f09b6.el8.x8 6.2 MB/s | 1.5 MB 00:00 2022-05-11T19:40:32.193 INFO:teuthology.orchestra.run.smithi166.stdout:(3/130): ceph-immutable-object-cache-17.0.0-121 1.7 MB/s | 169 kB 00:00 2022-05-11T19:40:32.641 INFO:teuthology.orchestra.run.smithi134.stdout:(7/130): ceph-mon-17.0.0-12109.g4a6f09b6.el8.x8 5.7 MB/s | 3.9 MB 00:00 2022-05-11T19:40:33.643 INFO:teuthology.orchestra.run.smithi166.stdout:(4/130): ceph-mds-17.0.0-12109.g4a6f09b6.el8.x8 1.6 MB/s | 2.3 MB 00:01 2022-05-11T19:40:33.816 INFO:teuthology.orchestra.run.smithi134.stdout:(8/130): ceph-common-17.0.0-12109.g4a6f09b6.el8 8.7 MB/s | 23 MB 00:02 2022-05-11T19:40:33.903 INFO:teuthology.orchestra.run.smithi134.stdout:(9/130): ceph-selinux-17.0.0-12109.g4a6f09b6.el 292 kB/s | 24 kB 00:00 2022-05-11T19:40:33.977 INFO:teuthology.orchestra.run.smithi166.stdout:(5/130): ceph-base-17.0.0-12109.g4a6f09b6.el8.x 2.1 MB/s | 5.3 MB 00:02 2022-05-11T19:40:34.293 INFO:teuthology.orchestra.run.smithi166.stdout:(6/130): ceph-mgr-17.0.0-12109.g4a6f09b6.el8.x8 2.4 MB/s | 1.5 MB 00:00 2022-05-11T19:40:34.308 INFO:teuthology.orchestra.run.smithi134.stdout:(10/130): ceph-osd-17.0.0-12109.g4a6f09b6.el8.x 7.9 MB/s | 17 MB 00:02 2022-05-11T19:40:34.400 INFO:teuthology.orchestra.run.smithi134.stdout:(11/130): cephfs-mirror-17.0.0-12109.g4a6f09b6. 2.9 MB/s | 272 kB 00:00 2022-05-11T19:40:34.500 INFO:teuthology.orchestra.run.smithi134.stdout:(12/130): libcephfs-devel-17.0.0-12109.g4a6f09b 249 kB/s | 25 kB 00:00 2022-05-11T19:40:34.684 INFO:teuthology.orchestra.run.smithi134.stdout:(13/130): libcephfs2-17.0.0-12109.g4a6f09b6.el8 4.2 MB/s | 797 kB 00:00 2022-05-11T19:40:34.784 INFO:teuthology.orchestra.run.smithi134.stdout:(14/130): libcephsqlite-17.0.0-12109.g4a6f09b6. 1.7 MB/s | 170 kB 00:00 2022-05-11T19:40:34.869 INFO:teuthology.orchestra.run.smithi134.stdout:(15/130): librados-devel-17.0.0-12109.g4a6f09b6 1.5 MB/s | 125 kB 00:00 2022-05-11T19:40:34.960 INFO:teuthology.orchestra.run.smithi134.stdout:(16/130): libradosstriper1-17.0.0-12109.g4a6f09 5.1 MB/s | 484 kB 00:00 2022-05-11T19:40:35.279 INFO:teuthology.orchestra.run.smithi134.stdout:(17/130): ceph-radosgw-17.0.0-12109.g4a6f09b6.e 6.2 MB/s | 16 MB 00:02 2022-05-11T19:40:35.319 INFO:teuthology.orchestra.run.smithi166.stdout:(7/130): ceph-mon-17.0.0-12109.g4a6f09b6.el8.x8 2.9 MB/s | 3.9 MB 00:01 2022-05-11T19:40:35.352 INFO:teuthology.orchestra.run.smithi134.stdout:(18/130): python3-ceph-argparse-17.0.0-12109.g4 599 kB/s | 45 kB 00:00 2022-05-11T19:40:35.444 INFO:teuthology.orchestra.run.smithi134.stdout:(19/130): python3-ceph-common-17.0.0-12109.g4a6 1.1 MB/s | 106 kB 00:00 2022-05-11T19:40:35.544 INFO:teuthology.orchestra.run.smithi134.stdout:(20/130): librgw2-17.0.0-12109.g4a6f09b6.el8.x8 9.2 MB/s | 5.4 MB 00:00 2022-05-11T19:40:35.569 INFO:teuthology.orchestra.run.smithi134.stdout:(21/130): python3-cephfs-17.0.0-12109.g4a6f09b6 1.4 MB/s | 178 kB 00:00 2022-05-11T19:40:35.621 INFO:teuthology.orchestra.run.smithi134.stdout:(22/130): python3-rados-17.0.0-12109.g4a6f09b6. 4.8 MB/s | 367 kB 00:00 2022-05-11T19:40:35.662 INFO:teuthology.orchestra.run.smithi134.stdout:(23/130): python3-rbd-17.0.0-12109.g4a6f09b6.el 3.7 MB/s | 345 kB 00:00 2022-05-11T19:40:35.696 INFO:teuthology.orchestra.run.smithi134.stdout:(24/130): python3-rgw-17.0.0-12109.g4a6f09b6.el 1.4 MB/s | 109 kB 00:00 2022-05-11T19:40:35.720 INFO:teuthology.orchestra.run.smithi134.stdout:(25/130): rbd-fuse-17.0.0-12109.g4a6f09b6.el8.x 1.6 MB/s | 93 kB 00:00 2022-05-11T19:40:35.813 INFO:teuthology.orchestra.run.smithi134.stdout:(26/130): rbd-nbd-17.0.0-12109.g4a6f09b6.el8.x8 1.9 MB/s | 175 kB 00:00 2022-05-11T19:40:35.904 INFO:teuthology.orchestra.run.smithi134.stdout:(27/130): ceph-grafana-dashboards-17.0.0-12109. 247 kB/s | 23 kB 00:00 2022-05-11T19:40:36.013 INFO:teuthology.orchestra.run.smithi134.stdout:(28/130): ceph-mgr-cephadm-17.0.0-12109.g4a6f09 975 kB/s | 106 kB 00:00 2022-05-11T19:40:36.155 INFO:teuthology.orchestra.run.smithi134.stdout:(29/130): rbd-mirror-17.0.0-12109.g4a6f09b6.el8 8.2 MB/s | 3.8 MB 00:00 2022-05-11T19:40:36.388 INFO:teuthology.orchestra.run.smithi134.stdout:(30/130): ceph-mgr-dashboard-17.0.0-12109.g4a6f 4.3 MB/s | 1.6 MB 00:00 2022-05-11T19:40:36.497 INFO:teuthology.orchestra.run.smithi134.stdout:(31/130): ceph-mgr-modules-core-17.0.0-12109.g4 2.1 MB/s | 229 kB 00:00 2022-05-11T19:40:36.589 INFO:teuthology.orchestra.run.smithi134.stdout:(32/130): ceph-mgr-rook-17.0.0-12109.g4a6f09b6. 513 kB/s | 47 kB 00:00 2022-05-11T19:40:36.681 INFO:teuthology.orchestra.run.smithi134.stdout:(33/130): ceph-prometheus-alerts-17.0.0-12109.g 160 kB/s | 15 kB 00:00 2022-05-11T19:40:36.781 INFO:teuthology.orchestra.run.smithi134.stdout:(34/130): ceph-volume-17.0.0-12109.g4a6f09b6.el 2.5 MB/s | 259 kB 00:00 2022-05-11T19:40:36.873 INFO:teuthology.orchestra.run.smithi134.stdout:(35/130): cephadm-17.0.0-12109.g4a6f09b6.el8.no 820 kB/s | 75 kB 00:00 2022-05-11T19:40:37.007 INFO:teuthology.orchestra.run.smithi134.stdout:(36/130): ceph-mgr-diskprediction-local-17.0.0- 8.7 MB/s | 7.4 MB 00:00 2022-05-11T19:40:37.032 INFO:teuthology.orchestra.run.smithi134.stdout:(37/130): cephfs-top-17.0.0-12109.g4a6f09b6.el8 91 kB/s | 14 kB 00:00 2022-05-11T19:40:37.166 INFO:teuthology.orchestra.run.smithi134.stdout:(38/130): liboath-2.6.2-3.el8.x86_64.rpm 441 kB/s | 59 kB 00:00 2022-05-11T19:40:37.224 INFO:teuthology.orchestra.run.smithi134.stdout:(39/130): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2022-05-11T19:40:37.250 INFO:teuthology.orchestra.run.smithi134.stdout:(40/130): libunwind-1.3.1-3.el8.x86_64.rpm 897 kB/s | 75 kB 00:00 2022-05-11T19:40:37.300 INFO:teuthology.orchestra.run.smithi134.stdout:(41/130): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2022-05-11T19:40:37.325 INFO:teuthology.orchestra.run.smithi134.stdout:(42/130): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2022-05-11T19:40:37.385 INFO:teuthology.orchestra.run.smithi134.stdout:(43/130): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2022-05-11T19:40:37.409 INFO:teuthology.orchestra.run.smithi134.stdout:(44/130): python3-cachetools-3.1.1-4.el8.noarch 394 kB/s | 33 kB 00:00 2022-05-11T19:40:37.476 INFO:teuthology.orchestra.run.smithi134.stdout:(45/130): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2022-05-11T19:40:37.501 INFO:teuthology.orchestra.run.smithi134.stdout:(46/130): python3-certifi-2018.10.15-7.el8.noar 139 kB/s | 16 kB 00:00 2022-05-11T19:40:37.677 INFO:teuthology.orchestra.run.smithi134.stdout:(47/130): python3-google-auth-1.1.1-10.el8.noar 464 kB/s | 81 kB 00:00 2022-05-11T19:40:37.702 INFO:teuthology.orchestra.run.smithi134.stdout:(48/130): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2022-05-11T19:40:37.736 INFO:teuthology.orchestra.run.smithi134.stdout:(49/130): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2022-05-11T19:40:37.770 INFO:teuthology.orchestra.run.smithi134.stdout:(50/130): python3-jaraco-functools-2.0-4.el8.no 262 kB/s | 18 kB 00:00 2022-05-11T19:40:37.837 INFO:teuthology.orchestra.run.smithi134.stdout:(51/130): python3-logutils-0.3.5-11.el8.noarch. 730 kB/s | 49 kB 00:00 2022-05-11T19:40:37.903 INFO:teuthology.orchestra.run.smithi134.stdout:(52/130): python3-more-itertools-7.2.0-3.el8.no 881 kB/s | 59 kB 00:00 2022-05-11T19:40:37.962 INFO:teuthology.orchestra.run.smithi134.stdout:(53/130): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2022-05-11T19:40:37.995 INFO:teuthology.orchestra.run.smithi134.stdout:(54/130): python3-kubernetes-11.0.0-6.el8.noarc 4.5 MB/s | 1.2 MB 00:00 2022-05-11T19:40:38.046 INFO:teuthology.orchestra.run.smithi134.stdout:(55/130): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2022-05-11T19:40:38.066 INFO:teuthology.orchestra.run.smithi134.stdout:(56/130): python3-portend-2.6-1.el8.noarch.rpm 232 kB/s | 16 kB 00:00 2022-05-11T19:40:38.088 INFO:teuthology.orchestra.run.smithi134.stdout:(57/130): python3-repoze-lru-0.7-6.el8.noarch.r 801 kB/s | 34 kB 00:00 2022-05-11T19:40:38.114 INFO:teuthology.orchestra.run.smithi134.stdout:(58/130): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2022-05-11T19:40:38.147 INFO:teuthology.orchestra.run.smithi134.stdout:(59/130): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2022-05-11T19:40:38.164 INFO:teuthology.orchestra.run.smithi134.stdout:(60/130): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2022-05-11T19:40:38.198 INFO:teuthology.orchestra.run.smithi134.stdout:(61/130): python3-singledispatch-3.4.0.3-18.el8 475 kB/s | 24 kB 00:00 2022-05-11T19:40:38.215 INFO:teuthology.orchestra.run.smithi134.stdout:(62/130): python3-tempora-1.14.1-5.el8.noarch.r 580 kB/s | 29 kB 00:00 2022-05-11T19:40:38.240 INFO:teuthology.orchestra.run.smithi134.stdout:(63/130): python3-trustme-0.6.0-4.el8.noarch.rp 655 kB/s | 27 kB 00:00 2022-05-11T19:40:38.274 INFO:teuthology.orchestra.run.smithi134.stdout:(64/130): python3-waitress-1.2.1-2.el8.1.noarch 4.0 MB/s | 241 kB 00:00 2022-05-11T19:40:38.299 INFO:teuthology.orchestra.run.smithi134.stdout:(65/130): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2022-05-11T19:40:38.316 INFO:teuthology.orchestra.run.smithi134.stdout:(66/130): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2022-05-11T19:40:38.349 INFO:teuthology.orchestra.run.smithi134.stdout:(67/130): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2022-05-11T19:40:38.375 INFO:teuthology.orchestra.run.smithi134.stdout:(68/130): python3-zc-lockfile-2.0-2.el8.noarch. 389 kB/s | 23 kB 00:00 2022-05-11T19:40:38.425 INFO:teuthology.orchestra.run.smithi134.stdout:(69/130): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.3 MB/s | 69 kB 00:00 2022-05-11T19:40:38.484 INFO:teuthology.orchestra.run.smithi134.stdout:(70/130): libcom_err-devel-1.45.6-2.el8.x86_64. 658 kB/s | 38 kB 00:00 2022-05-11T19:40:38.934 INFO:teuthology.orchestra.run.smithi134.stdout:(71/130): ceph-test-17.0.0-12109.g4a6f09b6.el8. 10 MB/s | 53 MB 00:05 2022-05-11T19:40:38.993 INFO:teuthology.orchestra.run.smithi134.stdout:(72/130): thrift-0.13.0-2.el8.x86_64.rpm 2.7 MB/s | 1.7 MB 00:00 2022-05-11T19:40:39.018 INFO:teuthology.orchestra.run.smithi134.stdout:(73/130): keyutils-libs-devel-1.5.10-9.el8.x86_ 90 kB/s | 48 kB 00:00 2022-05-11T19:40:39.064 INFO:teuthology.orchestra.run.smithi134.stdout:(74/130): zlib-devel-1.2.11-17.el8.x86_64.rpm 460 kB/s | 58 kB 00:00 2022-05-11T19:40:39.120 INFO:teuthology.orchestra.run.smithi134.stdout:(75/130): python3-requests-oauthlib-1.0.0-1.el8 392 kB/s | 43 kB 00:00 2022-05-11T19:40:39.127 INFO:teuthology.orchestra.run.smithi134.stdout:(76/130): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.3 MB/s | 229 kB 00:00 2022-05-11T19:40:39.136 INFO:teuthology.orchestra.run.smithi166.stdout:(8/130): ceph-osd-17.0.0-12109.g4a6f09b6.el8.x8 3.5 MB/s | 17 MB 00:04 2022-05-11T19:40:39.187 INFO:teuthology.orchestra.run.smithi134.stdout:(77/130): libquadmath-8.5.0-4.el8_5.x86_64.rpm 3.1 MB/s | 170 kB 00:00 2022-05-11T19:40:39.211 INFO:teuthology.orchestra.run.smithi134.stdout:(78/130): xfsprogs-devel-5.0.0-9.el8.x86_64.rpm 645 kB/s | 70 kB 00:00 2022-05-11T19:40:39.261 INFO:teuthology.orchestra.run.smithi134.stdout:(79/130): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2022-05-11T19:40:40.306 INFO:teuthology.orchestra.run.smithi166.stdout:(9/130): ceph-radosgw-17.0.0-12109.g4a6f09b6.el 4.1 MB/s | 16 MB 00:03 2022-05-11T19:40:40.306 INFO:teuthology.orchestra.run.smithi166.stdout:(10/130): ceph-selinux-17.0.0-12109.g4a6f09b6.e 139 kB/s | 24 kB 00:00 2022-05-11T19:40:40.306 INFO:teuthology.orchestra.run.smithi166.stdout:(11/130): cephfs-mirror-17.0.0-12109.g4a6f09b6. 3.2 MB/s | 272 kB 00:00 2022-05-11T19:40:40.307 INFO:teuthology.orchestra.run.smithi166.stdout:(12/130): libcephfs-devel-17.0.0-12109.g4a6f09b 498 kB/s | 25 kB 00:00 2022-05-11T19:40:40.307 INFO:teuthology.orchestra.run.smithi166.stdout:(13/130): ceph-common-17.0.0-12109.g4a6f09b6.el 2.8 MB/s | 23 MB 00:08 2022-05-11T19:40:40.307 INFO:teuthology.orchestra.run.smithi166.stdout:(14/130): libcephfs2-17.0.0-12109.g4a6f09b6.el8 2.2 MB/s | 797 kB 00:00 2022-05-11T19:40:40.307 INFO:teuthology.orchestra.run.smithi166.stdout:(15/130): libcephsqlite-17.0.0-12109.g4a6f09b6. 4.0 MB/s | 170 kB 00:00 2022-05-11T19:40:40.308 INFO:teuthology.orchestra.run.smithi166.stdout:(16/130): librados-devel-17.0.0-12109.g4a6f09b6 1.5 MB/s | 125 kB 00:00 2022-05-11T19:40:40.308 INFO:teuthology.orchestra.run.smithi166.stdout:(17/130): libradosstriper1-17.0.0-12109.g4a6f09 3.5 MB/s | 484 kB 00:00 2022-05-11T19:40:40.308 INFO:teuthology.orchestra.run.smithi166.stdout:(18/130): python3-ceph-argparse-17.0.0-12109.g4 888 kB/s | 45 kB 00:00 2022-05-11T19:40:40.308 INFO:teuthology.orchestra.run.smithi166.stdout:(19/130): python3-ceph-common-17.0.0-12109.g4a6 2.1 MB/s | 106 kB 00:00 2022-05-11T19:40:40.309 INFO:teuthology.orchestra.run.smithi166.stdout:(20/130): python3-cephfs-17.0.0-12109.g4a6f09b6 3.0 MB/s | 178 kB 00:00 2022-05-11T19:40:40.309 INFO:teuthology.orchestra.run.smithi166.stdout:(21/130): python3-rados-17.0.0-12109.g4a6f09b6. 2.9 MB/s | 367 kB 00:00 2022-05-11T19:40:40.311 INFO:teuthology.orchestra.run.smithi134.stdout:(80/130): libaio-devel-0.3.112-1.el8.x86_64.rpm 249 kB/s | 19 kB 00:00 2022-05-11T19:40:40.311 INFO:teuthology.orchestra.run.smithi134.stdout:(81/130): openssl-devel-1.1.1k-6.el8_5.x86_64.r 8.8 MB/s | 2.3 MB 00:00 2022-05-11T19:40:40.312 INFO:teuthology.orchestra.run.smithi134.stdout:(82/130): libuuid-devel-2.32.1-28.el8.x86_64.rp 829 kB/s | 97 kB 00:00 2022-05-11T19:40:40.312 INFO:teuthology.orchestra.run.smithi134.stdout:(83/130): python3-jwt-1.6.1-2.el8.noarch.rpm 364 kB/s | 43 kB 00:00 2022-05-11T19:40:40.312 INFO:teuthology.orchestra.run.smithi134.stdout:(84/130): libgfortran-8.5.0-4.el8_5.x86_64.rpm 5.3 MB/s | 643 kB 00:00 2022-05-11T19:40:40.312 INFO:teuthology.orchestra.run.smithi134.stdout:(85/130): python3-pycparser-2.14-14.el8.noarch. 1.5 MB/s | 109 kB 00:00 2022-05-11T19:40:40.312 INFO:teuthology.orchestra.run.smithi134.stdout:(86/130): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2022-05-11T19:40:40.313 INFO:teuthology.orchestra.run.smithi134.stdout:(87/130): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.4 MB/s | 560 kB 00:00 2022-05-11T19:40:40.313 INFO:teuthology.orchestra.run.smithi134.stdout:(88/130): librabbitmq-0.9.0-3.el8.x86_64.rpm 623 kB/s | 47 kB 00:00 2022-05-11T19:40:40.313 INFO:teuthology.orchestra.run.smithi134.stdout:(89/130): python3-cryptography-3.2.1-5.el8.x86_ 4.2 MB/s | 559 kB 00:00 2022-05-11T19:40:40.313 INFO:teuthology.orchestra.run.smithi134.stdout:(90/130): libverto-devel-0.3.0-5.el8.x86_64.rpm 178 kB/s | 18 kB 00:00 2022-05-11T19:40:40.314 INFO:teuthology.orchestra.run.smithi134.stdout:(91/130): elfutils-libelf-devel-0.185-1.el8.x86 584 kB/s | 59 kB 00:00 2022-05-11T19:40:40.314 INFO:teuthology.orchestra.run.smithi134.stdout:(92/130): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2022-05-11T19:40:40.314 INFO:teuthology.orchestra.run.smithi134.stdout:(93/130): fuse-2.9.7-12.el8.x86_64.rpm 759 kB/s | 83 kB 00:00 2022-05-11T19:40:40.314 INFO:teuthology.orchestra.run.smithi134.stdout:(94/130): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.1 MB/s | 220 kB 00:00 2022-05-11T19:40:40.314 INFO:teuthology.orchestra.run.smithi134.stdout:(95/130): libsepol-devel-2.9-3.el8.x86_64.rpm 832 kB/s | 87 kB 00:00 2022-05-11T19:40:40.315 INFO:teuthology.orchestra.run.smithi134.stdout:(96/130): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2022-05-11T19:40:40.315 INFO:teuthology.orchestra.run.smithi134.stdout:(97/130): python3-pyasn1-modules-0.3.7-6.el8.no 1.2 MB/s | 110 kB 00:00 2022-05-11T19:40:40.315 INFO:teuthology.orchestra.run.smithi134.stdout:(98/130): jq-1.5-12.el8.x86_64.rpm 1.6 MB/s | 161 kB 00:00 2022-05-11T19:40:40.315 INFO:teuthology.orchestra.run.smithi134.stdout:(99/130): python3-jsonpatch-1.21-2.el8.noarch.r 264 kB/s | 27 kB 00:00 2022-05-11T19:40:40.316 INFO:teuthology.orchestra.run.smithi134.stdout:(100/130): oniguruma-6.8.2-2.el8.x86_64.rpm 1.9 MB/s | 187 kB 00:00 2022-05-11T19:40:40.316 INFO:teuthology.orchestra.run.smithi134.stdout:(101/130): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.6 MB/s | 259 kB 00:00 2022-05-11T19:40:40.316 INFO:teuthology.orchestra.run.smithi134.stdout:(102/130): python3-jsonpointer-1.10-11.el8.noar 239 kB/s | 20 kB 00:00 2022-05-11T19:40:40.316 INFO:teuthology.orchestra.run.smithi134.stdout:(103/130): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.6 MB/s | 126 kB 00:00 2022-05-11T19:40:40.317 INFO:teuthology.orchestra.run.smithi134.stdout:(104/130): automake-1.16.1-7.el8.noarch.rpm 7.6 MB/s | 713 kB 00:00 2022-05-11T19:40:40.317 INFO:teuthology.orchestra.run.smithi134.stdout:(105/130): python3-pytz-2017.2-9.el8.noarch.rpm 682 kB/s | 54 kB 00:00 2022-05-11T19:40:40.317 INFO:teuthology.orchestra.run.smithi134.stdout:(106/130): flex-2.6.1-9.el8.x86_64.rpm 4.7 MB/s | 320 kB 00:00 2022-05-11T19:40:40.317 INFO:teuthology.orchestra.run.smithi134.stdout:(107/130): librdkafka-0.11.4-1.el8.x86_64.rpm 4.6 MB/s | 353 kB 00:00 2022-05-11T19:40:40.318 INFO:teuthology.orchestra.run.smithi134.stdout:(108/130): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2022-05-11T19:40:40.339 INFO:teuthology.orchestra.run.smithi166.stdout:(22/130): python3-rbd-17.0.0-12109.g4a6f09b6.el 3.1 MB/s | 345 kB 00:00 2022-05-11T19:40:40.340 INFO:teuthology.orchestra.run.smithi134.stdout:(109/130): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2022-05-11T19:40:40.407 INFO:teuthology.orchestra.run.smithi166.stdout:(23/130): python3-rgw-17.0.0-12109.g4a6f09b6.el 1.6 MB/s | 109 kB 00:00 2022-05-11T19:40:40.415 INFO:teuthology.orchestra.run.smithi134.stdout:(110/130): python3-babel-2.5.1-7.el8.noarch.rpm 28 MB/s | 4.8 MB 00:00 2022-05-11T19:40:40.442 INFO:teuthology.orchestra.run.smithi134.stdout:(111/130): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2022-05-11T19:40:40.457 INFO:teuthology.orchestra.run.smithi166.stdout:(24/130): rbd-fuse-17.0.0-12109.g4a6f09b6.el8.x 1.8 MB/s | 93 kB 00:00 2022-05-11T19:40:40.596 INFO:teuthology.orchestra.run.smithi134.stdout:(112/130): python3-scipy-1.0.0-21.module+el8.5. 25 MB/s | 14 MB 00:00 2022-05-11T19:40:40.622 INFO:teuthology.orchestra.run.smithi134.stdout:(113/130): python3-numpy-f2py-1.14.3-10.el8.x86 1.1 MB/s | 225 kB 00:00 2022-05-11T19:40:40.654 INFO:teuthology.orchestra.run.smithi134.stdout:(114/130): libtool-2.4.6-25.el8.x86_64.rpm 3.2 MB/s | 709 kB 00:00 2022-05-11T19:40:40.713 INFO:teuthology.orchestra.run.smithi134.stdout:(115/130): python3-markupsafe-0.23-19.el8.x86_6 777 kB/s | 39 kB 00:00 2022-05-11T19:40:40.738 INFO:teuthology.orchestra.run.smithi134.stdout:(116/130): python3-jinja2-2.10.1-3.el8.noarch.r 4.7 MB/s | 538 kB 00:00 2022-05-11T19:40:40.831 INFO:teuthology.orchestra.run.smithi134.stdout:(117/130): openblas-threads-0.3.12-1.el8.x86_64 20 MB/s | 4.7 MB 00:00 2022-05-11T19:40:40.855 INFO:teuthology.orchestra.run.smithi134.stdout:(118/130): python3-prettytable-0.7.2-14.el8.noa 309 kB/s | 44 kB 00:00 2022-05-11T19:40:40.883 INFO:teuthology.orchestra.run.smithi134.stdout:(119/130): python3-werkzeug-0.12.2-4.el8.noarch 3.2 MB/s | 457 kB 00:00 2022-05-11T19:40:40.898 INFO:teuthology.orchestra.run.smithi166.stdout:(25/130): librgw2-17.0.0-12109.g4a6f09b6.el8.x8 5.3 MB/s | 5.4 MB 00:01 2022-05-11T19:40:40.940 INFO:teuthology.orchestra.run.smithi134.stdout:(120/130): bison-3.0.4-10.el8.x86_64.rpm 6.7 MB/s | 688 kB 00:00 2022-05-11T19:40:40.956 INFO:teuthology.orchestra.run.smithi166.stdout:(26/130): rbd-nbd-17.0.0-12109.g4a6f09b6.el8.x8 3.0 MB/s | 175 kB 00:00 2022-05-11T19:40:41.006 INFO:teuthology.orchestra.run.smithi134.stdout:(121/130): python3-numpy-1.14.3-10.el8.x86_64.r 25 MB/s | 3.7 MB 00:00 2022-05-11T19:40:41.007 INFO:teuthology.orchestra.run.smithi166.stdout:(27/130): ceph-grafana-dashboards-17.0.0-12109. 455 kB/s | 23 kB 00:00 2022-05-11T19:40:41.074 INFO:teuthology.orchestra.run.smithi134.stdout:(122/130): openblas-0.3.12-1.el8.x86_64.rpm 25 MB/s | 4.6 MB 00:00 2022-05-11T19:40:41.090 INFO:teuthology.orchestra.run.smithi166.stdout:(28/130): rbd-mirror-17.0.0-12109.g4a6f09b6.el8 5.9 MB/s | 3.8 MB 00:00 2022-05-11T19:40:41.116 INFO:teuthology.orchestra.run.smithi166.stdout:(29/130): ceph-mgr-cephadm-17.0.0-12109.g4a6f09 972 kB/s | 106 kB 00:00 2022-05-11T19:40:41.123 INFO:teuthology.orchestra.run.smithi134.stdout:(123/130): openssl-1.1.1k-6.el8_5.x86_64.rpm 14 MB/s | 709 kB 00:00 2022-05-11T19:40:41.182 INFO:teuthology.orchestra.run.smithi134.stdout:(124/130): openssl-libs-1.1.1k-6.el8_5.x86_64.r 25 MB/s | 1.5 MB 00:00 2022-05-11T19:40:41.257 INFO:teuthology.orchestra.run.smithi134.stdout:(125/130): NetworkManager-1.32.10-5.el8_5.x86_6 35 MB/s | 2.6 MB 00:00 2022-05-11T19:40:41.300 INFO:teuthology.orchestra.run.smithi134.stdout:(126/130): NetworkManager-team-1.32.10-5.el8_5. 3.5 MB/s | 149 kB 00:00 2022-05-11T19:40:41.375 INFO:teuthology.orchestra.run.smithi134.stdout:(127/130): NetworkManager-libnm-1.32.10-5.el8_5 24 MB/s | 1.8 MB 00:00 2022-05-11T19:40:41.424 INFO:teuthology.orchestra.run.smithi134.stdout:(128/130): NetworkManager-tui-1.32.10-5.el8_5.x 6.6 MB/s | 336 kB 00:00 2022-05-11T19:40:44.385 INFO:teuthology.orchestra.run.smithi134.stdout:(129/130): librbd1-17.0.0-12109.g4a6f09b6.el8.x 6.7 MB/s | 3.9 MB 00:00 2022-05-11T19:40:44.385 INFO:teuthology.orchestra.run.smithi134.stdout:(130/130): librados2-17.0.0-12109.g4a6f09b6.el8 4.9 MB/s | 3.4 MB 00:00 2022-05-11T19:40:44.385 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2022-05-11T19:40:44.386 INFO:teuthology.orchestra.run.smithi134.stdout:Total 20 MB/s | 209 MB 00:10 2022-05-11T19:40:44.397 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2022-05-11T19:40:44.400 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2022-05-11T19:40:44.401 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2022-05-11T19:40:44.401 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2022-05-11T19:40:44.401 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2022-05-11T19:40:44.412 INFO:teuthology.orchestra.run.smithi166.stdout:(30/130): ceph-mgr-dashboard-17.0.0-12109.g4a6f 3.9 MB/s | 1.6 MB 00:00 2022-05-11T19:40:44.412 INFO:teuthology.orchestra.run.smithi166.stdout:(31/130): ceph-mgr-modules-core-17.0.0-12109.g4 3.3 MB/s | 229 kB 00:00 2022-05-11T19:40:44.412 INFO:teuthology.orchestra.run.smithi166.stdout:(32/130): ceph-mgr-rook-17.0.0-12109.g4a6f09b6. 808 kB/s | 47 kB 00:00 2022-05-11T19:40:44.412 INFO:teuthology.orchestra.run.smithi166.stdout:(33/130): ceph-prometheus-alerts-17.0.0-12109.g 251 kB/s | 15 kB 00:00 2022-05-11T19:40:44.413 INFO:teuthology.orchestra.run.smithi166.stdout:(34/130): ceph-volume-17.0.0-12109.g4a6f09b6.el 3.4 MB/s | 259 kB 00:00 2022-05-11T19:40:44.413 INFO:teuthology.orchestra.run.smithi166.stdout:(35/130): cephadm-17.0.0-12109.g4a6f09b6.el8.no 1.3 MB/s | 75 kB 00:00 2022-05-11T19:40:44.413 INFO:teuthology.orchestra.run.smithi166.stdout:(36/130): cephfs-top-17.0.0-12109.g4a6f09b6.el8 289 kB/s | 14 kB 00:00 2022-05-11T19:40:44.414 INFO:teuthology.orchestra.run.smithi166.stdout:(37/130): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2022-05-11T19:40:44.414 INFO:teuthology.orchestra.run.smithi166.stdout:(38/130): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2022-05-11T19:40:44.414 INFO:teuthology.orchestra.run.smithi166.stdout:(39/130): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2022-05-11T19:40:44.414 INFO:teuthology.orchestra.run.smithi166.stdout:(40/130): ceph-mgr-diskprediction-local-17.0.0- 6.1 MB/s | 7.4 MB 00:01 2022-05-11T19:40:44.415 INFO:teuthology.orchestra.run.smithi166.stdout:(41/130): python3-asyncssh-2.7.0-2.el8.noarch.r 2.9 MB/s | 476 kB 00:00 2022-05-11T19:40:44.415 INFO:teuthology.orchestra.run.smithi166.stdout:(42/130): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2022-05-11T19:40:44.415 INFO:teuthology.orchestra.run.smithi166.stdout:(43/130): python3-cachetools-3.1.1-4.el8.noarch 566 kB/s | 33 kB 00:00 2022-05-11T19:40:44.415 INFO:teuthology.orchestra.run.smithi166.stdout:(44/130): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 261 kB/s | 44 kB 00:00 2022-05-11T19:40:44.416 INFO:teuthology.orchestra.run.smithi166.stdout:(45/130): python3-certifi-2018.10.15-7.el8.noar 278 kB/s | 16 kB 00:00 2022-05-11T19:40:44.416 INFO:teuthology.orchestra.run.smithi166.stdout:(46/130): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2022-05-11T19:40:44.416 INFO:teuthology.orchestra.run.smithi166.stdout:(47/130): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2022-05-11T19:40:44.417 INFO:teuthology.orchestra.run.smithi166.stdout:(48/130): python3-google-auth-1.1.1-10.el8.noar 402 kB/s | 81 kB 00:00 2022-05-11T19:40:44.417 INFO:teuthology.orchestra.run.smithi166.stdout:(49/130): python3-jaraco-6.2-6.el8.noarch.rpm 55 kB/s | 11 kB 00:00 2022-05-11T19:40:44.418 INFO:teuthology.orchestra.run.smithi166.stdout:(50/130): python3-jaraco-functools-2.0-4.el8.no 364 kB/s | 18 kB 00:00 2022-05-11T19:40:44.418 INFO:teuthology.orchestra.run.smithi166.stdout:(51/130): python3-logutils-0.3.5-11.el8.noarch. 973 kB/s | 49 kB 00:00 2022-05-11T19:40:44.418 INFO:teuthology.orchestra.run.smithi166.stdout:(52/130): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2022-05-11T19:40:44.418 INFO:teuthology.orchestra.run.smithi166.stdout:(53/130): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2022-05-11T19:40:44.419 INFO:teuthology.orchestra.run.smithi166.stdout:(54/130): python3-natsort-7.1.1-2.el8.noarch.rp 722 kB/s | 60 kB 00:00 2022-05-11T19:40:44.419 INFO:teuthology.orchestra.run.smithi166.stdout:(55/130): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2022-05-11T19:40:44.419 INFO:teuthology.orchestra.run.smithi166.stdout:(56/130): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2022-05-11T19:40:44.419 INFO:teuthology.orchestra.run.smithi166.stdout:(57/130): python3-repoze-lru-0.7-6.el8.noarch.r 806 kB/s | 34 kB 00:00 2022-05-11T19:40:44.420 INFO:teuthology.orchestra.run.smithi166.stdout:(58/130): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2022-05-11T19:40:44.421 INFO:teuthology.orchestra.run.smithi166.stdout:(59/130): python3-rsa-4.8-1.el8.noarch.rpm 1.4 MB/s | 61 kB 00:00 2022-05-11T19:40:44.421 INFO:teuthology.orchestra.run.smithi166.stdout:(60/130): python3-simplegeneric-0.8.1-17.el8.no 447 kB/s | 19 kB 00:00 2022-05-11T19:40:44.421 INFO:teuthology.orchestra.run.smithi166.stdout:(61/130): python3-singledispatch-3.4.0.3-18.el8 571 kB/s | 24 kB 00:00 2022-05-11T19:40:44.421 INFO:teuthology.orchestra.run.smithi166.stdout:(62/130): python3-tempora-1.14.1-5.el8.noarch.r 699 kB/s | 29 kB 00:00 2022-05-11T19:40:44.422 INFO:teuthology.orchestra.run.smithi166.stdout:(63/130): python3-trustme-0.6.0-4.el8.noarch.rp 659 kB/s | 27 kB 00:00 2022-05-11T19:40:44.422 INFO:teuthology.orchestra.run.smithi166.stdout:(64/130): python3-waitress-1.2.1-2.el8.1.noarch 4.0 MB/s | 241 kB 00:00 2022-05-11T19:40:44.423 INFO:teuthology.orchestra.run.smithi166.stdout:(65/130): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2022-05-11T19:40:44.423 INFO:teuthology.orchestra.run.smithi166.stdout:(66/130): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2022-05-11T19:40:44.423 INFO:teuthology.orchestra.run.smithi166.stdout:(67/130): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2022-05-11T19:40:44.423 INFO:teuthology.orchestra.run.smithi166.stdout:(68/130): python3-zc-lockfile-2.0-2.el8.noarch. 456 kB/s | 23 kB 00:00 2022-05-11T19:40:44.424 INFO:teuthology.orchestra.run.smithi166.stdout:(69/130): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2022-05-11T19:40:44.424 INFO:teuthology.orchestra.run.smithi166.stdout:(70/130): libcom_err-devel-1.45.6-2.el8.x86_64. 576 kB/s | 38 kB 00:00 2022-05-11T19:40:44.424 INFO:teuthology.orchestra.run.smithi166.stdout:(71/130): keyutils-libs-devel-1.5.10-9.el8.x86_ 965 kB/s | 48 kB 00:00 2022-05-11T19:40:44.424 INFO:teuthology.orchestra.run.smithi166.stdout:(72/130): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2022-05-11T19:40:44.424 INFO:teuthology.orchestra.run.smithi166.stdout:(73/130): python3-requests-oauthlib-1.0.0-1.el8 855 kB/s | 43 kB 00:00 2022-05-11T19:40:44.425 INFO:teuthology.orchestra.run.smithi166.stdout:(74/130): thrift-0.13.0-2.el8.x86_64.rpm 5.2 MB/s | 1.7 MB 00:00 2022-05-11T19:40:44.425 INFO:teuthology.orchestra.run.smithi166.stdout:(75/130): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2022-05-11T19:40:44.425 INFO:teuthology.orchestra.run.smithi166.stdout:(76/130): openssl-devel-1.1.1k-6.el8_5.x86_64.r 20 MB/s | 2.3 MB 00:00 2022-05-11T19:40:44.425 INFO:teuthology.orchestra.run.smithi166.stdout:(77/130): xfsprogs-devel-5.0.0-9.el8.x86_64.rpm 839 kB/s | 70 kB 00:00 2022-05-11T19:40:44.426 INFO:teuthology.orchestra.run.smithi166.stdout:(78/130): libquadmath-8.5.0-4.el8_5.x86_64.rpm 2.5 MB/s | 170 kB 00:00 2022-05-11T19:40:44.426 INFO:teuthology.orchestra.run.smithi166.stdout:(79/130): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2022-05-11T19:40:44.426 INFO:teuthology.orchestra.run.smithi166.stdout:(80/130): libaio-devel-0.3.112-1.el8.x86_64.rpm 249 kB/s | 19 kB 00:00 2022-05-11T19:40:44.426 INFO:teuthology.orchestra.run.smithi166.stdout:(81/130): libuuid-devel-2.32.1-28.el8.x86_64.rp 1.3 MB/s | 97 kB 00:00 2022-05-11T19:40:44.426 INFO:teuthology.orchestra.run.smithi166.stdout:(82/130): python3-jwt-1.6.1-2.el8.noarch.rpm 566 kB/s | 43 kB 00:00 2022-05-11T19:40:44.427 INFO:teuthology.orchestra.run.smithi166.stdout:(83/130): libgfortran-8.5.0-4.el8_5.x86_64.rpm 7.5 MB/s | 643 kB 00:00 2022-05-11T19:40:44.427 INFO:teuthology.orchestra.run.smithi166.stdout:(84/130): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2022-05-11T19:40:44.427 INFO:teuthology.orchestra.run.smithi166.stdout:(85/130): python3-pycparser-2.14-14.el8.noarch. 1.5 MB/s | 109 kB 00:00 2022-05-11T19:40:44.427 INFO:teuthology.orchestra.run.smithi166.stdout:(86/130): krb5-devel-1.18.2-14.el8.x86_64.rpm 7.3 MB/s | 560 kB 00:00 2022-05-11T19:40:44.427 INFO:teuthology.orchestra.run.smithi166.stdout:(87/130): python3-cryptography-3.2.1-5.el8.x86_ 6.5 MB/s | 559 kB 00:00 2022-05-11T19:40:44.428 INFO:teuthology.orchestra.run.smithi166.stdout:(88/130): librabbitmq-0.9.0-3.el8.x86_64.rpm 622 kB/s | 47 kB 00:00 2022-05-11T19:40:44.428 INFO:teuthology.orchestra.run.smithi166.stdout:(89/130): libverto-devel-0.3.0-5.el8.x86_64.rpm 239 kB/s | 18 kB 00:00 2022-05-11T19:40:44.428 INFO:teuthology.orchestra.run.smithi166.stdout:(90/130): elfutils-libelf-devel-0.185-1.el8.x86 937 kB/s | 59 kB 00:00 2022-05-11T19:40:44.428 INFO:teuthology.orchestra.run.smithi166.stdout:(91/130): libselinux-devel-2.9-5.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2022-05-11T19:40:44.445 INFO:teuthology.orchestra.run.smithi166.stdout:(92/130): fuse-2.9.7-12.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2022-05-11T19:40:44.484 INFO:teuthology.orchestra.run.smithi166.stdout:(93/130): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2022-05-11T19:40:44.509 INFO:teuthology.orchestra.run.smithi166.stdout:(94/130): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2022-05-11T19:40:44.560 INFO:teuthology.orchestra.run.smithi166.stdout:(95/130): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2022-05-11T19:40:44.601 INFO:teuthology.orchestra.run.smithi166.stdout:(96/130): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2022-05-11T19:40:44.643 INFO:teuthology.orchestra.run.smithi166.stdout:(97/130): jq-1.5-12.el8.x86_64.rpm 1.9 MB/s | 161 kB 00:00 2022-05-11T19:40:44.660 INFO:teuthology.orchestra.run.smithi166.stdout:(98/130): python3-jsonpatch-1.21-2.el8.noarch.r 454 kB/s | 27 kB 00:00 2022-05-11T19:40:44.703 INFO:teuthology.orchestra.run.smithi166.stdout:(99/130): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2022-05-11T19:40:44.731 INFO:teuthology.orchestra.run.smithi166.stdout:(100/130): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2022-05-11T19:40:44.786 INFO:teuthology.orchestra.run.smithi166.stdout:(101/130): python3-jsonpointer-1.10-11.el8.noar 239 kB/s | 20 kB 00:00 2022-05-11T19:40:44.820 INFO:teuthology.orchestra.run.smithi166.stdout:(102/130): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.4 MB/s | 126 kB 00:00 2022-05-11T19:40:44.879 INFO:teuthology.orchestra.run.smithi166.stdout:(103/130): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2022-05-11T19:40:44.945 INFO:teuthology.orchestra.run.smithi166.stdout:(104/130): python3-pytz-2017.2-9.el8.noarch.rpm 816 kB/s | 54 kB 00:00 2022-05-11T19:40:45.099 INFO:teuthology.orchestra.run.smithi166.stdout:(105/130): python3-scipy-1.0.0-21.module+el8.5. 45 MB/s | 14 MB 00:00 2022-05-11T19:40:45.122 INFO:teuthology.orchestra.run.smithi166.stdout:(106/130): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2022-05-11T19:40:45.180 INFO:teuthology.orchestra.run.smithi166.stdout:(107/130): librdkafka-0.11.4-1.el8.x86_64.rpm 4.1 MB/s | 353 kB 00:00 2022-05-11T19:40:45.197 INFO:teuthology.orchestra.run.smithi166.stdout:(108/130): socat-1.7.4.1-1.el8.x86_64.rpm 4.4 MB/s | 323 kB 00:00 2022-05-11T19:40:45.247 INFO:teuthology.orchestra.run.smithi166.stdout:(109/130): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.2 MB/s | 103 kB 00:00 2022-05-11T19:40:45.331 INFO:teuthology.orchestra.run.smithi166.stdout:(110/130): python3-babel-2.5.1-7.el8.noarch.rpm 32 MB/s | 4.8 MB 00:00 2022-05-11T19:40:45.348 INFO:teuthology.orchestra.run.smithi166.stdout:(111/130): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2022-05-11T19:40:45.401 INFO:teuthology.orchestra.run.smithi166.stdout:(112/130): python3-numpy-f2py-1.14.3-10.el8.x86 3.3 MB/s | 225 kB 00:00 2022-05-11T19:40:45.435 INFO:teuthology.orchestra.run.smithi166.stdout:(113/130): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2022-05-11T19:40:45.482 INFO:teuthology.orchestra.run.smithi166.stdout:(114/130): python3-jinja2-2.10.1-3.el8.noarch.r 10 MB/s | 538 kB 00:00 2022-05-11T19:40:45.915 INFO:teuthology.orchestra.run.smithi166.stdout:(115/130): ceph-test-17.0.0-12109.g4a6f09b6.el8 7.9 MB/s | 53 MB 00:06 2022-05-11T19:40:45.957 INFO:teuthology.orchestra.run.smithi166.stdout:(116/130): python3-markupsafe-0.23-19.el8.x86_6 82 kB/s | 39 kB 00:00 2022-05-11T19:40:45.974 INFO:teuthology.orchestra.run.smithi166.stdout:(117/130): python3-prettytable-0.7.2-14.el8.noa 758 kB/s | 44 kB 00:00 2022-05-11T19:40:46.058 INFO:teuthology.orchestra.run.smithi166.stdout:(118/130): openblas-threads-0.3.12-1.el8.x86_64 7.2 MB/s | 4.7 MB 00:00 2022-05-11T19:40:46.091 INFO:teuthology.orchestra.run.smithi166.stdout:(119/130): python3-werkzeug-0.12.2-4.el8.noarch 3.3 MB/s | 457 kB 00:00 2022-05-11T19:40:46.125 INFO:teuthology.orchestra.run.smithi166.stdout:(120/130): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2022-05-11T19:40:46.217 INFO:teuthology.orchestra.run.smithi166.stdout:(121/130): python3-numpy-1.14.3-10.el8.x86_64.r 24 MB/s | 3.7 MB 00:00 2022-05-11T19:40:46.292 INFO:teuthology.orchestra.run.smithi166.stdout:(122/130): openblas-0.3.12-1.el8.x86_64.rpm 23 MB/s | 4.6 MB 00:00 2022-05-11T19:40:46.342 INFO:teuthology.orchestra.run.smithi166.stdout:(123/130): openssl-1.1.1k-6.el8_5.x86_64.rpm 14 MB/s | 709 kB 00:00 2022-05-11T19:40:46.410 INFO:teuthology.orchestra.run.smithi166.stdout:(124/130): openssl-libs-1.1.1k-6.el8_5.x86_64.r 22 MB/s | 1.5 MB 00:00 2022-05-11T19:40:46.487 INFO:teuthology.orchestra.run.smithi166.stdout:(125/130): NetworkManager-1.32.10-5.el8_5.x86_6 35 MB/s | 2.6 MB 00:00 2022-05-11T19:40:46.530 INFO:teuthology.orchestra.run.smithi166.stdout:(126/130): NetworkManager-team-1.32.10-5.el8_5. 3.5 MB/s | 149 kB 00:00 2022-05-11T19:40:46.595 INFO:teuthology.orchestra.run.smithi166.stdout:(127/130): NetworkManager-libnm-1.32.10-5.el8_5 27 MB/s | 1.8 MB 00:00 2022-05-11T19:40:46.653 INFO:teuthology.orchestra.run.smithi166.stdout:(128/130): NetworkManager-tui-1.32.10-5.el8_5.x 5.6 MB/s | 336 kB 00:00 2022-05-11T19:40:46.771 INFO:teuthology.orchestra.run.smithi166.stdout:(129/130): librbd1-17.0.0-12109.g4a6f09b6.el8.x 7.0 MB/s | 3.9 MB 00:00 2022-05-11T19:40:46.825 INFO:teuthology.orchestra.run.smithi166.stdout:(130/130): librados2-17.0.0-12109.g4a6f09b6.el8 5.0 MB/s | 3.4 MB 00:00 2022-05-11T19:40:46.825 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2022-05-11T19:40:46.825 INFO:teuthology.orchestra.run.smithi166.stdout:Total 14 MB/s | 209 MB 00:15 2022-05-11T19:40:47.610 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2022-05-11T19:40:47.773 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2022-05-11T19:40:47.773 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2022-05-11T19:40:48.361 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2022-05-11T19:40:48.492 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 1/1 2022-05-11T19:40:48.719 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:1.1.1k-6.el8_5.x86_64 1/138 2022-05-11T19:40:48.784 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 1/138 2022-05-11T19:40:48.870 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2022-05-11T19:40:48.875 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2022-05-11T19:40:49.123 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2022-05-11T19:40:49.333 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.13.0-2.el8.x86_64 3/138 2022-05-11T19:40:49.536 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/138 2022-05-11T19:40:49.679 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/138 2022-05-11T19:40:49.776 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/138 2022-05-11T19:40:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-05-11T19:40:50.340 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-05-11T19:40:50.571 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 7/138 2022-05-11T19:40:50.984 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 7/138 2022-05-11T19:40:51.171 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 8/138 2022-05-11T19:40:51.291 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 8/138 2022-05-11T19:40:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 9/138 2022-05-11T19:40:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 9/138 2022-05-11T19:40:52.172 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:17.0.0-12109.g4a6f09b6.el8.x86_6 10/138 2022-05-11T19:40:52.359 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 11/138 2022-05-11T19:40:52.457 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 11/138 2022-05-11T19:40:52.623 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2022-05-11T19:40:52.777 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/138 2022-05-11T19:40:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:17.0.0-12109.g4a6f09b6.el8.x86_6 14/138 2022-05-11T19:40:53.271 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:17.0.0-12109.g4a6f09b6.el8.x86_6 14/138 2022-05-11T19:40:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:17.0.0-12109.g4a6f09b6.el8.x8 15/138 2022-05-11T19:40:53.487 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2022-05-11T19:40:53.619 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 1/1 2022-05-11T19:40:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:17.0.0-12109.g4a6f09b6.el8.x8 15/138 2022-05-11T19:40:53.830 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : openssl-libs-1:1.1.1k-6.el8_5.x86_64 1/138 2022-05-11T19:40:53.903 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 1/138 2022-05-11T19:40:53.919 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.32.10-5.el8_5.x86_64 16/138 2022-05-11T19:40:53.965 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.32.10-5.el8_5.x86_64 16/138 2022-05-11T19:40:54.198 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2022-05-11T19:40:54.200 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.32.10-5.el8_5.x86_64 17/138 2022-05-11T19:40:54.412 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : thrift-0.13.0-2.el8.x86_64 3/138 2022-05-11T19:40:54.446 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.32.10-5.el8_5.x86_64 17/138 2022-05-11T19:40:54.612 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/138 2022-05-11T19:40:54.742 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/138 2022-05-11T19:40:54.817 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/138 2022-05-11T19:40:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.32.10-5.el8_5.x86_64 17/138 2022-05-11T19:40:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-05-11T19:40:55.057 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/138 2022-05-11T19:40:55.233 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 19/138 2022-05-11T19:40:55.392 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-05-11T19:40:55.429 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/138 2022-05-11T19:40:55.592 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-8.5.0-4.el8_5.x86_64 21/138 2022-05-11T19:40:55.639 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : librados2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 7/138 2022-05-11T19:40:55.721 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libquadmath-8.5.0-4.el8_5.x86_64 21/138 2022-05-11T19:40:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-8.5.0-4.el8_5.x86_64 22/138 2022-05-11T19:40:56.060 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librados2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 7/138 2022-05-11T19:40:56.238 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : librbd1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 8/138 2022-05-11T19:40:56.363 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librbd1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 8/138 2022-05-11T19:40:56.422 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libgfortran-8.5.0-4.el8_5.x86_64 22/138 2022-05-11T19:40:56.546 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libcephfs2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 9/138 2022-05-11T19:40:56.580 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 23/138 2022-05-11T19:40:56.640 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libcephfs2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 9/138 2022-05-11T19:40:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 23/138 2022-05-11T19:40:57.227 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.12-1.el8.x86_64 24/138 2022-05-11T19:40:57.290 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rados-2:17.0.0-12109.g4a6f09b6.el8.x86_6 10/138 2022-05-11T19:40:57.495 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librgw2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 11/138 2022-05-11T19:40:57.585 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librgw2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 11/138 2022-05-11T19:40:57.765 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2022-05-11T19:40:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 24/138 2022-05-11T19:40:57.932 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/138 2022-05-11T19:40:58.087 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libcephsqlite-2:17.0.0-12109.g4a6f09b6.el8.x86_6 14/138 2022-05-11T19:40:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/138 2022-05-11T19:40:58.182 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libcephsqlite-2:17.0.0-12109.g4a6f09b6.el8.x86_6 14/138 2022-05-11T19:40:58.345 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libradosstriper1-2:17.0.0-12109.g4a6f09b6.el8.x8 15/138 2022-05-11T19:40:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 26/138 2022-05-11T19:40:58.796 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libradosstriper1-2:17.0.0-12109.g4a6f09b6.el8.x8 15/138 2022-05-11T19:40:58.840 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/138 2022-05-11T19:40:59.023 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : NetworkManager-libnm-1:1.32.10-5.el8_5.x86_64 16/138 2022-05-11T19:40:59.034 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:17.0.0-12109.g4a6f09b6.el8 28/138 2022-05-11T19:40:59.084 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-libnm-1:1.32.10-5.el8_5.x86_64 16/138 2022-05-11T19:40:59.162 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:17.0.0-12109.g4a6f09b6.e 29/138 2022-05-11T19:40:59.330 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-1:1.32.10-5.el8_5.x86_64 17/138 2022-05-11T19:40:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:17.0.0-12109.g4a6f09b6.el8.x86_ 30/138 2022-05-11T19:40:59.571 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 31/138 2022-05-11T19:40:59.579 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : NetworkManager-1:1.32.10-5.el8_5.x86_64 17/138 2022-05-11T19:40:59.981 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-1:1.32.10-5.el8_5.x86_64 17/138 2022-05-11T19:41:00.182 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/138 2022-05-11T19:41:00.379 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 19/138 2022-05-11T19:41:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 31/138 2022-05-11T19:41:02.177 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/138 2022-05-11T19:41:02.177 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libquadmath-8.5.0-4.el8_5.x86_64 21/138 2022-05-11T19:41:02.178 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libquadmath-8.5.0-4.el8_5.x86_64 21/138 2022-05-11T19:41:02.178 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libgfortran-8.5.0-4.el8_5.x86_64 22/138 2022-05-11T19:41:02.178 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libgfortran-8.5.0-4.el8_5.x86_64 22/138 2022-05-11T19:41:02.178 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 23/138 2022-05-11T19:41:02.247 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 23/138 2022-05-11T19:41:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 32/138 2022-05-11T19:41:02.411 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : openblas-0.3.12-1.el8.x86_64 24/138 2022-05-11T19:41:02.656 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/138 2022-05-11T19:41:02.923 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/138 2022-05-11T19:41:03.096 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 24/138 2022-05-11T19:41:03.192 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/138 2022-05-11T19:41:03.367 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/138 2022-05-11T19:41:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2022-05-11T19:41:03.558 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 26/138 2022-05-11T19:41:03.596 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/138 2022-05-11T19:41:03.799 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 38/138 2022-05-11T19:41:04.439 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/138 2022-05-11T19:41:04.440 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 39/138 2022-05-11T19:41:04.441 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:17.0.0-12109.g4a6f09b6.el8.x86_ 40/138 2022-05-11T19:41:04.441 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 41/138 2022-05-11T19:41:04.442 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-ceph-common-2:17.0.0-12109.g4a6f09b6.el8 28/138 2022-05-11T19:41:04.442 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-ceph-argparse-2:17.0.0-12109.g4a6f09b6.e 29/138 2022-05-11T19:41:04.442 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cephfs-2:17.0.0-12109.g4a6f09b6.el8.x86_ 30/138 2022-05-11T19:41:04.523 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 31/138 2022-05-11T19:41:04.600 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 42/138 2022-05-11T19:41:04.802 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.1-7.el8.noarch 43/138 2022-05-11T19:41:04.960 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 44/138 2022-05-11T19:41:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 45/138 2022-05-11T19:41:05.263 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 46/138 2022-05-11T19:41:05.320 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 46/138 2022-05-11T19:41:05.481 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.5-12.el8.x86_64 47/138 2022-05-11T19:41:05.671 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 48/138 2022-05-11T19:41:05.867 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 49/138 2022-05-11T19:41:06.029 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.7-12.el8.x86_64 50/138 2022-05-11T19:41:06.189 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 51/138 2022-05-11T19:41:06.230 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 31/138 2022-05-11T19:41:06.448 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 52/138 2022-05-11T19:41:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 53/138 2022-05-11T19:41:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 54/138 2022-05-11T19:41:07.211 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 32/138 2022-05-11T19:41:07.283 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 55/138 2022-05-11T19:41:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/138 2022-05-11T19:41:07.554 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/138 2022-05-11T19:41:07.738 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 57/138 2022-05-11T19:41:07.821 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/138 2022-05-11T19:41:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 58/138 2022-05-11T19:41:08.085 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/138 2022-05-11T19:41:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 59/138 2022-05-11T19:41:08.313 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2022-05-11T19:41:08.463 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 60/138 2022-05-11T19:41:08.497 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/138 2022-05-11T19:41:08.641 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 61/138 2022-05-11T19:41:08.711 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 38/138 2022-05-11T19:41:08.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.32.1-28.el8.x86_64 62/138 2022-05-11T19:41:08.898 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 39/138 2022-05-11T19:41:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librados-devel-2:17.0.0-12109.g4a6f09b6.el8.x86_ 40/138 2022-05-11T19:41:09.120 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 63/138 2022-05-11T19:41:09.394 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 41/138 2022-05-11T19:41:09.483 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/138 2022-05-11T19:41:09.878 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/138 2022-05-11T19:41:09.911 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 42/138 2022-05-11T19:41:10.022 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/138 2022-05-11T19:41:10.116 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : automake-1.16.1-7.el8.noarch 43/138 2022-05-11T19:41:10.243 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcom_err-devel-1.45.6-2.el8.x86_64 67/138 2022-05-11T19:41:10.279 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 44/138 2022-05-11T19:41:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 45/138 2022-05-11T19:41:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 68/138 2022-05-11T19:41:10.595 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 46/138 2022-05-11T19:41:10.642 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 69/138 2022-05-11T19:41:10.671 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 46/138 2022-05-11T19:41:10.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 70/138 2022-05-11T19:41:10.838 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : jq-1.5-12.el8.x86_64 47/138 2022-05-11T19:41:11.029 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 48/138 2022-05-11T19:41:11.040 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 71/138 2022-05-11T19:41:11.233 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 49/138 2022-05-11T19:41:11.234 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 72/138 2022-05-11T19:41:11.388 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 73/138 2022-05-11T19:41:11.395 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : fuse-2.9.7-12.el8.x86_64 50/138 2022-05-11T19:41:11.552 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 74/138 2022-05-11T19:41:11.572 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 51/138 2022-05-11T19:41:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 75/138 2022-05-11T19:41:11.803 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 52/138 2022-05-11T19:41:11.948 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 76/138 2022-05-11T19:41:12.139 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 77/138 2022-05-11T19:41:12.182 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 53/138 2022-05-11T19:41:12.304 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 78/138 2022-05-11T19:41:12.453 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 54/138 2022-05-11T19:41:12.473 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 79/138 2022-05-11T19:41:12.663 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 55/138 2022-05-11T19:41:12.679 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 80/138 2022-05-11T19:41:12.904 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/138 2022-05-11T19:41:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/138 2022-05-11T19:41:13.124 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/138 2022-05-11T19:41:13.149 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 57/138 2022-05-11T19:41:13.361 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/138 2022-05-11T19:41:13.461 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 58/138 2022-05-11T19:41:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/138 2022-05-11T19:41:13.717 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 59/138 2022-05-11T19:41:13.807 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 85/138 2022-05-11T19:41:13.897 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 60/138 2022-05-11T19:41:14.021 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 86/138 2022-05-11T19:41:14.111 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 61/138 2022-05-11T19:41:14.306 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libuuid-devel-2.32.1-28.el8.x86_64 62/138 2022-05-11T19:41:14.628 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 63/138 2022-05-11T19:41:14.875 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/138 2022-05-11T19:41:15.075 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 87/138 2022-05-11T19:41:15.091 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/138 2022-05-11T19:41:15.222 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/138 2022-05-11T19:41:15.335 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 88/138 2022-05-11T19:41:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libcom_err-devel-1.45.6-2.el8.x86_64 67/138 2022-05-11T19:41:15.558 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/138 2022-05-11T19:41:15.661 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 68/138 2022-05-11T19:41:15.832 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 69/138 2022-05-11T19:41:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/138 2022-05-11T19:41:16.023 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 70/138 2022-05-11T19:41:16.185 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/138 2022-05-11T19:41:16.267 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 71/138 2022-05-11T19:41:16.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/138 2022-05-11T19:41:16.507 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 72/138 2022-05-11T19:41:16.556 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/138 2022-05-11T19:41:16.665 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 73/138 2022-05-11T19:41:16.844 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 74/138 2022-05-11T19:41:17.075 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 75/138 2022-05-11T19:41:17.254 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 76/138 2022-05-11T19:41:17.483 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 77/138 2022-05-11T19:41:17.646 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 78/138 2022-05-11T19:41:17.815 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 79/138 2022-05-11T19:41:18.038 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 80/138 2022-05-11T19:41:18.255 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/138 2022-05-11T19:41:18.459 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/138 2022-05-11T19:41:18.715 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/138 2022-05-11T19:41:18.992 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/138 2022-05-11T19:41:19.219 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 85/138 2022-05-11T19:41:19.433 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 86/138 2022-05-11T19:41:20.047 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 94/138 2022-05-11T19:41:20.443 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 94/138 2022-05-11T19:41:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 87/138 2022-05-11T19:41:20.779 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 88/138 2022-05-11T19:41:20.992 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/138 2022-05-11T19:41:21.001 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 94/138 2022-05-11T19:41:21.264 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:17.0.0-12109.g4a6f09b6.el8.x86_64 95/138 2022-05-11T19:41:21.324 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/138 2022-05-11T19:41:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:17.0.0-12109.g4a6f09b6.el8.x86_64 95/138 2022-05-11T19:41:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:17.0.0-12109.g4a6f09b6.el8.x86_64 96/138 2022-05-11T19:41:21.592 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/138 2022-05-11T19:41:21.800 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/138 2022-05-11T19:41:21.975 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/138 2022-05-11T19:41:25.570 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 94/138 2022-05-11T19:41:25.792 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 94/138 2022-05-11T19:41:26.358 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 94/138 2022-05-11T19:41:26.616 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-base-2:17.0.0-12109.g4a6f09b6.el8.x86_64 95/138 2022-05-11T19:41:26.682 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-base-2:17.0.0-12109.g4a6f09b6.el8.x86_64 95/138 2022-05-11T19:41:26.819 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-selinux-2:17.0.0-12109.g4a6f09b6.el8.x86_64 96/138 2022-05-11T19:41:39.364 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:17.0.0-12109.g4a6f09b6.el8.x86_64 96/138 2022-05-11T19:41:39.365 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2022-05-11T19:41:39.365 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2022-05-11T19:41:39.366 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2022-05-11T19:41:39.366 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /run 2022-05-11T19:41:39.367 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2022-05-11T19:41:39.367 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2022-05-11T19:41:39.367 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2022-05-11T19:41:39.367 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2022-05-11T19:41:39.368 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2022-05-11T19:41:39.368 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:41:39.679 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:17.0.0-12109.g4a6f09b6.el8.noarch 97/138 2022-05-11T19:41:41.174 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:17.0.0-12109.g4a6f09b6.el8.noarch 97/138 2022-05-11T19:41:41.344 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 98/138 2022-05-11T19:41:41.566 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 98/138 2022-05-11T19:41:41.721 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:17.0.0-12109.g4a6f09b6.el8.x86_64 99/138 2022-05-11T19:41:42.104 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:17.0.0-12109.g4a6f09b6.el8.x86_64 99/138 2022-05-11T19:41:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:17.0.0-12109.g4a6f09b6.el8.x86_64 100/138 2022-05-11T19:41:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:17.0.0-12109.g4a6f09b6.el8.x86_64 100/138 2022-05-11T19:41:43.877 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 101/138 2022-05-11T19:41:44.046 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 101/138 2022-05-11T19:41:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-12109.g4a6f09b6. 102/138 2022-05-11T19:41:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-12109.g4a6f09b6 103/138 2022-05-11T19:41:44.491 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-12109.g4a6f09b6.el8.no 104/138 2022-05-11T19:41:44.635 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-selinux-2:17.0.0-12109.g4a6f09b6.el8.x86_64 96/138 2022-05-11T19:41:44.635 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /sys 2022-05-11T19:41:44.636 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /proc 2022-05-11T19:41:44.636 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /dev 2022-05-11T19:41:44.636 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /run 2022-05-11T19:41:44.636 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /mnt 2022-05-11T19:41:44.637 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /var/tmp 2022-05-11T19:41:44.637 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /home 2022-05-11T19:41:44.637 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /tmp 2022-05-11T19:41:44.637 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /dev 2022-05-11T19:41:44.638 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:41:44.684 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-12109.g4a6f09b6.el8.no 104/138 2022-05-11T19:41:44.926 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-12109.g4a6f09b6.el8. 105/138 2022-05-11T19:41:44.973 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-volume-2:17.0.0-12109.g4a6f09b6.el8.noarch 97/138 2022-05-11T19:41:45.887 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-12109.g4a6f09b6.el8. 105/138 2022-05-11T19:41:46.080 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-12109.g4a 106/138 2022-05-11T19:41:46.168 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-12109.g4a 106/138 2022-05-11T19:41:46.474 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-volume-2:17.0.0-12109.g4a6f09b6.el8.noarch 97/138 2022-05-11T19:41:46.512 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-12109.g4a6f09b6.e 107/138 2022-05-11T19:41:46.638 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-osd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 98/138 2022-05-11T19:41:46.685 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:17.0.0-12109.g4a6f09b6.el8.x86_64 108/138 2022-05-11T19:41:46.720 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:17.0.0-12109.g4a6f09b6.el8.x86_64 108/138 2022-05-11T19:41:46.860 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-osd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 98/138 2022-05-11T19:41:46.861 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:17.0.0-12109.g4a6f09b6.el8.noarc 109/138 2022-05-11T19:41:46.875 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-12109.g4a6f09b6.el8.noarc 109/138 2022-05-11T19:41:47.023 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mds-2:17.0.0-12109.g4a6f09b6.el8.x86_64 99/138 2022-05-11T19:41:47.407 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mds-2:17.0.0-12109.g4a6f09b6.el8.x86_64 99/138 2022-05-11T19:41:47.561 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mon-2:17.0.0-12109.g4a6f09b6.el8.x86_64 100/138 2022-05-11T19:41:47.573 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mon-2:17.0.0-12109.g4a6f09b6.el8.x86_64 100/138 2022-05-11T19:41:48.404 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:17.0.0-12109.g4a6f09b6.el8.x86_64 110/138 2022-05-11T19:41:48.593 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 111/138 2022-05-11T19:41:48.667 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 111/138 2022-05-11T19:41:48.803 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-12109.g4a6f 112/138 2022-05-11T19:41:48.847 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-12109.g4a6f 112/138 2022-05-11T19:41:49.003 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_6 113/138 2022-05-11T19:41:49.111 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 101/138 2022-05-11T19:41:49.307 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 101/138 2022-05-11T19:41:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_6 113/138 2022-05-11T19:41:49.419 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-12109.g4a6f09b6. 102/138 2022-05-11T19:41:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 114/138 2022-05-11T19:41:49.580 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-12109.g4a6f09b6 103/138 2022-05-11T19:41:49.771 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-12109.g4a6f09b6.el8.no 104/138 2022-05-11T19:41:49.971 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-12109.g4a6f09b6.el8.no 104/138 2022-05-11T19:41:50.187 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-12109.g4a6f09b6.el8. 105/138 2022-05-11T19:41:51.145 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-12109.g4a6f09b6.el8. 105/138 2022-05-11T19:41:51.305 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-12109.g4a 106/138 2022-05-11T19:41:51.394 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-12109.g4a 106/138 2022-05-11T19:41:51.765 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-12109.g4a6f09b6.e 107/138 2022-05-11T19:41:51.946 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-2:17.0.0-12109.g4a6f09b6.el8.x86_64 108/138 2022-05-11T19:41:51.981 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-2:17.0.0-12109.g4a6f09b6.el8.x86_64 108/138 2022-05-11T19:41:52.138 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-rook-2:17.0.0-12109.g4a6f09b6.el8.noarc 109/138 2022-05-11T19:41:52.150 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-12109.g4a6f09b6.el8.noarc 109/138 2022-05-11T19:41:53.689 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-2:17.0.0-12109.g4a6f09b6.el8.x86_64 110/138 2022-05-11T19:41:53.887 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-radosgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 111/138 2022-05-11T19:41:53.975 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 111/138 2022-05-11T19:41:54.138 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-12109.g4a6f 112/138 2022-05-11T19:41:54.182 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-12109.g4a6f 112/138 2022-05-11T19:41:54.354 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : cephfs-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_6 113/138 2022-05-11T19:41:54.487 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 114/138 2022-05-11T19:41:54.736 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_6 113/138 2022-05-11T19:41:54.904 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : rbd-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 114/138 2022-05-11T19:41:55.409 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:17.0.0-12109.g4a6f09b6.el8.x86_64 115/138 2022-05-11T19:41:55.671 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:1.1.1k-6.el8_5.x86_64 116/138 2022-05-11T19:41:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-5.0.0-9.el8.x86_64 117/138 2022-05-11T19:41:56.137 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 118/138 2022-05-11T19:41:56.310 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/138 2022-05-11T19:41:56.321 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/138 2022-05-11T19:41:56.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:17.0.0-12109.g4a6f09b6.el8.x86 120/138 2022-05-11T19:41:56.655 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.185-1.el8.x86_64 121/138 2022-05-11T19:41:56.864 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.32.10-5.el8_5.x86_64 122/138 2022-05-11T19:41:57.080 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.32.10-5.el8_5.x86_64 123/138 2022-05-11T19:41:57.252 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:17.0.0-12109.g4a6f09b6.el8.noarch 124/138 2022-05-11T19:41:57.426 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 125/138 2022-05-11T19:41:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 126/138 2022-05-11T19:41:58.002 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:1.1.1k-6.el8_5.x86_64 127/138 2022-05-11T19:41:58.184 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.0.4-10.el8.x86_64 128/138 2022-05-11T19:41:58.235 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 128/138 2022-05-11T19:41:58.455 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.1-9.el8.x86_64 129/138 2022-05-11T19:41:58.459 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 129/138 2022-05-11T19:41:58.603 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 130/138 2022-05-11T19:41:58.746 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.32.10-4.el8.x86_64 131/138 2022-05-11T19:41:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:1.1.1k-4.el8.x86_64 132/138 2022-05-11T19:41:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 133/138 2022-05-11T19:41:59.170 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 133/138 2022-05-11T19:42:01.430 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: rbd-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 114/138 2022-05-11T19:42:01.432 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-test-2:17.0.0-12109.g4a6f09b6.el8.x86_64 115/138 2022-05-11T19:42:01.433 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : openssl-devel-1:1.1.1k-6.el8_5.x86_64 116/138 2022-05-11T19:42:01.434 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : xfsprogs-devel-5.0.0-9.el8.x86_64 117/138 2022-05-11T19:42:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.32.10-4.el8.x86_64 134/138 2022-05-11T19:42:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.32.10-4.el8.x86_64 135/138 2022-05-11T19:42:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.32.10-4.el8.x86_64 135/138 2022-05-11T19:42:01.455 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.32.10-4.el8.x86_64 135/138 2022-05-11T19:42:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.32.10-4.el8.x86_64 136/138 2022-05-11T19:42:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.32.10-4.el8.x86_64 136/138 2022-05-11T19:42:01.456 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2022-05-11T19:42:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2022-05-11T19:42:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:1.1.1k-4.el8.x86_64 138/138 2022-05-11T19:42:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:1.1.1k-4.el8.x86_64 138/138 2022-05-11T19:42:01.457 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:17.0.0-12109.g4a6f09b6.el8.x86_64 1/138 2022-05-11T19:42:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2/138 2022-05-11T19:42:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 3/138 2022-05-11T19:42:01.459 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 4/138 2022-05-11T19:42:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-12109.g4a6f 5/138 2022-05-11T19:42:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:17.0.0-12109.g4a6f09b6.el8.x86_64 6/138 2022-05-11T19:42:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:17.0.0-12109.g4a6f09b6.el8.x86_64 7/138 2022-05-11T19:42:01.460 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:17.0.0-12109.g4a6f09b6.el8.x86_64 8/138 2022-05-11T19:42:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 9/138 2022-05-11T19:42:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 10/138 2022-05-11T19:42:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:17.0.0-12109.g4a6f09b6.el8.x86_64 11/138 2022-05-11T19:42:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:17.0.0-12109.g4a6f09b6.el8.x86_64 12/138 2022-05-11T19:42:01.461 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_6 13/138 2022-05-11T19:42:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:17.0.0-12109.g4a6f09b6.el8.x86 14/138 2022-05-11T19:42:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 15/138 2022-05-11T19:42:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:17.0.0-12109.g4a6f09b6.el8.x86_6 16/138 2022-05-11T19:42:01.462 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:17.0.0-12109.g4a6f09b6.el8.x86_ 17/138 2022-05-11T19:42:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:17.0.0-12109.g4a6f09b6.el8.x8 18/138 2022-05-11T19:42:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 19/138 2022-05-11T19:42:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:17.0.0-12109.g4a6f09b6.e 20/138 2022-05-11T19:42:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:17.0.0-12109.g4a6f09b6.el8 21/138 2022-05-11T19:42:01.463 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:17.0.0-12109.g4a6f09b6.el8.x86_ 22/138 2022-05-11T19:42:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:17.0.0-12109.g4a6f09b6.el8.x86_6 23/138 2022-05-11T19:42:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 24/138 2022-05-11T19:42:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 25/138 2022-05-11T19:42:01.464 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 26/138 2022-05-11T19:42:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 27/138 2022-05-11T19:42:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 28/138 2022-05-11T19:42:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-12109.g4a6f09b6 29/138 2022-05-11T19:42:01.465 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-12109.g4a6f09b6.el8.no 30/138 2022-05-11T19:42:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-12109.g4a6f09b6.el8. 31/138 2022-05-11T19:42:01.466 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-12109.g4a 32/138 2022-05-11T19:42:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-12109.g4a6f09b6.e 33/138 2022-05-11T19:42:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:17.0.0-12109.g4a6f09b6.el8.noarc 34/138 2022-05-11T19:42:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-12109.g4a6f09b6. 35/138 2022-05-11T19:42:01.467 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:17.0.0-12109.g4a6f09b6.el8.noarch 36/138 2022-05-11T19:42:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 37/138 2022-05-11T19:42:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:17.0.0-12109.g4a6f09b6.el8.noarch 38/138 2022-05-11T19:42:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/138 2022-05-11T19:42:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/138 2022-05-11T19:42:01.468 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/138 2022-05-11T19:42:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/138 2022-05-11T19:42:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/138 2022-05-11T19:42:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/138 2022-05-11T19:42:01.469 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/138 2022-05-11T19:42:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/138 2022-05-11T19:42:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/138 2022-05-11T19:42:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/138 2022-05-11T19:42:01.470 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/138 2022-05-11T19:42:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/138 2022-05-11T19:42:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2022-05-11T19:42:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/138 2022-05-11T19:42:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/138 2022-05-11T19:42:01.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/138 2022-05-11T19:42:01.472 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/138 2022-05-11T19:42:01.472 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/138 2022-05-11T19:42:01.472 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/138 2022-05-11T19:42:01.472 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/138 2022-05-11T19:42:01.473 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/138 2022-05-11T19:42:01.473 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/138 2022-05-11T19:42:01.473 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/138 2022-05-11T19:42:01.473 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/138 2022-05-11T19:42:01.473 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/138 2022-05-11T19:42:01.474 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/138 2022-05-11T19:42:01.474 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/138 2022-05-11T19:42:01.474 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/138 2022-05-11T19:42:01.474 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/138 2022-05-11T19:42:01.475 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/138 2022-05-11T19:42:01.475 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-05-11T19:42:01.475 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/138 2022-05-11T19:42:01.475 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 71/138 2022-05-11T19:42:01.475 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcom_err-devel-1.45.6-2.el8.x86_64 72/138 2022-05-11T19:42:01.476 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2022-05-11T19:42:01.476 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 74/138 2022-05-11T19:42:01.477 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/138 2022-05-11T19:42:01.477 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 76/138 2022-05-11T19:42:01.477 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:1.1.1k-6.el8_5.x86_64 77/138 2022-05-11T19:42:01.477 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-5.0.0-9.el8.x86_64 78/138 2022-05-11T19:42:01.477 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-8.5.0-4.el8_5.x86_64 79/138 2022-05-11T19:42:01.478 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 80/138 2022-05-11T19:42:01.478 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 81/138 2022-05-11T19:42:01.478 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.32.1-28.el8.x86_64 82/138 2022-05-11T19:42:01.478 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 83/138 2022-05-11T19:42:01.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-8.5.0-4.el8_5.x86_64 84/138 2022-05-11T19:42:01.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/138 2022-05-11T19:42:01.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/138 2022-05-11T19:42:01.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 87/138 2022-05-11T19:42:01.479 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 88/138 2022-05-11T19:42:01.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 89/138 2022-05-11T19:42:01.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 90/138 2022-05-11T19:42:01.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.185-1.el8.x86_64 91/138 2022-05-11T19:42:01.480 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/138 2022-05-11T19:42:01.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 93/138 2022-05-11T19:42:01.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 94/138 2022-05-11T19:42:01.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 95/138 2022-05-11T19:42:01.481 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 96/138 2022-05-11T19:42:01.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 97/138 2022-05-11T19:42:01.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.5-12.el8.x86_64 98/138 2022-05-11T19:42:01.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 99/138 2022-05-11T19:42:01.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 100/138 2022-05-11T19:42:01.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/138 2022-05-11T19:42:01.483 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 102/138 2022-05-11T19:42:01.483 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/138 2022-05-11T19:42:01.483 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 104/138 2022-05-11T19:42:01.483 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/138 2022-05-11T19:42:01.484 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 106/138 2022-05-11T19:42:01.484 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/138 2022-05-11T19:42:01.484 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 108/138 2022-05-11T19:42:01.484 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 109/138 2022-05-11T19:42:01.484 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 110/138 2022-05-11T19:42:01.485 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/138 2022-05-11T19:42:01.485 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 112/138 2022-05-11T19:42:01.485 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 113/138 2022-05-11T19:42:01.485 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/138 2022-05-11T19:42:01.485 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 115/138 2022-05-11T19:42:01.486 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 116/138 2022-05-11T19:42:01.486 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 117/138 2022-05-11T19:42:01.486 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 118/138 2022-05-11T19:42:01.487 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 119/138 2022-05-11T19:42:01.487 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.0.4-10.el8.x86_64 120/138 2022-05-11T19:42:01.487 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 121/138 2022-05-11T19:42:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 122/138 2022-05-11T19:42:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 123/138 2022-05-11T19:42:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/138 2022-05-11T19:42:01.488 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 125/138 2022-05-11T19:42:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/138 2022-05-11T19:42:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 127/138 2022-05-11T19:42:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:1.1.1k-4.el8.x86_64 128/138 2022-05-11T19:42:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 129/138 2022-05-11T19:42:01.489 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:1.1.1k-4.el8.x86_64 130/138 2022-05-11T19:42:01.490 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.32.10-5.el8_5.x86_64 131/138 2022-05-11T19:42:01.490 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.32.10-4.el8.x86_64 132/138 2022-05-11T19:42:01.490 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.32.10-5.el8_5.x86_64 133/138 2022-05-11T19:42:01.490 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.32.10-4.el8.x86_64 134/138 2022-05-11T19:42:01.491 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.32.10-5.el8_5.x86_64 135/138 2022-05-11T19:42:01.491 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.32.10-4.el8.x86_64 136/138 2022-05-11T19:42:01.491 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.32.10-5.el8_5.x86_64 137/138 2022-05-11T19:42:01.597 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 118/138 2022-05-11T19:42:01.828 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/138 2022-05-11T19:42:01.839 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/138 2022-05-11T19:42:01.999 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libcephfs-devel-2:17.0.0-12109.g4a6f09b6.el8.x86 120/138 2022-05-11T19:42:02.148 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : elfutils-libelf-devel-0.185-1.el8.x86_64 121/138 2022-05-11T19:42:02.356 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : NetworkManager-team-1:1.32.10-5.el8_5.x86_64 122/138 2022-05-11T19:42:02.549 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : NetworkManager-tui-1:1.32.10-5.el8_5.x86_64 123/138 2022-05-11T19:42:02.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.32.10-4.el8.x86_64 138/138 2022-05-11T19:42:02.642 INFO:teuthology.orchestra.run.smithi134.stdout:Installed products updated. 2022-05-11T19:42:02.720 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : cephfs-top-2:17.0.0-12109.g4a6f09b6.el8.noarch 124/138 2022-05-11T19:42:02.903 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : rbd-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 125/138 2022-05-11T19:42:03.179 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : rbd-nbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 126/138 2022-05-11T19:42:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : openssl-1:1.1.1k-6.el8_5.x86_64 127/138 2022-05-11T19:42:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : bison-3.0.4-10.el8.x86_64 128/138 2022-05-11T19:42:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 128/138 2022-05-11T19:42:04.176 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : flex-2.6.1-9.el8.x86_64 129/138 2022-05-11T19:42:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 129/138 2022-05-11T19:42:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 130/138 2022-05-11T19:42:04.265 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : NetworkManager-tui-1:1.32.10-4.el8.x86_64 131/138 2022-05-11T19:42:04.465 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : openssl-1:1.1.1k-4.el8.x86_64 132/138 2022-05-11T19:42:04.466 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 133/138 2022-05-11T19:42:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 133/138 2022-05-11T19:42:04.884 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : NetworkManager-team-1:1.32.10-4.el8.x86_64 134/138 2022-05-11T19:42:04.888 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-1:1.32.10-4.el8.x86_64 135/138 2022-05-11T19:42:04.889 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : NetworkManager-1:1.32.10-4.el8.x86_64 135/138 2022-05-11T19:42:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-1:1.32.10-4.el8.x86_64 135/138 2022-05-11T19:42:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : NetworkManager-libnm-1:1.32.10-4.el8.x86_64 136/138 2022-05-11T19:42:05.409 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:05.410 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2022-05-11T19:42:05.410 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.32.10-5.el8_5.x86_64 2022-05-11T19:42:05.410 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.32.10-5.el8_5.x86_64 2022-05-11T19:42:05.410 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.32.10-5.el8_5.x86_64 2022-05-11T19:42:05.411 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.32.10-5.el8_5.x86_64 2022-05-11T19:42:05.411 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.411 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.411 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:1.1.1k-6.el8_5.x86_64 2022-05-11T19:42:05.411 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:1.1.1k-6.el8_5.x86_64 2022-05-11T19:42:05.412 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2022-05-11T19:42:05.412 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.1-7.el8.noarch 2022-05-11T19:42:05.412 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.0.4-10.el8.x86_64 2022-05-11T19:42:05.412 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.412 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.413 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.413 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.413 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.413 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.414 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.414 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.414 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.414 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.414 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.415 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.415 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.416 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.416 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.416 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.417 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.418 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.418 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:05.418 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.185-1.el8.x86_64 2022-05-11T19:42:05.418 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.1-9.el8.x86_64 2022-05-11T19:42:05.418 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.7-12.el8.x86_64 2022-05-11T19:42:05.419 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-05-11T19:42:05.419 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.5-12.el8.x86_64 2022-05-11T19:42:05.419 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-05-11T19:42:05.419 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-05-11T19:42:05.420 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-05-11T19:42:05.420 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.420 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.420 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.420 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel-1.45.6-2.el8.x86_64 2022-05-11T19:42:05.421 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-8.5.0-4.el8_5.x86_64 2022-05-11T19:42:05.421 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.2-3.el8.x86_64 2022-05-11T19:42:05.421 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-8.5.0-4.el8_5.x86_64 2022-05-11T19:42:05.421 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-05-11T19:42:05.421 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.422 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.422 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-05-11T19:42:05.422 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.422 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-05-11T19:42:05.423 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-05-11T19:42:05.423 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-25.el8.x86_64 2022-05-11T19:42:05.423 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.3.1-3.el8.x86_64 2022-05-11T19:42:05.423 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.32.1-28.el8.x86_64 2022-05-11T19:42:05.423 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-05-11T19:42:05.424 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-05-11T19:42:05.424 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-05-11T19:42:05.424 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.12-1.el8.x86_64 2022-05-11T19:42:05.424 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-05-11T19:42:05.425 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:1.1.1k-6.el8_5.x86_64 2022-05-11T19:42:05.425 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-05-11T19:42:05.425 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-05-11T19:42:05.425 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-05-11T19:42:05.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-05-11T19:42:05.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.5.1-7.el8.noarch 2022-05-11T19:42:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-05-11T19:42:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-05-11T19:42:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-05-11T19:42:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-05-11T19:42:05.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-05-11T19:42:05.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-05-11T19:42:05.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-05-11T19:42:05.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-05-11T19:42:05.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-05-11T19:42:05.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-6.2-6.el8.noarch 2022-05-11T19:42:05.429 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-05-11T19:42:05.430 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-05-11T19:42:05.430 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-05-11T19:42:05.430 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-05-11T19:42:05.430 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-05-11T19:42:05.430 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-05-11T19:42:05.431 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-05-11T19:42:05.431 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.0.6-13.el8.noarch 2022-05-11T19:42:05.431 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-05-11T19:42:05.431 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-05-11T19:42:05.432 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-05-11T19:42:05.432 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-05-11T19:42:05.432 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-05-11T19:42:05.432 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-05-11T19:42:05.432 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-05-11T19:42:05.433 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-2.6-1.el8.noarch 2022-05-11T19:42:05.433 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-05-11T19:42:05.433 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-05-11T19:42:05.433 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-05-11T19:42:05.433 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-05-11T19:42:05.434 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.14-14.el8.noarch 2022-05-11T19:42:05.434 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2017.2-9.el8.noarch 2022-05-11T19:42:05.434 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.434 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-05-11T19:42:05.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-05-11T19:42:05.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.4.1-12.el8.noarch 2022-05-11T19:42:05.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.8-1.el8.noarch 2022-05-11T19:42:05.436 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-05-11T19:42:05.436 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-05-11T19:42:05.436 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-05-11T19:42:05.436 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-05-11T19:42:05.437 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-05-11T19:42:05.437 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-05-11T19:42:05.437 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-05-11T19:42:05.438 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-05-11T19:42:05.438 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-05-11T19:42:05.438 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-05-11T19:42:05.438 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-05-11T19:42:05.438 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.439 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.439 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:05.439 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-1.el8.x86_64 2022-05-11T19:42:05.439 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.13.0-2.el8.x86_64 2022-05-11T19:42:05.440 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-5.0.0-9.el8.x86_64 2022-05-11T19:42:05.440 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-05-11T19:42:05.440 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-05-11T19:42:05.441 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:05.441 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2022-05-11T19:42:05.581 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: NetworkManager-libnm-1:1.32.10-4.el8.x86_64 136/138 2022-05-11T19:42:05.581 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2022-05-11T19:42:05.602 DEBUG:teuthology.parallel:result is None 2022-05-11T19:42:05.781 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2022-05-11T19:42:05.781 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : openssl-libs-1:1.1.1k-4.el8.x86_64 138/138 2022-05-11T19:42:06.659 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: openssl-libs-1:1.1.1k-4.el8.x86_64 138/138 2022-05-11T19:42:06.659 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-2:17.0.0-12109.g4a6f09b6.el8.x86_64 1/138 2022-05-11T19:42:06.659 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-base-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2/138 2022-05-11T19:42:06.660 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 3/138 2022-05-11T19:42:06.660 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 4/138 2022-05-11T19:42:06.660 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-12109.g4a6f 5/138 2022-05-11T19:42:06.660 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mds-2:17.0.0-12109.g4a6f09b6.el8.x86_64 6/138 2022-05-11T19:42:06.661 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-2:17.0.0-12109.g4a6f09b6.el8.x86_64 7/138 2022-05-11T19:42:06.661 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mon-2:17.0.0-12109.g4a6f09b6.el8.x86_64 8/138 2022-05-11T19:42:06.661 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-osd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 9/138 2022-05-11T19:42:06.661 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-radosgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 10/138 2022-05-11T19:42:06.661 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-selinux-2:17.0.0-12109.g4a6f09b6.el8.x86_64 11/138 2022-05-11T19:42:06.662 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-test-2:17.0.0-12109.g4a6f09b6.el8.x86_64 12/138 2022-05-11T19:42:06.662 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : cephfs-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_6 13/138 2022-05-11T19:42:06.662 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libcephfs-devel-2:17.0.0-12109.g4a6f09b6.el8.x86 14/138 2022-05-11T19:42:06.663 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libcephfs2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 15/138 2022-05-11T19:42:06.663 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libcephsqlite-2:17.0.0-12109.g4a6f09b6.el8.x86_6 16/138 2022-05-11T19:42:06.663 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librados-devel-2:17.0.0-12109.g4a6f09b6.el8.x86_ 17/138 2022-05-11T19:42:06.664 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libradosstriper1-2:17.0.0-12109.g4a6f09b6.el8.x8 18/138 2022-05-11T19:42:06.664 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librgw2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 19/138 2022-05-11T19:42:06.666 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-ceph-argparse-2:17.0.0-12109.g4a6f09b6.e 20/138 2022-05-11T19:42:06.667 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-ceph-common-2:17.0.0-12109.g4a6f09b6.el8 21/138 2022-05-11T19:42:06.667 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cephfs-2:17.0.0-12109.g4a6f09b6.el8.x86_ 22/138 2022-05-11T19:42:06.667 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rados-2:17.0.0-12109.g4a6f09b6.el8.x86_6 23/138 2022-05-11T19:42:06.667 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 24/138 2022-05-11T19:42:06.667 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 25/138 2022-05-11T19:42:06.668 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : rbd-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 26/138 2022-05-11T19:42:06.668 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : rbd-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 27/138 2022-05-11T19:42:06.668 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : rbd-nbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 28/138 2022-05-11T19:42:06.668 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-12109.g4a6f09b6 29/138 2022-05-11T19:42:06.669 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-12109.g4a6f09b6.el8.no 30/138 2022-05-11T19:42:06.669 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-12109.g4a6f09b6.el8. 31/138 2022-05-11T19:42:06.669 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-12109.g4a 32/138 2022-05-11T19:42:06.669 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-12109.g4a6f09b6.e 33/138 2022-05-11T19:42:06.669 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-rook-2:17.0.0-12109.g4a6f09b6.el8.noarc 34/138 2022-05-11T19:42:06.670 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-12109.g4a6f09b6. 35/138 2022-05-11T19:42:06.670 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-volume-2:17.0.0-12109.g4a6f09b6.el8.noarch 36/138 2022-05-11T19:42:06.670 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 37/138 2022-05-11T19:42:06.670 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : cephfs-top-2:17.0.0-12109.g4a6f09b6.el8.noarch 38/138 2022-05-11T19:42:06.671 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/138 2022-05-11T19:42:06.671 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/138 2022-05-11T19:42:06.671 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/138 2022-05-11T19:42:06.671 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/138 2022-05-11T19:42:06.671 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/138 2022-05-11T19:42:06.672 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/138 2022-05-11T19:42:06.672 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/138 2022-05-11T19:42:06.672 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/138 2022-05-11T19:42:06.674 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/138 2022-05-11T19:42:06.675 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/138 2022-05-11T19:42:06.675 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/138 2022-05-11T19:42:06.675 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/138 2022-05-11T19:42:06.676 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2022-05-11T19:42:06.676 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/138 2022-05-11T19:42:06.676 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/138 2022-05-11T19:42:06.677 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/138 2022-05-11T19:42:06.677 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/138 2022-05-11T19:42:06.677 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/138 2022-05-11T19:42:06.677 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/138 2022-05-11T19:42:06.678 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/138 2022-05-11T19:42:06.678 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/138 2022-05-11T19:42:06.678 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/138 2022-05-11T19:42:06.680 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/138 2022-05-11T19:42:06.680 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/138 2022-05-11T19:42:06.681 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/138 2022-05-11T19:42:06.681 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/138 2022-05-11T19:42:06.682 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/138 2022-05-11T19:42:06.684 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/138 2022-05-11T19:42:06.685 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/138 2022-05-11T19:42:06.685 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/138 2022-05-11T19:42:06.685 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-05-11T19:42:06.685 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/138 2022-05-11T19:42:06.686 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 71/138 2022-05-11T19:42:06.686 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libcom_err-devel-1.45.6-2.el8.x86_64 72/138 2022-05-11T19:42:06.686 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2022-05-11T19:42:06.686 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 74/138 2022-05-11T19:42:06.687 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/138 2022-05-11T19:42:06.688 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 76/138 2022-05-11T19:42:06.689 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openssl-devel-1:1.1.1k-6.el8_5.x86_64 77/138 2022-05-11T19:42:06.689 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : xfsprogs-devel-5.0.0-9.el8.x86_64 78/138 2022-05-11T19:42:06.689 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libquadmath-8.5.0-4.el8_5.x86_64 79/138 2022-05-11T19:42:06.690 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 80/138 2022-05-11T19:42:06.690 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 81/138 2022-05-11T19:42:06.691 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libuuid-devel-2.32.1-28.el8.x86_64 82/138 2022-05-11T19:42:06.691 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 83/138 2022-05-11T19:42:06.692 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libgfortran-8.5.0-4.el8_5.x86_64 84/138 2022-05-11T19:42:06.692 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/138 2022-05-11T19:42:06.692 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/138 2022-05-11T19:42:06.693 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 87/138 2022-05-11T19:42:06.693 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 88/138 2022-05-11T19:42:06.693 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 89/138 2022-05-11T19:42:06.694 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 90/138 2022-05-11T19:42:06.694 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : elfutils-libelf-devel-0.185-1.el8.x86_64 91/138 2022-05-11T19:42:06.695 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/138 2022-05-11T19:42:06.695 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 93/138 2022-05-11T19:42:06.695 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 94/138 2022-05-11T19:42:06.696 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 95/138 2022-05-11T19:42:06.696 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 96/138 2022-05-11T19:42:06.697 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 97/138 2022-05-11T19:42:06.697 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : jq-1.5-12.el8.x86_64 98/138 2022-05-11T19:42:06.698 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 99/138 2022-05-11T19:42:06.699 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 100/138 2022-05-11T19:42:06.700 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/138 2022-05-11T19:42:06.700 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 102/138 2022-05-11T19:42:06.700 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/138 2022-05-11T19:42:06.701 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 104/138 2022-05-11T19:42:06.701 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/138 2022-05-11T19:42:06.701 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 106/138 2022-05-11T19:42:06.702 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/138 2022-05-11T19:42:06.702 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 108/138 2022-05-11T19:42:06.702 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 109/138 2022-05-11T19:42:06.703 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 110/138 2022-05-11T19:42:06.703 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/138 2022-05-11T19:42:06.703 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 112/138 2022-05-11T19:42:06.704 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 113/138 2022-05-11T19:42:06.704 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/138 2022-05-11T19:42:06.705 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 115/138 2022-05-11T19:42:06.705 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 116/138 2022-05-11T19:42:06.705 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 117/138 2022-05-11T19:42:06.706 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 118/138 2022-05-11T19:42:06.706 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 119/138 2022-05-11T19:42:06.707 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : bison-3.0.4-10.el8.x86_64 120/138 2022-05-11T19:42:06.707 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 121/138 2022-05-11T19:42:06.708 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 122/138 2022-05-11T19:42:06.708 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librados2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 123/138 2022-05-11T19:42:06.708 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/138 2022-05-11T19:42:06.710 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librbd1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 125/138 2022-05-11T19:42:06.710 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/138 2022-05-11T19:42:06.711 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 127/138 2022-05-11T19:42:06.711 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openssl-1:1.1.1k-4.el8.x86_64 128/138 2022-05-11T19:42:06.712 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 129/138 2022-05-11T19:42:06.712 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openssl-libs-1:1.1.1k-4.el8.x86_64 130/138 2022-05-11T19:42:06.712 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-1:1.32.10-5.el8_5.x86_64 131/138 2022-05-11T19:42:06.713 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-1:1.32.10-4.el8.x86_64 132/138 2022-05-11T19:42:06.713 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-team-1:1.32.10-5.el8_5.x86_64 133/138 2022-05-11T19:42:06.714 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-team-1:1.32.10-4.el8.x86_64 134/138 2022-05-11T19:42:06.714 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-libnm-1:1.32.10-5.el8_5.x86_64 135/138 2022-05-11T19:42:06.714 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-libnm-1:1.32.10-4.el8.x86_64 136/138 2022-05-11T19:42:06.715 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-tui-1:1.32.10-5.el8_5.x86_64 137/138 2022-05-11T19:42:08.141 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : NetworkManager-tui-1:1.32.10-4.el8.x86_64 138/138 2022-05-11T19:42:08.142 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2022-05-11T19:42:10.913 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:10.914 INFO:teuthology.orchestra.run.smithi166.stdout:Upgraded: 2022-05-11T19:42:10.914 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-1:1.32.10-5.el8_5.x86_64 2022-05-11T19:42:10.914 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-libnm-1:1.32.10-5.el8_5.x86_64 2022-05-11T19:42:10.914 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-team-1:1.32.10-5.el8_5.x86_64 2022-05-11T19:42:10.915 INFO:teuthology.orchestra.run.smithi166.stdout: NetworkManager-tui-1:1.32.10-5.el8_5.x86_64 2022-05-11T19:42:10.925 INFO:teuthology.orchestra.run.smithi166.stdout: librados2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.925 INFO:teuthology.orchestra.run.smithi166.stdout: librbd1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: openssl-1:1.1.1k-6.el8_5.x86_64 2022-05-11T19:42:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: openssl-libs-1:1.1.1k-6.el8_5.x86_64 2022-05-11T19:42:10.926 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2022-05-11T19:42:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: automake-1.16.1-7.el8.noarch 2022-05-11T19:42:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: bison-3.0.4-10.el8.x86_64 2022-05-11T19:42:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-base-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-grafana-dashboards-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-immutable-object-cache-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mds-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-dashboard-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-diskprediction-local-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-modules-core-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.930 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-rook-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.930 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mon-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.930 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-osd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-prometheus-alerts-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-radosgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-selinux-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-test-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-volume-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: cephadm-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: cephfs-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: cephfs-top-2:17.0.0-12109.g4a6f09b6.el8.noarch 2022-05-11T19:42:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: elfutils-libelf-devel-0.185-1.el8.x86_64 2022-05-11T19:42:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: flex-2.6.1-9.el8.x86_64 2022-05-11T19:42:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: fuse-2.9.7-12.el8.x86_64 2022-05-11T19:42:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-05-11T19:42:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: jq-1.5-12.el8.x86_64 2022-05-11T19:42:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-05-11T19:42:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-05-11T19:42:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-05-11T19:42:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs-devel-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: libcephsqlite-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: libcom_err-devel-1.45.6-2.el8.x86_64 2022-05-11T19:42:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: libgfortran-8.5.0-4.el8_5.x86_64 2022-05-11T19:42:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: liboath-2.6.2-3.el8.x86_64 2022-05-11T19:42:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: libquadmath-8.5.0-4.el8_5.x86_64 2022-05-11T19:42:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-05-11T19:42:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: librados-devel-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: libradosstriper1-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-05-11T19:42:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: librgw2-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-05-11T19:42:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-05-11T19:42:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: libtool-2.4.6-25.el8.x86_64 2022-05-11T19:42:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: libunwind-1.3.1-3.el8.x86_64 2022-05-11T19:42:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: libuuid-devel-2.32.1-28.el8.x86_64 2022-05-11T19:42:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-05-11T19:42:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-05-11T19:42:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-05-11T19:42:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: openblas-0.3.12-1.el8.x86_64 2022-05-11T19:42:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-05-11T19:42:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: openssl-devel-1:1.1.1k-6.el8_5.x86_64 2022-05-11T19:42:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-05-11T19:42:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-05-11T19:42:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-05-11T19:42:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-05-11T19:42:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: python3-babel-2.5.1-7.el8.noarch 2022-05-11T19:42:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-05-11T19:42:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-05-11T19:42:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-05-11T19:42:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-argparse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-common-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cephfs-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-05-11T19:42:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-05-11T19:42:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-05-11T19:42:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-05-11T19:42:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-05-11T19:42:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-05-11T19:42:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco-6.2-6.el8.noarch 2022-05-11T19:42:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-05-11T19:42:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-05-11T19:42:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-05-11T19:42:10.945 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-05-11T19:42:10.945 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-05-11T19:42:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-05-11T19:42:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-05-11T19:42:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: python3-mako-1.0.6-13.el8.noarch 2022-05-11T19:42:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-05-11T19:42:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-05-11T19:42:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-05-11T19:42:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-05-11T19:42:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-05-11T19:42:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-05-11T19:42:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-05-11T19:42:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: python3-portend-2.6-1.el8.noarch 2022-05-11T19:42:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-05-11T19:42:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-05-11T19:42:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-05-11T19:42:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-05-11T19:42:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pycparser-2.14-14.el8.noarch 2022-05-11T19:42:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pytz-2017.2-9.el8.noarch 2022-05-11T19:42:10.952 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rados-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.952 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.952 INFO:teuthology.orchestra.run.smithi166.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-05-11T19:42:10.952 INFO:teuthology.orchestra.run.smithi166.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-05-11T19:42:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rgw-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: python3-routes-2.4.1-12.el8.noarch 2022-05-11T19:42:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rsa-4.8-1.el8.noarch 2022-05-11T19:42:10.954 INFO:teuthology.orchestra.run.smithi166.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-05-11T19:42:10.955 INFO:teuthology.orchestra.run.smithi166.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-05-11T19:42:10.955 INFO:teuthology.orchestra.run.smithi166.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-05-11T19:42:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-05-11T19:42:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-05-11T19:42:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-05-11T19:42:10.957 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-05-11T19:42:10.957 INFO:teuthology.orchestra.run.smithi166.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-05-11T19:42:10.958 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-05-11T19:42:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-05-11T19:42:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-05-11T19:42:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-fuse-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.960 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-mirror-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.960 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-nbd-2:17.0.0-12109.g4a6f09b6.el8.x86_64 2022-05-11T19:42:10.961 INFO:teuthology.orchestra.run.smithi166.stdout: socat-1.7.4.1-1.el8.x86_64 2022-05-11T19:42:10.961 INFO:teuthology.orchestra.run.smithi166.stdout: thrift-0.13.0-2.el8.x86_64 2022-05-11T19:42:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: xfsprogs-devel-5.0.0-9.el8.x86_64 2022-05-11T19:42:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-05-11T19:42:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-05-11T19:42:10.963 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:10.963 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2022-05-11T19:42:11.070 DEBUG:teuthology.parallel:result is None 2022-05-11T19:42:11.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2022-05-11T19:42:11.140 INFO:teuthology.orchestra.run.smithi134.stdout:RedHatEnterprise 2022-05-11T19:42:11.141 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-05-11T19:42:11.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a6f09b69a2cce44f2caeba09a373309e0e0ba2e 2022-05-11T19:42:11.307 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-05-11T19:42:11.332 INFO:teuthology.orchestra.run.smithi134.stdout:17.0.0-12109.g4a6f09b6.el8 2022-05-11T19:42:11.334 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-12109.g4a6f09b6.el8 2022-05-11T19:42:11.335 INFO:teuthology.task.install:The correct ceph version 17.0.0-12109.g4a6f09b6 is installed. 2022-05-11T19:42:11.336 DEBUG:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2022-05-11T19:42:11.391 INFO:teuthology.orchestra.run.smithi166.stdout:RedHatEnterprise 2022-05-11T19:42:11.392 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-05-11T19:42:11.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a6f09b69a2cce44f2caeba09a373309e0e0ba2e 2022-05-11T19:42:11.540 DEBUG:teuthology.orchestra.run.smithi166:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-05-11T19:42:11.567 INFO:teuthology.orchestra.run.smithi166.stdout:17.0.0-12109.g4a6f09b6.el8 2022-05-11T19:42:11.568 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-12109.g4a6f09b6.el8 2022-05-11T19:42:11.568 INFO:teuthology.task.install:The correct ceph version 17.0.0-12109.g4a6f09b6 is installed. 2022-05-11T19:42:11.568 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-05-11T19:42:11.569 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:11.569 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-05-11T19:42:11.600 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:11.600 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-05-11T19:42:11.635 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-05-11T19:42:11.636 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:11.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2022-05-11T19:42:11.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-05-11T19:42:11.736 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:11.737 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/usr/bin/daemon-helper 2022-05-11T19:42:11.764 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-05-11T19:42:11.834 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-05-11T19:42:11.835 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:11.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2022-05-11T19:42:11.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-05-11T19:42:11.936 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:11.937 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/usr/bin/adjust-ulimits 2022-05-11T19:42:11.964 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-05-11T19:42:12.029 INFO:teuthology.run_tasks:Running task ceph... 2022-05-11T19:42:15.535 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-05-11T19:42:15.536 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2022-05-11T19:42:15.541 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod 777 /var/log/ceph 2022-05-11T19:42:15.573 INFO:tasks.ceph:Disabling ceph logrotate... 2022-05-11T19:42:15.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2022-05-11T19:42:15.613 DEBUG:teuthology.orchestra.run.smithi166:> sudo rm -f -- /etc/logrotate.d/ceph 2022-05-11T19:42:15.643 INFO:tasks.ceph:Creating extra log directories... 2022-05-11T19:42:15.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-05-11T19:42:15.682 DEBUG:teuthology.orchestra.run.smithi166:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-05-11T19:42:16.004 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-05-11T19:42:16.005 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-05-11T19:42:16.007 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-05-11T19:42:16.010 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:16.010 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-05-11T19:42:16.032 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-05-11T19:42:16.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-05-11T19:42:16.187 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:16.187 DEBUG:teuthology.orchestra.run.smithi166:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-05-11T19:42:16.206 DEBUG:teuthology.orchestra.run.smithi166:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-05-11T19:42:16.328 DEBUG:teuthology.orchestra.run.smithi166:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-05-11T19:42:16.366 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-05-11T19:42:16.367 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-05-11T19:42:16.368 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2022-05-11_08:21:56-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi/6830413', 'branch': 'wip-vshankar-testing-20220509-125847', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '6830413', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '9d1d97e0574f2f6f861b59a6eefcf986dcf94fa7'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2022-05-11_08:21:56-fs-wip-vshankar-testing-20220509-125847-testing-default-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.5', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20220509-125847'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20220509-125847', 'sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20220509-125847', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4a6f09b69a2cce44f2caeba09a373309e0e0ba2e/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi134.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD652hhuIIOKpJe8b1jtVSSLVtrRe3TmbkR6YfhaOwFJcES8lVa8JH85CX/wgAVTTYQ4O9xQ9UUybkATCg9FrNURrHiQuvwLQof/G4mhZ80C4yRMdRwLDK22ss9O9lQOHqx5y0KznXnzZ+kp6dq55ypLfEEL4ww+NNzFm1ZOFQRamEgRddrB4a8QouOzRElTvIH3u1QGGmThzHxP+/UEdngVymYkC2bUdRosuRi0eDC5JoCkbNcK6QsA+ET3T6eKtC6gnjzlOzKEVazW5+QO4doEkRbeBOXyu7uN6vRyVe53tLSqNus//avDaJEiSPnbtTs3xsXQVkni2kp1bk3fZik4uLnAStM1/1+Bxc98Tn/TF+87E4S0gjPxFXBGiVz9lhIrG54lqLogZpA+qxwpxY/LFFpu0zPy4q3UZob9pJ9sl97dPa4k0Rs27oYQg/k6GvaoJ4j9F36tvzT6RmQg/t/BYA+/wwf7KcPdkdShoUWHUTkMJnO76u2krttL2QFqhs=', 'smithi166.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsvpNRqjsbybNpCO4HRA9bQaQ3xZ5eEZspd5nLjjBrq4RqB6idibb/uFV4wgaNKDCBpQgex8PDnSOJoW0R6UUmIjSFH/xi+rMm4VMbdUqiwOthH0A1Z9dXl56KxHcRFZObkzP3nCDvBI0P8ZEj8+5sTfcxy7gd2Y/TtX50apsPjrY6JR7aFBHTyJCma62ryk3lu7/S3c3AtNIngxQPzbcX5tuhBiRwWjlO0juj44+eJA0bh0ByJiaP6yoH8iaIyBhMTesR3pjfim+8lExJTLG3q6QB0GbXlWrA4fjufl2chedYuHq8tmYnq7WytZoQDuXcW7dVo6bIqbnJgMQqgMt9HlFlmqciRnUth/s1keT/wQVafqv2me09uByoTsT1G2VW+ey8uFbhx6Ujrrup5eZDagjIsmQkks/foqkoKPiyosarRQaa0feIDZ0LzFX3NfcwCDKSAp5TBMgX+yOu1DCI4BF+Y4npbK81BxMAcHpgOuxeDg4GytP/jot65K4oV0M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '9d1d97e0574f2f6f861b59a6eefcf986dcf94fa7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '4a6f09b69a2cce44f2caeba09a373309e0e0ba2e'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b018fa018d3f885cbc018f839b42536477653f84', 'timestamp': '2022-05-11_08:21:56', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.456'} 2022-05-11T19:42:16.369 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-05-11T19:42:16.372 DEBUG:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-05-11T19:42:16.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2022-05-11T19:42:16.433 DEBUG:teuthology.orchestra.run.smithi166:> sudo install -d -m0777 -- /var/run/ceph 2022-05-11T19:42:16.496 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:16.496 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2022-05-11T19:42:16.518 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-05-11T19:42:16.519 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-05-11T19:42:16.576 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-05-11T19:42:16.576 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-11T19:42:16.577 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 385723 Links: 1 2022-05-11T19:42:16.577 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-11T19:42:16.577 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2022-05-11T19:42:16.578 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2022-05-11 19:42:00.749628850 +0000 2022-05-11T19:42:16.578 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2022-05-11 19:39:27.254750286 +0000 2022-05-11T19:42:16.578 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2022-05-11 19:39:27.254750286 +0000 2022-05-11T19:42:16.578 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2022-05-11T19:42:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2022-05-11T19:42:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2022-05-11T19:42:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000219575 s, 2.3 MB/s 2022-05-11T19:42:16.590 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-05-11T19:42:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-05-11T19:42:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-11T19:42:16.650 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 389902 Links: 1 2022-05-11T19:42:16.650 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-11T19:42:16.650 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2022-05-11T19:42:16.650 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2022-05-11 19:42:00.749628850 +0000 2022-05-11T19:42:16.651 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2022-05-11 19:39:27.829737123 +0000 2022-05-11T19:42:16.651 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2022-05-11 19:39:27.829737123 +0000 2022-05-11T19:42:16.651 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2022-05-11T19:42:16.662 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2022-05-11T19:42:16.662 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2022-05-11T19:42:16.662 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000212105 s, 2.4 MB/s 2022-05-11T19:42:16.663 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-05-11T19:42:16.719 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-05-11T19:42:16.719 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-11T19:42:16.720 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 393270 Links: 1 2022-05-11T19:42:16.720 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-11T19:42:16.720 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2022-05-11T19:42:16.720 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2022-05-11 19:42:00.750628827 +0000 2022-05-11T19:42:16.720 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2022-05-11 19:39:28.430723366 +0000 2022-05-11T19:42:16.721 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2022-05-11 19:39:28.430723366 +0000 2022-05-11T19:42:16.721 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2022-05-11T19:42:16.731 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2022-05-11T19:42:16.731 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2022-05-11T19:42:16.732 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00021117 s, 2.4 MB/s 2022-05-11T19:42:16.732 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-05-11T19:42:16.789 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-05-11T19:42:16.790 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-11T19:42:16.790 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 385836 Links: 1 2022-05-11T19:42:16.790 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-11T19:42:16.791 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2022-05-11T19:42:16.791 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2022-05-11 19:42:00.750628827 +0000 2022-05-11T19:42:16.791 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2022-05-11 19:39:29.048709219 +0000 2022-05-11T19:42:16.792 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2022-05-11 19:39:29.048709219 +0000 2022-05-11T19:42:16.792 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2022-05-11T19:42:16.798 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2022-05-11T19:42:16.799 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2022-05-11T19:42:16.799 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00021659 s, 2.4 MB/s 2022-05-11T19:42:16.803 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:16.803 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:16.803 DEBUG:teuthology.orchestra.run.smithi166:> dd if=/scratch_devs of=/dev/stdout 2022-05-11T19:42:16.823 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-05-11T19:42:16.824 DEBUG:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-05-11T19:42:16.882 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-05-11T19:42:16.883 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-11T19:42:16.883 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 393536 Links: 1 2022-05-11T19:42:16.883 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-11T19:42:16.883 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2022-05-11T19:42:16.884 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2022-05-11 19:42:06.256277027 +0000 2022-05-11T19:42:16.884 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2022-05-11 19:39:27.249065110 +0000 2022-05-11T19:42:16.884 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2022-05-11 19:39:27.249065110 +0000 2022-05-11T19:42:16.884 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2022-05-11T19:42:16.894 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2022-05-11T19:42:16.894 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2022-05-11T19:42:16.895 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000254812 s, 2.0 MB/s 2022-05-11T19:42:16.897 DEBUG:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-05-11T19:42:16.960 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-05-11T19:42:16.960 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-11T19:42:16.960 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 391825 Links: 1 2022-05-11T19:42:16.961 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-11T19:42:16.961 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2022-05-11T19:42:16.961 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2022-05-11 19:42:06.256277027 +0000 2022-05-11T19:42:16.961 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2022-05-11 19:39:27.824053315 +0000 2022-05-11T19:42:16.962 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2022-05-11 19:39:27.824053315 +0000 2022-05-11T19:42:16.962 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2022-05-11T19:42:16.970 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2022-05-11T19:42:16.971 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2022-05-11T19:42:16.971 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000251884 s, 2.0 MB/s 2022-05-11T19:42:16.974 DEBUG:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-05-11T19:42:17.031 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-05-11T19:42:17.031 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-11T19:42:17.031 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 393729 Links: 1 2022-05-11T19:42:17.032 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-11T19:42:17.032 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2022-05-11T19:42:17.032 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2022-05-11 19:42:06.256277027 +0000 2022-05-11T19:42:17.032 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2022-05-11 19:39:28.383041849 +0000 2022-05-11T19:42:17.033 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2022-05-11 19:39:28.383041849 +0000 2022-05-11T19:42:17.035 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2022-05-11T19:42:17.042 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2022-05-11T19:42:17.042 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2022-05-11T19:42:17.043 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000251365 s, 2.0 MB/s 2022-05-11T19:42:17.045 DEBUG:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-05-11T19:42:17.108 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-05-11T19:42:17.109 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-05-11T19:42:17.109 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 390959 Links: 1 2022-05-11T19:42:17.109 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-05-11T19:42:17.109 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2022-05-11T19:42:17.110 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2022-05-11 19:42:06.256277027 +0000 2022-05-11T19:42:17.110 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2022-05-11 19:39:28.984029520 +0000 2022-05-11T19:42:17.110 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2022-05-11 19:39:28.984029520 +0000 2022-05-11T19:42:17.111 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2022-05-11T19:42:17.112 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2022-05-11T19:42:17.112 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2022-05-11T19:42:17.113 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000169663 s, 3.0 MB/s 2022-05-11T19:42:17.116 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:17.116 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi166.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-05-11T19:42:17.116 INFO:tasks.ceph:Generating config... 2022-05-11T19:42:17.119 INFO:tasks.ceph:[client] client mount timeout = 600 2022-05-11T19:42:17.119 INFO:tasks.ceph:[client] debug client = 20 2022-05-11T19:42:17.120 INFO:tasks.ceph:[client] debug ms = 1 2022-05-11T19:42:17.120 INFO:tasks.ceph:[client] pid file = 2022-05-11T19:42:17.120 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-05-11T19:42:17.121 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-05-11T19:42:17.121 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-05-11T19:42:17.121 INFO:tasks.ceph:[mds] debug mds = 20 2022-05-11T19:42:17.122 INFO:tasks.ceph:[mds] debug ms = 1 2022-05-11T19:42:17.122 INFO:tasks.ceph:[mds] mds debug frag = True 2022-05-11T19:42:17.122 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-05-11T19:42:17.123 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-05-11T19:42:17.123 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-05-11T19:42:17.123 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-05-11T19:42:17.124 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-05-11T19:42:17.124 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-05-11T19:42:17.124 INFO:tasks.ceph:[mgr] debug client = 20 2022-05-11T19:42:17.124 INFO:tasks.ceph:[mgr] debug finisher = 20 2022-05-11T19:42:17.125 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-05-11T19:42:17.125 INFO:tasks.ceph:[mgr] debug ms = 1 2022-05-11T19:42:17.125 INFO:tasks.ceph:[mon] debug mon = 20 2022-05-11T19:42:17.126 INFO:tasks.ceph:[mon] debug ms = 1 2022-05-11T19:42:17.126 INFO:tasks.ceph:[mon] debug paxos = 20 2022-05-11T19:42:17.126 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-05-11T19:42:17.127 INFO:tasks.ceph:[osd] bdev async discard = True 2022-05-11T19:42:17.127 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-05-11T19:42:17.127 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-05-11T19:42:17.127 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-05-11T19:42:17.128 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-05-11T19:42:17.128 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2022-05-11T19:42:17.128 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2022-05-11T19:42:17.129 INFO:tasks.ceph:[osd] debug ms = 1 2022-05-11T19:42:17.129 INFO:tasks.ceph:[osd] debug osd = 20 2022-05-11T19:42:17.129 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2022-05-11T19:42:17.130 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-05-11T19:42:17.130 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-05-11T19:42:17.130 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-05-11T19:42:17.131 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-05-11T19:42:17.131 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-05-11T19:42:17.131 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-05-11T19:42:17.132 INFO:tasks.ceph:Setting up mon.a... 2022-05-11T19:42:17.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-05-11T19:42:17.176 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.keyring 2022-05-11T19:42:17.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-05-11T19:42:17.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-05-11T19:42:17.328 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.134'), ('mon.b', '172.21.15.166'), ('mon.c', '[v2:172.21.15.166:3301,v1:172.21.15.166:6790]')] 2022-05-11T19:42:17.329 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.134,172.21.15.166,[v2:172.21.15.166:3301,v1:172.21.15.166:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-05-11T19:42:17.330 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:17.330 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-05-11T19:42:17.384 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.134 --add b 172.21.15.166 --addv c '[v2:172.21.15.166:3301,v1:172.21.15.166:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:17.467 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:17.467 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: generated fsid ccb62be3-03e9-4327-8bbc-0e532a97b11c 2022-05-11T19:42:17.468 INFO:teuthology.orchestra.run.smithi134.stdout:setting min_mon_release = octopus 2022-05-11T19:42:17.468 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 0 2022-05-11T19:42:17.468 INFO:teuthology.orchestra.run.smithi134.stdout:fsid ccb62be3-03e9-4327-8bbc-0e532a97b11c 2022-05-11T19:42:17.468 INFO:teuthology.orchestra.run.smithi134.stdout:last_changed 2022-05-11T19:42:17.466173+0000 2022-05-11T19:42:17.468 INFO:teuthology.orchestra.run.smithi134.stdout:created 2022-05-11T19:42:17.466173+0000 2022-05-11T19:42:17.469 INFO:teuthology.orchestra.run.smithi134.stdout:min_mon_release 15 (octopus) 2022-05-11T19:42:17.469 INFO:teuthology.orchestra.run.smithi134.stdout:election_strategy: 1 2022-05-11T19:42:17.470 INFO:teuthology.orchestra.run.smithi134.stdout:0: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.a 2022-05-11T19:42:17.471 INFO:teuthology.orchestra.run.smithi134.stdout:1: [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] mon.b 2022-05-11T19:42:17.471 INFO:teuthology.orchestra.run.smithi134.stdout:2: [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] mon.c 2022-05-11T19:42:17.471 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-05-11T19:42:17.473 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-05-11T19:42:17.533 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ccb62be3-03e9-4327-8bbc-0e532a97b11c... 2022-05-11T19:42:17.534 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-05-11T19:42:17.575 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-05-11T19:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2022-05-11T19:42:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2022-05-11T19:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-05-11T19:42:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2022-05-11T19:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2022-05-11T19:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2022-05-11T19:42:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2022-05-11T19:42:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2022-05-11T19:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2022-05-11T19:42:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2022-05-11T19:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2022-05-11T19:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2022-05-11T19:42:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2022-05-11T19:42:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2022-05-11T19:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2022-05-11T19:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2022-05-11T19:42:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2022-05-11T19:42:17.629 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2022-05-11T19:42:17.629 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2022-05-11T19:42:17.629 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2022-05-11T19:42:17.630 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2022-05-11T19:42:17.630 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2022-05-11T19:42:17.630 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-05-11T19:42:17.630 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2022-05-11T19:42:17.630 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2022-05-11T19:42:17.631 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.631 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-05-11T19:42:17.633 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.633 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2022-05-11T19:42:17.634 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.634 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2022-05-11T19:42:17.634 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.634 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2022-05-11T19:42:17.635 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2022-05-11T19:42:17.635 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2022-05-11T19:42:17.635 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.134,172.21.15.166,[v2:172.21.15.166:3301,v1:172.21.15.166:6790]" 2022-05-11T19:42:17.635 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2022-05-11T19:42:17.635 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = ccb62be3-03e9-4327-8bbc-0e532a97b11c 2022-05-11T19:42:17.636 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.636 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2022-05-11T19:42:17.636 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2022-05-11T19:42:17.636 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.636 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2022-05-11T19:42:17.637 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2022-05-11T19:42:17.637 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.637 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2022-05-11T19:42:17.637 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2022-05-11T19:42:17.637 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.638 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2022-05-11T19:42:17.638 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2022-05-11T19:42:17.638 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2022-05-11T19:42:17.638 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.639 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2022-05-11T19:42:17.639 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2022-05-11T19:42:17.639 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.639 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2022-05-11T19:42:17.640 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.640 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2022-05-11T19:42:17.640 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.640 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2022-05-11T19:42:17.640 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.641 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2022-05-11T19:42:17.641 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2022-05-11T19:42:17.641 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.641 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2022-05-11T19:42:17.642 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2022-05-11T19:42:17.642 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2022-05-11T19:42:17.642 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2022-05-11T19:42:17.642 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = bitmap 2022-05-11T19:42:17.642 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2022-05-11T19:42:17.643 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2022-05-11T19:42:17.643 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2022-05-11T19:42:17.643 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2022-05-11T19:42:17.643 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2022-05-11T19:42:17.643 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2022-05-11T19:42:17.644 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2022-05-11T19:42:17.644 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2022-05-11T19:42:17.644 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2022-05-11T19:42:17.644 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2022-05-11T19:42:17.645 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2022-05-11T19:42:17.645 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2022-05-11T19:42:17.645 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2022-05-11T19:42:17.645 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.645 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2022-05-11T19:42:17.646 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2022-05-11T19:42:17.646 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2022-05-11T19:42:17.646 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2022-05-11T19:42:17.646 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2022-05-11T19:42:17.646 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2022-05-11T19:42:17.647 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2022-05-11T19:42:17.647 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2022-05-11T19:42:17.647 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2022-05-11T19:42:17.647 INFO:teuthology.orchestra.run.smithi134.stdout: debug finisher = 20 2022-05-11T19:42:17.647 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.648 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2022-05-11T19:42:17.648 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2022-05-11T19:42:17.648 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2022-05-11T19:42:17.649 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2022-05-11T19:42:17.649 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2022-05-11T19:42:17.649 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2022-05-11T19:42:17.649 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2022-05-11T19:42:17.649 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2022-05-11T19:42:17.650 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2022-05-11T19:42:17.650 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2022-05-11T19:42:17.650 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2022-05-11T19:42:17.650 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.651 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-05-11T19:42:17.651 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2022-05-11T19:42:17.651 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2022-05-11T19:42:17.651 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.651 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2022-05-11T19:42:17.652 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-05-11T19:42:17.652 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-05-11T19:42:17.652 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.652 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2022-05-11T19:42:17.653 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2022-05-11T19:42:17.653 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.653 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2022-05-11T19:42:17.653 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2022-05-11T19:42:17.653 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:17.654 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2022-05-11T19:42:17.654 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2022-05-11T19:42:17.654 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2022-05-11T19:42:17.655 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2022-05-11T19:42:17.655 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-05-11T19:42:17.655 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-05-11T19:42:17.655 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2022-05-11T19:42:17.655 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2022-05-11T19:42:17.656 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2022-05-11T19:42:17.656 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = "" 2022-05-11T19:42:17.656 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2022-05-11T19:42:17.656 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2022-05-11T19:42:17.657 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2022-05-11T19:42:17.657 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2022-05-11T19:42:17.657 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2022-05-11T19:42:17.657 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2022-05-11T19:42:17.657 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2022-05-11T19:42:17.658 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2022-05-11T19:42:17.658 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2022-05-11T19:42:17.658 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2022-05-11T19:42:17.658 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2022-05-11T19:42:17.659 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2022-05-11T19:42:17.659 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2022-05-11T19:42:17.659 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2022-05-11T19:42:17.659 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2022-05-11T19:42:17.660 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2022-05-11T19:42:17.660 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2022-05-11T19:42:17.660 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2022-05-11T19:42:17.660 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2022-05-11T19:42:17.662 INFO:teuthology.orchestra.run.smithi166.stdout:[global] 2022-05-11T19:42:17.662 INFO:teuthology.orchestra.run.smithi166.stdout: chdir = "" 2022-05-11T19:42:17.663 INFO:teuthology.orchestra.run.smithi166.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-05-11T19:42:17.663 INFO:teuthology.orchestra.run.smithi166.stdout: auth supported = cephx 2022-05-11T19:42:17.663 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.663 INFO:teuthology.orchestra.run.smithi166.stdout: filestore xattr use omap = true 2022-05-11T19:42:17.663 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.664 INFO:teuthology.orchestra.run.smithi166.stdout: mon clock drift allowed = 1.000 2022-05-11T19:42:17.664 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.664 INFO:teuthology.orchestra.run.smithi166.stdout: osd crush chooseleaf type = 0 2022-05-11T19:42:17.664 INFO:teuthology.orchestra.run.smithi166.stdout: auth debug = true 2022-05-11T19:42:17.664 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.665 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on old message = true 2022-05-11T19:42:17.665 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on bug = true 2022-05-11T19:42:17.665 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.665 INFO:teuthology.orchestra.run.smithi166.stdout: mon max pg per osd = 10000 # >= luminous 2022-05-11T19:42:17.666 INFO:teuthology.orchestra.run.smithi166.stdout: mon pg warn max object skew = 0 2022-05-11T19:42:17.666 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.666 INFO:teuthology.orchestra.run.smithi166.stdout: # disable pg_autoscaler by default for new pools 2022-05-11T19:42:17.666 INFO:teuthology.orchestra.run.smithi166.stdout: osd_pool_default_pg_autoscale_mode = off 2022-05-11T19:42:17.666 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.667 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default size = 2 2022-05-11T19:42:17.667 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.667 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow primary affinity = true 2022-05-11T19:42:17.667 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow pg remap = true 2022-05-11T19:42:17.667 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on legacy crush tunables = false 2022-05-11T19:42:17.668 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on crush straw calc version zero = false 2022-05-11T19:42:17.668 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on no sortbitwise = false 2022-05-11T19:42:17.668 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on osd down out interval zero = false 2022-05-11T19:42:17.668 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on too few osds = false 2022-05-11T19:42:17.669 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-05-11T19:42:17.669 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_no_redundancy = false 2022-05-11T19:42:17.669 INFO:teuthology.orchestra.run.smithi166.stdout: mon_allow_pool_size_one = true 2022-05-11T19:42:17.669 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.669 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-05-11T19:42:17.670 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.670 INFO:teuthology.orchestra.run.smithi166.stdout: osd default data pool replay window = 5 2022-05-11T19:42:17.670 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.670 INFO:teuthology.orchestra.run.smithi166.stdout: mon allow pool delete = true 2022-05-11T19:42:17.671 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.671 INFO:teuthology.orchestra.run.smithi166.stdout: mon cluster log file level = debug 2022-05-11T19:42:17.671 INFO:teuthology.orchestra.run.smithi166.stdout: debug asserts on shutdown = true 2022-05-11T19:42:17.671 INFO:teuthology.orchestra.run.smithi166.stdout: mon health detail to clog = false 2022-05-11T19:42:17.672 INFO:teuthology.orchestra.run.smithi166.stdout: mon host = "172.21.15.134,172.21.15.166,[v2:172.21.15.166:3301,v1:172.21.15.166:6790]" 2022-05-11T19:42:17.672 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on skipped message = False 2022-05-11T19:42:17.672 INFO:teuthology.orchestra.run.smithi166.stdout: fsid = ccb62be3-03e9-4327-8bbc-0e532a97b11c 2022-05-11T19:42:17.672 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.673 INFO:teuthology.orchestra.run.smithi166.stdout:[osd] 2022-05-11T19:42:17.673 INFO:teuthology.orchestra.run.smithi166.stdout: osd journal size = 100 2022-05-11T19:42:17.673 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.673 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub load threshold = 5.0 2022-05-11T19:42:17.673 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub max interval = 600 2022-05-11T19:42:17.674 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.674 INFO:teuthology.orchestra.run.smithi166.stdout: osd recover clone overlap = true 2022-05-11T19:42:17.674 INFO:teuthology.orchestra.run.smithi166.stdout: osd recovery max chunk = 1048576 2022-05-11T19:42:17.674 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.675 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug shutdown = true 2022-05-11T19:42:17.675 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug op order = true 2022-05-11T19:42:17.675 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug verify stray on activate = true 2022-05-11T19:42:17.675 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.675 INFO:teuthology.orchestra.run.smithi166.stdout: osd open classes on start = true 2022-05-11T19:42:17.676 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug pg log writeout = true 2022-05-11T19:42:17.676 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.676 INFO:teuthology.orchestra.run.smithi166.stdout: osd deep scrub update digest min age = 30 2022-05-11T19:42:17.676 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.677 INFO:teuthology.orchestra.run.smithi166.stdout: osd map max advance = 10 2022-05-11T19:42:17.677 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.677 INFO:teuthology.orchestra.run.smithi166.stdout: journal zero on create = true 2022-05-11T19:42:17.677 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.678 INFO:teuthology.orchestra.run.smithi166.stdout: filestore ondisk finisher threads = 3 2022-05-11T19:42:17.678 INFO:teuthology.orchestra.run.smithi166.stdout: filestore apply finisher threads = 3 2022-05-11T19:42:17.678 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.678 INFO:teuthology.orchestra.run.smithi166.stdout: bdev debug aio = true 2022-05-11T19:42:17.678 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug misdirected ops = true 2022-05-11T19:42:17.679 INFO:teuthology.orchestra.run.smithi166.stdout: bdev async discard = True 2022-05-11T19:42:17.679 INFO:teuthology.orchestra.run.smithi166.stdout: bdev enable discard = True 2022-05-11T19:42:17.679 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore allocator = bitmap 2022-05-11T19:42:17.679 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore block size = 96636764160 2022-05-11T19:42:17.679 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore fsck on mount = True 2022-05-11T19:42:17.680 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluefs = 1/20 2022-05-11T19:42:17.680 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluestore = 1/20 2022-05-11T19:42:17.680 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-05-11T19:42:17.680 INFO:teuthology.orchestra.run.smithi166.stdout: debug osd = 20 2022-05-11T19:42:17.680 INFO:teuthology.orchestra.run.smithi166.stdout: debug rocksdb = 4/10 2022-05-11T19:42:17.681 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd backfillfull_ratio = 0.85 2022-05-11T19:42:17.681 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd full ratio = 0.9 2022-05-11T19:42:17.681 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd nearfull ratio = 0.8 2022-05-11T19:42:17.681 INFO:teuthology.orchestra.run.smithi166.stdout: osd failsafe full ratio = 0.95 2022-05-11T19:42:17.681 INFO:teuthology.orchestra.run.smithi166.stdout: osd objectstore = bluestore 2022-05-11T19:42:17.682 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2022-05-11T19:42:17.682 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.682 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr] 2022-05-11T19:42:17.682 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-05-11T19:42:17.683 INFO:teuthology.orchestra.run.smithi166.stdout: debug mgr = 20 2022-05-11T19:42:17.683 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2022-05-11T19:42:17.683 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2022-05-11T19:42:17.683 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2022-05-11T19:42:17.683 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2022-05-11T19:42:17.684 INFO:teuthology.orchestra.run.smithi166.stdout: mgr/telemetry/nag = false 2022-05-11T19:42:17.684 INFO:teuthology.orchestra.run.smithi166.stdout: debug client = 20 2022-05-11T19:42:17.684 INFO:teuthology.orchestra.run.smithi166.stdout: debug finisher = 20 2022-05-11T19:42:17.684 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.684 INFO:teuthology.orchestra.run.smithi166.stdout:[mon] 2022-05-11T19:42:17.685 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-05-11T19:42:17.685 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2022-05-11T19:42:17.685 INFO:teuthology.orchestra.run.smithi166.stdout: debug paxos = 20 2022-05-11T19:42:17.685 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2022-05-11T19:42:17.686 INFO:teuthology.orchestra.run.smithi166.stdout: mon data avail warn = 5 2022-05-11T19:42:17.686 INFO:teuthology.orchestra.run.smithi166.stdout: mon mgr mkfs grace = 240 2022-05-11T19:42:17.686 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2022-05-11T19:42:17.686 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd reporter subtree level = osd 2022-05-11T19:42:17.686 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd prime pg temp = true 2022-05-11T19:42:17.687 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2022-05-11T19:42:17.687 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.687 INFO:teuthology.orchestra.run.smithi166.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-05-11T19:42:17.687 INFO:teuthology.orchestra.run.smithi166.stdout: auth mon ticket ttl = 660 # 11m 2022-05-11T19:42:17.688 INFO:teuthology.orchestra.run.smithi166.stdout: auth service ticket ttl = 240 # 4m 2022-05-11T19:42:17.688 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.688 INFO:teuthology.orchestra.run.smithi166.stdout: # don't complain about insecure global_id in the test suite 2022-05-11T19:42:17.688 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-05-11T19:42:17.689 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-05-11T19:42:17.689 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.689 INFO:teuthology.orchestra.run.smithi166.stdout: # 1m isn't quite enough 2022-05-11T19:42:17.689 INFO:teuthology.orchestra.run.smithi166.stdout: mon_down_mkfs_grace = 2m 2022-05-11T19:42:17.689 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.690 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_filestore_osds = false 2022-05-11T19:42:17.690 INFO:teuthology.orchestra.run.smithi166.stdout: mon op complaint time = 120 2022-05-11T19:42:17.690 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-05-11T19:42:17.690 INFO:teuthology.orchestra.run.smithi166.stdout:[client] 2022-05-11T19:42:17.691 INFO:teuthology.orchestra.run.smithi166.stdout: rgw cache enabled = true 2022-05-11T19:42:17.691 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable ops log = true 2022-05-11T19:42:17.691 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable usage log = true 2022-05-11T19:42:17.691 INFO:teuthology.orchestra.run.smithi166.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-05-11T19:42:17.692 INFO:teuthology.orchestra.run.smithi166.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-05-11T19:42:17.692 INFO:teuthology.orchestra.run.smithi166.stdout: client mount timeout = 600 2022-05-11T19:42:17.692 INFO:teuthology.orchestra.run.smithi166.stdout: debug client = 20 2022-05-11T19:42:17.692 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-05-11T19:42:17.692 INFO:teuthology.orchestra.run.smithi166.stdout: pid file = "" 2022-05-11T19:42:17.693 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 900 2022-05-11T19:42:17.693 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 900 2022-05-11T19:42:17.693 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.a] 2022-05-11T19:42:17.693 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.b] 2022-05-11T19:42:17.694 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.c] 2022-05-11T19:42:17.694 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.a] 2022-05-11T19:42:17.694 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.c] 2022-05-11T19:42:17.695 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.b] 2022-05-11T19:42:17.696 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.d] 2022-05-11T19:42:17.696 INFO:teuthology.orchestra.run.smithi166.stdout:[mds] 2022-05-11T19:42:17.696 INFO:teuthology.orchestra.run.smithi166.stdout: debug mds = 20 2022-05-11T19:42:17.697 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-05-11T19:42:17.697 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug frag = True 2022-05-11T19:42:17.697 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug scatterstat = True 2022-05-11T19:42:17.697 INFO:teuthology.orchestra.run.smithi166.stdout: mds op complaint time = 180 2022-05-11T19:42:17.697 INFO:teuthology.orchestra.run.smithi166.stdout: mds verify scatter = True 2022-05-11T19:42:17.698 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2022-05-11T19:42:17.698 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 900 2022-05-11T19:42:17.698 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 900 2022-05-11T19:42:17.699 INFO:tasks.ceph:Creating admin key on mon.a... 2022-05-11T19:42:17.699 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-05-11T19:42:17.754 INFO:tasks.ceph:Copying monmap to all nodes... 2022-05-11T19:42:17.754 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:17.755 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-05-11T19:42:17.771 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:17.771 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-05-11T19:42:17.827 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2022-05-11T19:42:17.827 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:17.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2022-05-11T19:42:17.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-05-11T19:42:17.903 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:17.904 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:17.959 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi166.front.sepia.ceph.com 2022-05-11T19:42:17.960 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:17.960 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/ceph/ceph.keyring 2022-05-11T19:42:17.960 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-05-11T19:42:18.004 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:18.004 DEBUG:teuthology.orchestra.run.smithi166:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:18.063 INFO:tasks.ceph:Setting up mon nodes... 2022-05-11T19:42:18.063 INFO:tasks.ceph:Setting up mgr nodes... 2022-05-11T19:42:18.064 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-05-11T19:42:18.114 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-05-11T19:42:18.116 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-05-11T19:42:18.174 INFO:teuthology.orchestra.run.smithi166.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-05-11T19:42:18.176 INFO:tasks.ceph:Setting up mds nodes... 2022-05-11T19:42:18.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-05-11T19:42:18.225 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-05-11T19:42:18.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-05-11T19:42:18.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-05-11T19:42:18.343 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-05-11T19:42:18.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-05-11T19:42:18.377 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-05-11T19:42:18.439 INFO:teuthology.orchestra.run.smithi166.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-05-11T19:42:18.439 DEBUG:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-05-11T19:42:18.467 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-05-11T19:42:18.556 INFO:teuthology.orchestra.run.smithi166.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-05-11T19:42:18.559 DEBUG:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-05-11T19:42:18.584 INFO:tasks.ceph_client:Setting up client nodes... 2022-05-11T19:42:18.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-05-11T19:42:18.625 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-05-11T19:42:18.640 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2022-05-11T19:42:18.718 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.2.keyring 2022-05-11T19:42:18.731 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-05-11T19:42:18.771 INFO:teuthology.orchestra.run.smithi166.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-05-11T19:42:18.784 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2022-05-11T19:42:18.862 INFO:teuthology.orchestra.run.smithi166.stdout:creating /etc/ceph/ceph.client.3.keyring 2022-05-11T19:42:18.875 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-05-11T19:42:18.876 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi166.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-05-11T19:42:18.876 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-05-11T19:42:18.902 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:18.902 INFO:tasks.ceph:role: osd.0 2022-05-11T19:42:18.902 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2022-05-11T19:42:18.903 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-05-11T19:42:18.975 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-05-11T19:42:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-11T19:42:18.975 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-11T19:42:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2022-05-11T19:42:18.976 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-11T19:42:18.976 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2022-05-11T19:42:18.976 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-11T19:42:18.976 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-11T19:42:18.977 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-11T19:42:18.977 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-11T19:42:19.341 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2022-05-11T19:42:19.345 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2022-05-11T19:42:19.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-05-11T19:42:19.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-05-11T19:42:19.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-05-11T19:42:19.554 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:19.554 INFO:tasks.ceph:role: osd.1 2022-05-11T19:42:19.554 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2022-05-11T19:42:19.555 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-05-11T19:42:19.627 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-05-11T19:42:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-11T19:42:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-11T19:42:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2022-05-11T19:42:19.629 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-11T19:42:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2022-05-11T19:42:19.629 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-11T19:42:19.629 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-11T19:42:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-11T19:42:19.630 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-11T19:42:19.992 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2022-05-11T19:42:19.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2022-05-11T19:42:19.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-05-11T19:42:20.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-05-11T19:42:20.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-05-11T19:42:20.183 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:20.183 INFO:tasks.ceph:role: osd.2 2022-05-11T19:42:20.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2022-05-11T19:42:20.185 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-05-11T19:42:20.256 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-05-11T19:42:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-11T19:42:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-11T19:42:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2022-05-11T19:42:20.257 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-11T19:42:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2022-05-11T19:42:20.258 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-11T19:42:20.258 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-11T19:42:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-11T19:42:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-11T19:42:20.630 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2022-05-11T19:42:20.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2022-05-11T19:42:20.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-05-11T19:42:20.730 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-05-11T19:42:20.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-05-11T19:42:20.825 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:20.826 INFO:tasks.ceph:role: osd.3 2022-05-11T19:42:20.826 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2022-05-11T19:42:20.827 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-05-11T19:42:20.898 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-05-11T19:42:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-11T19:42:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-11T19:42:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2022-05-11T19:42:20.899 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-11T19:42:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2022-05-11T19:42:20.900 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-11T19:42:20.901 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-11T19:42:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-11T19:42:20.901 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-11T19:42:21.269 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2022-05-11T19:42:21.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2022-05-11T19:42:21.271 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-05-11T19:42:21.380 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-05-11T19:42:21.414 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:21.497 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:21.495+0000 7fe73a2833c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-05-11T19:42:21.501 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:21.500+0000 7fe73a2833c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-05-11T19:42:21.502 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:21.500+0000 7fe73a2833c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-05-11T19:42:21.502 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:21.500+0000 7fe73a2833c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-05-11T19:42:21.502 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:21.500+0000 7fe73a2833c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-05-11T19:42:21.504 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:21.502+0000 7fe73a2833c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-05-11T19:42:24.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-05-11T19:42:24.433 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:24.521 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:24.519+0000 7fbee9a713c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-05-11T19:42:24.521 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:24.519+0000 7fbee9a713c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-05-11T19:42:24.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:24.519+0000 7fbee9a713c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-05-11T19:42:24.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:24.519+0000 7fbee9a713c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-05-11T19:42:24.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:24.519+0000 7fbee9a713c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-05-11T19:42:24.523 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:24.519+0000 7fbee9a713c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-05-11T19:42:27.379 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-05-11T19:42:29.358 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:29.448 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:29.445+0000 7f60608533c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-05-11T19:42:29.449 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:29.445+0000 7f60608533c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-05-11T19:42:29.449 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:29.446+0000 7f60608533c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-05-11T19:42:29.450 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:29.446+0000 7f60608533c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-05-11T19:42:29.450 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:29.446+0000 7f60608533c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-05-11T19:42:29.451 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:29.446+0000 7f60608533c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-05-11T19:42:32.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-05-11T19:42:32.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:32.420 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:32.417+0000 7fa01e55b3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-05-11T19:42:32.421 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:32.418+0000 7fa01e55b3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-05-11T19:42:32.421 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:32.418+0000 7fa01e55b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-05-11T19:42:32.421 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:32.418+0000 7fa01e55b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-05-11T19:42:32.421 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:32.418+0000 7fa01e55b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-05-11T19:42:32.422 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:32.418+0000 7fa01e55b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-05-11T19:42:35.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-05-11T19:42:35.312 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-05-11T19:42:35.347 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:35.348 INFO:tasks.ceph:role: osd.4 2022-05-11T19:42:35.348 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi166.front.sepia.ceph.com 2022-05-11T19:42:35.348 DEBUG:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-05-11T19:42:35.429 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-05-11T19:42:35.429 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-11T19:42:35.430 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-11T19:42:35.430 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2022-05-11T19:42:35.443 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-11T19:42:35.443 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2022-05-11T19:42:35.444 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-11T19:42:35.444 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-11T19:42:35.445 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-11T19:42:35.445 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-11T19:42:35.796 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2022-05-11T19:42:35.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2022-05-11T19:42:35.798 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-05-11T19:42:35.931 DEBUG:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-05-11T19:42:35.972 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-05-11T19:42:36.047 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:36.048 INFO:tasks.ceph:role: osd.5 2022-05-11T19:42:36.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi166.front.sepia.ceph.com 2022-05-11T19:42:36.048 DEBUG:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-05-11T19:42:36.123 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-05-11T19:42:36.123 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-11T19:42:36.123 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-11T19:42:36.124 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2022-05-11T19:42:36.124 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-11T19:42:36.124 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2022-05-11T19:42:36.124 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-11T19:42:36.125 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-11T19:42:36.125 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-11T19:42:36.125 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-11T19:42:36.485 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2022-05-11T19:42:36.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2022-05-11T19:42:36.488 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-05-11T19:42:36.574 DEBUG:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-05-11T19:42:36.648 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-05-11T19:42:36.717 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:36.719 INFO:tasks.ceph:role: osd.6 2022-05-11T19:42:36.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi166.front.sepia.ceph.com 2022-05-11T19:42:36.720 DEBUG:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-05-11T19:42:36.792 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-05-11T19:42:36.792 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-11T19:42:36.793 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-11T19:42:36.793 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2022-05-11T19:42:36.793 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-11T19:42:36.793 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2022-05-11T19:42:36.794 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-11T19:42:36.794 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-11T19:42:36.794 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-11T19:42:36.794 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-11T19:42:37.169 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2022-05-11T19:42:37.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2022-05-11T19:42:37.171 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-05-11T19:42:37.267 DEBUG:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-05-11T19:42:37.299 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-05-11T19:42:37.366 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-05-11T19:42:37.366 INFO:tasks.ceph:role: osd.7 2022-05-11T19:42:37.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi166.front.sepia.ceph.com 2022-05-11T19:42:37.367 DEBUG:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-05-11T19:42:37.439 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-05-11T19:42:37.439 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2022-05-11T19:42:37.439 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-05-11T19:42:37.439 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2022-05-11T19:42:37.440 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-05-11T19:42:37.440 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2022-05-11T19:42:37.440 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-05-11T19:42:37.440 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-05-11T19:42:37.441 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-05-11T19:42:37.441 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-05-11T19:42:37.808 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2022-05-11T19:42:37.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2022-05-11T19:42:37.810 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-05-11T19:42:37.913 DEBUG:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-05-11T19:42:37.945 DEBUG:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:38.028 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:38.025+0000 7f7ebcf093c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-05-11T19:42:38.031 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:38.028+0000 7f7ebcf093c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-05-11T19:42:38.033 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:38.028+0000 7f7ebcf093c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-05-11T19:42:38.033 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:38.028+0000 7f7ebcf093c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-05-11T19:42:38.033 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:38.029+0000 7f7ebcf093c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-05-11T19:42:38.034 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:38.031+0000 7f7ebcf093c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-05-11T19:42:40.895 DEBUG:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-05-11T19:42:40.964 DEBUG:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:41.050 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:41.047+0000 7fb6a68c83c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-05-11T19:42:41.050 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:41.047+0000 7fb6a68c83c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-05-11T19:42:41.050 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:41.047+0000 7fb6a68c83c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-05-11T19:42:41.051 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:41.047+0000 7fb6a68c83c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-05-11T19:42:41.051 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:41.047+0000 7fb6a68c83c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-05-11T19:42:41.051 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:41.047+0000 7fb6a68c83c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-05-11T19:42:43.906 DEBUG:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-05-11T19:42:43.934 DEBUG:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:44.017 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:44.014+0000 7f04efc043c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-05-11T19:42:44.018 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:44.015+0000 7f04efc043c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-05-11T19:42:44.018 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:44.015+0000 7f04efc043c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-05-11T19:42:44.018 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:44.015+0000 7f04efc043c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-05-11T19:42:44.018 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:44.015+0000 7f04efc043c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-05-11T19:42:44.019 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:44.015+0000 7f04efc043c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-05-11T19:42:46.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-05-11T19:42:46.373 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-05-11T19:42:46.878 DEBUG:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-05-11T19:42:46.907 DEBUG:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:46.991 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:46.989+0000 7fa8a59e13c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-05-11T19:42:46.992 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:46.989+0000 7fa8a59e13c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-05-11T19:42:46.992 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:46.989+0000 7fa8a59e13c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-05-11T19:42:46.992 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:46.989+0000 7fa8a59e13c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-05-11T19:42:46.993 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:46.989+0000 7fa8a59e13c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-05-11T19:42:46.993 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:46.989+0000 7fa8a59e13c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-05-11T19:42:49.842 DEBUG:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-05-11T19:42:49.911 INFO:tasks.ceph:Reading keys from all nodes... 2022-05-11T19:42:49.911 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:49.912 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-05-11T19:42:49.942 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:49.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-05-11T19:42:50.011 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:50.012 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-05-11T19:42:50.079 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:50.080 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-05-11T19:42:50.147 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:50.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-05-11T19:42:50.215 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:50.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-05-11T19:42:50.281 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:50.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-05-11T19:42:50.347 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:50.348 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-05-11T19:42:50.378 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:50.378 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-05-11T19:42:50.446 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:50.447 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-05-11T19:42:50.515 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:50.515 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-05-11T19:42:50.582 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:50.582 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-05-11T19:42:50.649 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:50.649 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-05-11T19:42:50.715 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:50.715 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-05-11T19:42:50.781 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:50.781 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-05-11T19:42:50.800 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:50.800 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2022-05-11T19:42:50.858 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:50.859 DEBUG:teuthology.orchestra.run.smithi166:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2022-05-11T19:42:50.876 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:50.876 DEBUG:teuthology.orchestra.run.smithi166:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2022-05-11T19:42:50.932 INFO:tasks.ceph:Adding keys to all mons... 2022-05-11T19:42:50.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2022-05-11T19:42:50.935 DEBUG:teuthology.orchestra.run.smithi166:> sudo tee -a /etc/ceph/ceph.keyring 2022-05-11T19:42:50.976 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2022-05-11T19:42:50.976 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxi2je8BhAABfCxGX6+q7UuZqXTiRCMCw== 2022-05-11T19:42:50.976 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2022-05-11T19:42:50.977 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxi8zdiDRAAC6GYVkBALGA7vmkCqL/FVQ== 2022-05-11T19:42:50.977 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2022-05-11T19:42:50.977 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxihWhiFBAArpJ7OGhemRKH7yxoT4LxLA== 2022-05-11T19:42:50.977 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2022-05-11T19:42:50.977 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCdEXxiLN6VHRAANpsi1CLQy94xgrK2MJ7iAg== 2022-05-11T19:42:50.978 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2022-05-11T19:42:50.978 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCgEXxinXX3HhAAHEUCuEsU4AMmVMomMvoKsw== 2022-05-11T19:42:50.978 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2022-05-11T19:42:50.978 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQClEXxiZQunGhAANYl4sVX9OjLRt/B70gV5Ew== 2022-05-11T19:42:50.979 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2022-05-11T19:42:50.979 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCoEXxiDoX9GBAAqKiHRCz/9E4dkZZQagkCFA== 2022-05-11T19:42:50.979 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2022-05-11T19:42:50.979 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxiJfZLChAALQCNj23z0FkY2q3EeC45kQ== 2022-05-11T19:42:50.980 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2022-05-11T19:42:50.980 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxiFpztGRAAUTYrDRFTEVkKkysMhD72NQ== 2022-05-11T19:42:50.980 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2022-05-11T19:42:50.980 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxiDyUjIRAAWuJ5ggk2fSh746JICv0/iQ== 2022-05-11T19:42:50.980 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2022-05-11T19:42:50.981 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCuEXxifGScARAARmcaSYgUcJGisCYqsVnPvQ== 2022-05-11T19:42:50.981 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2022-05-11T19:42:50.981 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCxEXxidcjhAhAANhV2bDl5LInjf4CEuwIpVQ== 2022-05-11T19:42:50.981 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2022-05-11T19:42:50.982 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC0EXxiMQzzABAASicPFUhxjQeVe1q6oxhrkg== 2022-05-11T19:42:50.982 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2022-05-11T19:42:50.982 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC2EXxiaKIFOxAA4/8/2HJVXLM+6sn3rDGJDw== 2022-05-11T19:42:50.982 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2022-05-11T19:42:50.983 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxihgI8JRAAGFq/vbOyx1lN2ot0X95nDA== 2022-05-11T19:42:50.983 INFO:teuthology.orchestra.run.smithi134.stdout:[client.2] 2022-05-11T19:42:50.983 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxixwG+KhAAJZ/V0STWfEl4piy6aKUA2w== 2022-05-11T19:42:50.983 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2022-05-11T19:42:50.983 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxi11LiLRAA1SEC5u0Y9oSdEQeowslsTg== 2022-05-11T19:42:50.984 INFO:teuthology.orchestra.run.smithi134.stdout:[client.3] 2022-05-11T19:42:50.984 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCaEXxiYptfMxAArK3Yx6oXPFgiTLv9+DxYYw== 2022-05-11T19:42:50.996 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr.y] 2022-05-11T19:42:50.996 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxi2je8BhAABfCxGX6+q7UuZqXTiRCMCw== 2022-05-11T19:42:50.996 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.a] 2022-05-11T19:42:50.996 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxi8zdiDRAAC6GYVkBALGA7vmkCqL/FVQ== 2022-05-11T19:42:50.997 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.c] 2022-05-11T19:42:50.997 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxihWhiFBAArpJ7OGhemRKH7yxoT4LxLA== 2022-05-11T19:42:50.997 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.0] 2022-05-11T19:42:50.997 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCdEXxiLN6VHRAANpsi1CLQy94xgrK2MJ7iAg== 2022-05-11T19:42:50.998 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.1] 2022-05-11T19:42:50.998 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCgEXxinXX3HhAAHEUCuEsU4AMmVMomMvoKsw== 2022-05-11T19:42:50.998 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.2] 2022-05-11T19:42:50.998 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQClEXxiZQunGhAANYl4sVX9OjLRt/B70gV5Ew== 2022-05-11T19:42:50.999 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.3] 2022-05-11T19:42:50.999 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCoEXxiDoX9GBAAqKiHRCz/9E4dkZZQagkCFA== 2022-05-11T19:42:50.999 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr.x] 2022-05-11T19:42:50.999 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxiJfZLChAALQCNj23z0FkY2q3EeC45kQ== 2022-05-11T19:42:50.999 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.b] 2022-05-11T19:42:51.000 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxiFpztGRAAUTYrDRFTEVkKkysMhD72NQ== 2022-05-11T19:42:51.000 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.d] 2022-05-11T19:42:51.000 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxiDyUjIRAAWuJ5ggk2fSh746JICv0/iQ== 2022-05-11T19:42:51.000 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.4] 2022-05-11T19:42:51.001 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCuEXxifGScARAARmcaSYgUcJGisCYqsVnPvQ== 2022-05-11T19:42:51.001 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.5] 2022-05-11T19:42:51.001 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCxEXxidcjhAhAANhV2bDl5LInjf4CEuwIpVQ== 2022-05-11T19:42:51.001 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.6] 2022-05-11T19:42:51.001 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQC0EXxiMQzzABAASicPFUhxjQeVe1q6oxhrkg== 2022-05-11T19:42:51.002 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.7] 2022-05-11T19:42:51.002 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQC2EXxiaKIFOxAA4/8/2HJVXLM+6sn3rDGJDw== 2022-05-11T19:42:51.002 INFO:teuthology.orchestra.run.smithi166.stdout:[client.0] 2022-05-11T19:42:51.002 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxihgI8JRAAGFq/vbOyx1lN2ot0X95nDA== 2022-05-11T19:42:51.003 INFO:teuthology.orchestra.run.smithi166.stdout:[client.2] 2022-05-11T19:42:51.003 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxixwG+KhAAJZ/V0STWfEl4piy6aKUA2w== 2022-05-11T19:42:51.003 INFO:teuthology.orchestra.run.smithi166.stdout:[client.1] 2022-05-11T19:42:51.003 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxi11LiLRAA1SEC5u0Y9oSdEQeowslsTg== 2022-05-11T19:42:51.003 INFO:teuthology.orchestra.run.smithi166.stdout:[client.3] 2022-05-11T19:42:51.004 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQCaEXxiYptfMxAArK3Yx6oXPFgiTLv9+DxYYw== 2022-05-11T19:42:51.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-05-11T19:42:51.028 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-05-11T19:42:51.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-11T19:42:51.095 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-11T19:42:51.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-11T19:42:51.150 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-11T19:42:51.202 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.205 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.256 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.307 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.358 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-05-11T19:42:51.408 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-05-11T19:42:51.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-11T19:42:51.459 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-11T19:42:51.510 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-11T19:42:51.512 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-05-11T19:42:51.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.566 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.614 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.616 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.669 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.718 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.722 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-05-11T19:42:51.770 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-11T19:42:51.773 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-11T19:42:51.824 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-11T19:42:51.827 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-11T19:42:51.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-11T19:42:51.880 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-11T19:42:51.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-11T19:42:51.933 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-05-11T19:42:51.984 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-05-11T19:42:51.985 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-05-11T19:42:52.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-05-11T19:42:52.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-05-11T19:42:52.131 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-05-11T19:42:52.157 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-05-11T19:42:52.249 DEBUG:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-05-11T19:42:52.275 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-05-11T19:42:52.341 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-05-11T19:42:52.433 DEBUG:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-05-11T19:42:52.459 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:52.462 DEBUG:teuthology.orchestra.run.smithi166:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-05-11T19:42:52.514 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-05-11T19:42:52.515 INFO:tasks.ceph.mon.a:Restarting daemon 2022-05-11T19:42:52.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-05-11T19:42:52.519 INFO:tasks.ceph.mon.a:Started 2022-05-11T19:42:52.519 INFO:tasks.ceph.mon.b:Restarting daemon 2022-05-11T19:42:52.520 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-05-11T19:42:52.557 INFO:tasks.ceph.mon.b:Started 2022-05-11T19:42:52.558 INFO:tasks.ceph.mon.c:Restarting daemon 2022-05-11T19:42:52.558 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-05-11T19:42:52.560 INFO:tasks.ceph.mon.c:Started 2022-05-11T19:42:52.561 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-05-11T19:42:52.561 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-05-11T19:42:52.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-05-11T19:42:52.564 INFO:tasks.ceph.mgr.y:Started 2022-05-11T19:42:52.565 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-05-11T19:42:52.565 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-05-11T19:42:52.568 INFO:tasks.ceph.mgr.x:Started 2022-05-11T19:42:52.568 INFO:tasks.ceph:Setting crush tunables to default 2022-05-11T19:42:52.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd crush tunables default 2022-05-11T19:42:52.684 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.682+0000 7f4c6f26d700 1 Processor -- start 2022-05-11T19:42:52.685 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.682+0000 7f4c6f26d700 1 -- start start 2022-05-11T19:42:52.687 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6f26d700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 0x7f4c680c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:52.688 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6f26d700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f4c680c4e40 0x7f4c681597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:52.690 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6f26d700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c680c9770 con 0x7f4c680693f0 2022-05-11T19:42:52.690 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6f26d700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c680ca5d0 con 0x7f4c680c4e40 2022-05-11T19:42:52.690 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6f26d700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680ca010 con 0x7f4c68159420 2022-05-11T19:42:52.691 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6d80a700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4c680693f0 0x7f4c6806be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:46448/0 (socket says 172.21.15.134:46448) 2022-05-11T19:42:52.691 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6d80a700 1 -- 172.21.15.134:0/3110557015 learned_addr learned my addr 172.21.15.134:0/3110557015 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:42:52.691 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6d009700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 0x7f4c680c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:52.692 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6c808700 1 --2- 172.21.15.134:0/3110557015 >> v2:172.21.15.166:3300/0 conn(0x7f4c680c4e40 0x7f4c681597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:52.692 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6d009700 1 -- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 msgr2=0x7f4c680c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-05-11T19:42:52.692 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6d009700 1 -- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 msgr2=0x7f4c680c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-11T19:42:52.692 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6c808700 1 -- 172.21.15.134:0/3110557015 >> v2:172.21.15.166:3300/0 conn(0x7f4c680c4e40 msgr2=0x7f4c681597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-05-11T19:42:52.693 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6c808700 1 -- 172.21.15.134:0/3110557015 >> v2:172.21.15.166:3300/0 conn(0x7f4c680c4e40 msgr2=0x7f4c681597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-05-11T19:42:52.693 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6d009700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 0x7f4c680c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-11T19:42:52.693 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6c808700 1 --2- 172.21.15.134:0/3110557015 >> v2:172.21.15.166:3300/0 conn(0x7f4c680c4e40 0x7f4c681597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-05-11T19:42:52.694 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6c808700 1 --2- 172.21.15.134:0/3110557015 >> v2:172.21.15.166:3300/0 conn(0x7f4c680c4e40 0x7f4c681597f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-05-11T19:42:52.694 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.683+0000 7f4c6d009700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 0x7f4c680c3690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-05-11T19:42:52.848 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.845+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026743504 0 0) 0x7f4c680c9770 con 0x7f4c680693f0 2022-05-11T19:42:52.848 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.845+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c500033f0 con 0x7f4c680693f0 2022-05-11T19:42:52.855 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1550148428 0 0) 0x7f4c500033f0 con 0x7f4c680693f0 2022-05-11T19:42:52.856 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 msgr2=0x7f4c680c3690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-11T19:42:52.856 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 0x7f4c680c3690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:52.856 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 >> v2:172.21.15.166:3300/0 conn(0x7f4c680c4e40 msgr2=0x7f4c681597f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-05-11T19:42:52.856 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 --2- 172.21.15.134:0/3110557015 >> v2:172.21.15.166:3300/0 conn(0x7f4c680c4e40 0x7f4c681597f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:52.856 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c680c9a50 con 0x7f4c680693f0 2022-05-11T19:42:52.857 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 667751508 0 0) 0x7f4c600017f0 con 0x7f4c680693f0 2022-05-11T19:42:52.857 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 >> v1:172.21.15.134:6789/0 conn(0x7f4c680693f0 legacy=0x7f4c6806be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:52.857 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50003960 0x7f4c50003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:52.857 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c50004690 0x7f4c50004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:52.858 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 0x7f4c500050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:52.858 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680ca5d0 con 0x7f4c50003960 2022-05-11T19:42:52.858 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680ca010 con 0x7f4c50004690 2022-05-11T19:42:52.858 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5000baf0 con 0x7f4c68159420 2022-05-11T19:42:52.858 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c6d009700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50003960 0x7f4c50003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:52.859 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.846+0000 7f4c6c808700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c50004690 0x7f4c50004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:52.859 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c6d80a700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 0x7f4c500050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:52.859 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c6d009700 1 -- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 msgr2=0x7f4c500050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:52.859 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c6d009700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 0x7f4c500050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:52.860 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c6d009700 1 -- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c50004690 msgr2=0x7f4c50004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:52.860 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c6d009700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c50004690 0x7f4c50004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:52.860 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c6d009700 1 -- 172.21.15.134:0/3110557015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500033f0 con 0x7f4c50003960 2022-05-11T19:42:52.860 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c6d80a700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68159420 0x7f4c500050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-11T19:42:52.860 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c6d009700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50003960 0x7f4c50003d70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c64006e50 tx=0x7f4c64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90746bea54e29101 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:52.861 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64017070 con 0x7f4c50003960 2022-05-11T19:42:52.861 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c64004020 con 0x7f4c50003960 2022-05-11T19:42:52.861 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.847+0000 7f4c57fff700 1 -- 172.21.15.134:0/3110557015 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c640043c0 con 0x7f4c50003960 2022-05-11T19:42:52.861 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.848+0000 7f4c6f26d700 1 -- 172.21.15.134:0/3110557015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50003960 msgr2=0x7f4c50003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:52.861 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.848+0000 7f4c6f26d700 1 --2- 172.21.15.134:0/3110557015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c50003960 0x7f4c50003d70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c64006e50 tx=0x7f4c64008040 comp rx=0 tx=0).stop 2022-05-11T19:42:52.862 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.848+0000 7f4c6d80a700 1 -- 172.21.15.134:0/3110557015 reap_dead start 2022-05-11T19:42:52.862 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.848+0000 7f4c6f26d700 1 -- 172.21.15.134:0/3110557015 shutdown_connections 2022-05-11T19:42:52.862 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.848+0000 7f4c6f26d700 1 -- 172.21.15.134:0/3110557015 >> 172.21.15.134:0/3110557015 conn(0x7f4c68063620 msgr2=0x7f4c68063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:52.862 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.848+0000 7f4c6f26d700 1 -- 172.21.15.134:0/3110557015 shutdown_connections 2022-05-11T19:42:52.863 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.848+0000 7f4c6f26d700 1 -- 172.21.15.134:0/3110557015 wait complete. 2022-05-11T19:42:52.863 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.849+0000 7f4c6f26d700 1 Processor -- start 2022-05-11T19:42:52.863 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.849+0000 7f4c6f26d700 1 -- start start 2022-05-11T19:42:52.863 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6f26d700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c50003960 0x7f4c68146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:52.863 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6f26d700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68157780 0x7f4c680c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:52.864 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6f26d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c68157bf0 0x7f4c680c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:52.864 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6f26d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c681581a0 con 0x7f4c68157bf0 2022-05-11T19:42:52.864 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6f26d700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68158480 con 0x7f4c50003960 2022-05-11T19:42:52.864 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6f26d700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68158760 con 0x7f4c68157780 2022-05-11T19:42:52.865 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d80a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c68157bf0 0x7f4c680c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:52.865 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d009700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c50003960 0x7f4c68146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:52.865 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d80a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c68157bf0 0x7f4c680c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39624/0 (socket says 172.21.15.134:39624) 2022-05-11T19:42:52.865 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d80a700 1 -- 172.21.15.134:0/506502379 learned_addr learned my addr 172.21.15.134:0/506502379 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:42:52.865 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6c808700 1 --2- 172.21.15.134:0/506502379 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68157780 0x7f4c680c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:52.866 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d80a700 1 -- 172.21.15.134:0/506502379 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68157780 msgr2=0x7f4c680c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:52.866 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d80a700 1 --2- 172.21.15.134:0/506502379 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68157780 0x7f4c680c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:52.866 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d80a700 1 -- 172.21.15.134:0/506502379 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c50003960 msgr2=0x7f4c68146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:52.866 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d80a700 1 --2- 172.21.15.134:0/506502379 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c50003960 0x7f4c68146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:52.867 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d80a700 1 -- 172.21.15.134:0/506502379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68158a40 con 0x7f4c68157bf0 2022-05-11T19:42:52.867 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.850+0000 7f4c6d80a700 1 --2- 172.21.15.134:0/506502379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c68157bf0 0x7f4c680c7a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c60001330 tx=0x7f4c680ca540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:52.867 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.851+0000 7f4c557fa700 1 -- 172.21.15.134:0/506502379 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60012590 con 0x7f4c68157bf0 2022-05-11T19:42:52.867 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.852+0000 7f4c557fa700 1 -- 172.21.15.134:0/506502379 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c600126f0 con 0x7f4c68157bf0 2022-05-11T19:42:52.867 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.852+0000 7f4c6f26d700 1 -- 172.21.15.134:0/506502379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c68169be0 con 0x7f4c68157bf0 2022-05-11T19:42:52.868 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.852+0000 7f4c557fa700 1 -- 172.21.15.134:0/506502379 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60012ab0 con 0x7f4c68157bf0 2022-05-11T19:42:52.868 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.852+0000 7f4c6f26d700 1 -- 172.21.15.134:0/506502379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6815a160 con 0x7f4c68157bf0 2022-05-11T19:42:52.868 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.852+0000 7f4c557fa700 1 -- 172.21.15.134:0/506502379 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f4c6001d6e0 con 0x7f4c68157bf0 2022-05-11T19:42:52.868 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.852+0000 7f4c557fa700 1 -- 172.21.15.134:0/506502379 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4c60013770 con 0x7f4c68157bf0 2022-05-11T19:42:52.868 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.853+0000 7f4c6f26d700 1 -- 172.21.15.134:0/506502379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c68169f90 con 0x7f4c68157bf0 2022-05-11T19:42:52.869 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.855+0000 7f4c557fa700 1 -- 172.21.15.134:0/506502379 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7f4c6001db50 con 0x7f4c68157bf0 2022-05-11T19:42:52.932 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.930+0000 7f4c6f26d700 1 -- 172.21.15.134:0/506502379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4c6815a350 con 0x7f4c68157bf0 2022-05-11T19:42:52.937 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.934+0000 7f4c557fa700 1 -- 172.21.15.134:0/506502379 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4c600139b0 con 0x7f4c68157bf0 2022-05-11T19:42:52.938 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.935+0000 7f4c6f26d700 1 -- 172.21.15.134:0/506502379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c68157bf0 msgr2=0x7f4c680c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:52.939 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.935+0000 7f4c6f26d700 1 --2- 172.21.15.134:0/506502379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c68157bf0 0x7f4c680c7a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c60001330 tx=0x7f4c680ca540 comp rx=0 tx=0).stop 2022-05-11T19:42:52.939 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.935+0000 7f4c6f26d700 1 -- 172.21.15.134:0/506502379 shutdown_connections 2022-05-11T19:42:52.939 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.935+0000 7f4c6f26d700 1 --2- 172.21.15.134:0/506502379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c68157bf0 0x7f4c680c7a80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:52.939 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.935+0000 7f4c6f26d700 1 --2- 172.21.15.134:0/506502379 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f4c50003960 0x7f4c68146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:52.939 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.935+0000 7f4c6f26d700 1 --2- 172.21.15.134:0/506502379 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f4c68157780 0x7f4c680c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:52.940 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.935+0000 7f4c6f26d700 1 -- 172.21.15.134:0/506502379 >> 172.21.15.134:0/506502379 conn(0x7f4c68063620 msgr2=0x7f4c680cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:52.940 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.935+0000 7f4c6f26d700 1 -- 172.21.15.134:0/506502379 shutdown_connections 2022-05-11T19:42:52.940 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:52.935+0000 7f4c6f26d700 1 -- 172.21.15.134:0/506502379 wait complete. 2022-05-11T19:42:52.940 INFO:teuthology.orchestra.run.smithi134.stderr:adjusted tunables profile to default 2022-05-11T19:42:52.950 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-05-11T19:42:52.950 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:52.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-05-11T19:42:52.958 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:52.957+0000 7fbd19ff5000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-05-11T19:42:52.966 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:52.964+0000 7fbf733c1000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-05-11T19:42:52.976 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:52.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-05-11T19:42:53.021 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:53.020+0000 7fbd19ff5000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-05-11T19:42:53.033 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:53.030+0000 7fbf733c1000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-05-11T19:42:53.041 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:53.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-05-11T19:42:53.092 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:53.090+0000 7fbd19ff5000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-05-11T19:42:53.107 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2022-05-11T19:42:53.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-05-11T19:42:53.108 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:53.104+0000 7fbf733c1000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-05-11T19:42:53.169 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:53.167+0000 7fbd19ff5000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-05-11T19:42:53.172 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:53.172 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-05-11T19:42:53.188 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:53.186+0000 7fbf733c1000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-05-11T19:42:53.198 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:53.198 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-05-11T19:42:53.263 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:53.264 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-05-11T19:42:53.329 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-05-11T19:42:53.330 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-05-11T19:42:53.395 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd new 56e1cfec-aefb-4fe9-b5a7-b6dda26a7f5b 0 2022-05-11T19:42:53.553 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.551+0000 7fa24967b700 1 Processor -- start 2022-05-11T19:42:53.553 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.551+0000 7fa24967b700 1 -- start start 2022-05-11T19:42:53.556 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.551+0000 7fa24967b700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fa244151d90 0x7fa2440cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:53.556 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.551+0000 7fa24967b700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:53.557 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.551+0000 7fa24967b700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2440c34c0 con 0x7fa2441519c0 2022-05-11T19:42:53.557 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.551+0000 7fa24967b700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440cb6e0 con 0x7fa244151d90 2022-05-11T19:42:53.557 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.551+0000 7fa24967b700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24415b6a0 con 0x7fa24415b0e0 2022-05-11T19:42:53.557 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2427fc700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fa244151d90 0x7fa2440cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:53.558 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2437fe700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:53.558 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2427fc700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fa244151d90 0x7fa2440cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.166:42928/0 (socket says 172.21.15.166:42928) 2022-05-11T19:42:53.558 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2437fe700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3301/0 says I am v2:172.21.15.166:38018/0 (socket says 172.21.15.166:38018) 2022-05-11T19:42:53.558 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2427fc700 1 -- 172.21.15.166:0/4001451142 learned_addr learned my addr 172.21.15.166:0/4001451142 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:53.559 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa242ffd700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7fa2441519c0 0x7fa244158510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.166:52304/0 (socket says 172.21.15.166:52304) 2022-05-11T19:42:53.559 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2427fc700 1 -- 172.21.15.166:0/4001451142 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 msgr2=0x7fa2440cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:53.559 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2427fc700 1 --2- 172.21.15.166:0/4001451142 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.559 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2427fc700 1 -- 172.21.15.166:0/4001451142 >> v1:172.21.15.166:6789/0 conn(0x7fa2441519c0 legacy=0x7fa244158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.559 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa241ffb700 1 -- 172.21.15.166:0/4001451142 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767771480 0 0) 0x7fa2440c34c0 con 0x7fa2441519c0 2022-05-11T19:42:53.560 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2427fc700 1 -- 172.21.15.166:0/4001451142 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24415b980 con 0x7fa244151d90 2022-05-11T19:42:53.560 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa2427fc700 1 --2- 172.21.15.166:0/4001451142 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 0x7fa2440cac60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa234006fd0 tx=0x7fa2340090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb53e45eb41fbfde server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:53.560 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa241ffb700 1 -- 172.21.15.166:0/4001451142 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234004030 con 0x7fa244151d90 2022-05-11T19:42:53.560 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa241ffb700 1 -- 172.21.15.166:0/4001451142 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2340041d0 con 0x7fa244151d90 2022-05-11T19:42:53.561 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.552+0000 7fa241ffb700 1 -- 172.21.15.166:0/4001451142 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234011630 con 0x7fa244151d90 2022-05-11T19:42:53.561 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.553+0000 7fa24967b700 1 -- 172.21.15.166:0/4001451142 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 msgr2=0x7fa2440cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.561 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.553+0000 7fa24967b700 1 --2- 172.21.15.166:0/4001451142 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 0x7fa2440cac60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa234006fd0 tx=0x7fa2340090f0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.561 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.553+0000 7fa24967b700 1 -- 172.21.15.166:0/4001451142 shutdown_connections 2022-05-11T19:42:53.561 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.553+0000 7fa24967b700 1 --2- 172.21.15.166:0/4001451142 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.562 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.553+0000 7fa24967b700 1 --2- 172.21.15.166:0/4001451142 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 0x7fa2440cac60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.562 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.553+0000 7fa24967b700 1 -- 172.21.15.166:0/4001451142 >> 172.21.15.166:0/4001451142 conn(0x7fa244063620 msgr2=0x7fa244063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:53.562 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.553+0000 7fa24967b700 1 -- 172.21.15.166:0/4001451142 shutdown_connections 2022-05-11T19:42:53.562 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.553+0000 7fa24967b700 1 -- 172.21.15.166:0/4001451142 wait complete. 2022-05-11T19:42:53.563 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.554+0000 7fa24967b700 1 Processor -- start 2022-05-11T19:42:53.563 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.554+0000 7fa24967b700 1 -- start start 2022-05-11T19:42:53.565 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa24967b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2441519c0 0x7fa2440aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:53.566 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa24967b700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 0x7fa2440c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:53.566 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa24967b700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:53.566 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa24967b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440c5c40 con 0x7fa2441519c0 2022-05-11T19:42:53.566 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa24967b700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440af5a0 con 0x7fa244151d90 2022-05-11T19:42:53.567 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa24967b700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440af880 con 0x7fa24415b0e0 2022-05-11T19:42:53.567 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2437fe700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:53.567 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2427fc700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 0x7fa2440c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:53.567 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2437fe700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3301/0 says I am v2:172.21.15.166:38024/0 (socket says 172.21.15.166:38024) 2022-05-11T19:42:53.568 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2427fc700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 0x7fa2440c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.166:42934/0 (socket says 172.21.15.166:42934) 2022-05-11T19:42:53.568 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2437fe700 1 -- 172.21.15.166:0/186691735 learned_addr learned my addr 172.21.15.166:0/186691735 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:53.568 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa242ffd700 1 --2- 172.21.15.166:0/186691735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2441519c0 0x7fa2440aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:53.568 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2437fe700 1 -- 172.21.15.166:0/186691735 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 msgr2=0x7fa2440c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.568 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2437fe700 1 --2- 172.21.15.166:0/186691735 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 0x7fa2440c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.569 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2437fe700 1 -- 172.21.15.166:0/186691735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2441519c0 msgr2=0x7fa2440aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.569 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2437fe700 1 --2- 172.21.15.166:0/186691735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2441519c0 0x7fa2440aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.569 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2437fe700 1 -- 172.21.15.166:0/186691735 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234009370 con 0x7fa24415b0e0 2022-05-11T19:42:53.569 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa242ffd700 1 --2- 172.21.15.166:0/186691735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2441519c0 0x7fa2440aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-11T19:42:53.570 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.555+0000 7fa2437fe700 1 --2- 172.21.15.166:0/186691735 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440c7060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0122c0 tx=0x7fa23c00f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:53.570 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.556+0000 7fa22affd700 1 -- 172.21.15.166:0/186691735 <== mon.2 v2:172.21.15.166:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00d0d0 con 0x7fa24415b0e0 2022-05-11T19:42:53.570 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.556+0000 7fa22affd700 1 -- 172.21.15.166:0/186691735 <== mon.2 v2:172.21.15.166:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c013040 con 0x7fa24415b0e0 2022-05-11T19:42:53.570 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.556+0000 7fa24967b700 1 -- 172.21.15.166:0/186691735 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2440afb60 con 0x7fa24415b0e0 2022-05-11T19:42:53.570 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.556+0000 7fa22affd700 1 -- 172.21.15.166:0/186691735 <== mon.2 v2:172.21.15.166:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00d480 con 0x7fa24415b0e0 2022-05-11T19:42:53.571 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.556+0000 7fa24967b700 1 -- 172.21.15.166:0/186691735 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2440b0120 con 0x7fa24415b0e0 2022-05-11T19:42:53.571 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.556+0000 7fa22affd700 1 -- 172.21.15.166:0/186691735 <== mon.2 v2:172.21.15.166:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fa23c00b960 con 0x7fa24415b0e0 2022-05-11T19:42:53.571 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.556+0000 7fa22affd700 1 -- 172.21.15.166:0/186691735 <== mon.2 v2:172.21.15.166:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa23c018980 con 0x7fa24415b0e0 2022-05-11T19:42:53.571 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.557+0000 7fa24967b700 1 -- 172.21.15.166:0/186691735 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2440b0490 con 0x7fa24415b0e0 2022-05-11T19:42:53.571 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.559+0000 7fa22affd700 1 -- 172.21.15.166:0/186691735 <== mon.2 v2:172.21.15.166:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7fa23c00bdd0 con 0x7fa24415b0e0 2022-05-11T19:42:53.643 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.641+0000 7fa24967b700 1 -- 172.21.15.166:0/186691735 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_command({"prefix": "osd new", "uuid": "56e1cfec-aefb-4fe9-b5a7-b6dda26a7f5b", "id": 0} v 0) v1 -- 0x7fa24404c7e0 con 0x7fa24415b0e0 2022-05-11T19:42:53.649 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.646+0000 7fa22affd700 1 -- 172.21.15.166:0/186691735 <== mon.2 v2:172.21.15.166:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56e1cfec-aefb-4fe9-b5a7-b6dda26a7f5b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa23c018b90 con 0x7fa24415b0e0 2022-05-11T19:42:53.649 INFO:teuthology.orchestra.run.smithi166.stdout:0 2022-05-11T19:42:53.650 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.647+0000 7fa24967b700 1 -- 172.21.15.166:0/186691735 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 msgr2=0x7fa2440c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.650 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.647+0000 7fa24967b700 1 --2- 172.21.15.166:0/186691735 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440c7060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0122c0 tx=0x7fa23c00f040 comp rx=0 tx=0).stop 2022-05-11T19:42:53.651 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.647+0000 7fa24967b700 1 -- 172.21.15.166:0/186691735 shutdown_connections 2022-05-11T19:42:53.651 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.647+0000 7fa24967b700 1 --2- 172.21.15.166:0/186691735 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa24415b0e0 0x7fa2440c7060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.651 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.647+0000 7fa24967b700 1 --2- 172.21.15.166:0/186691735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2441519c0 0x7fa2440aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.651 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.647+0000 7fa24967b700 1 --2- 172.21.15.166:0/186691735 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa244151d90 0x7fa2440c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.652 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.647+0000 7fa24967b700 1 -- 172.21.15.166:0/186691735 >> 172.21.15.166:0/186691735 conn(0x7fa244063620 msgr2=0x7fa2440cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:53.652 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.648+0000 7fa24967b700 1 -- 172.21.15.166:0/186691735 shutdown_connections 2022-05-11T19:42:53.652 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.648+0000 7fa24967b700 1 -- 172.21.15.166:0/186691735 wait complete. 2022-05-11T19:42:53.661 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd new d2a3acee-ede6-47f8-81c4-7e019143a485 1 2022-05-11T19:42:53.732 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:53.729+0000 7fbf733c1000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-05-11T19:42:53.750 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:53.748+0000 7fbd19ff5000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-05-11T19:42:53.778 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.775+0000 7f746f4d5700 1 Processor -- start 2022-05-11T19:42:53.778 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.775+0000 7f746f4d5700 1 -- start start 2022-05-11T19:42:53.781 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.776+0000 7f746f4d5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f746806b480 0x7f746806ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:53.781 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.776+0000 7f746f4d5700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74680c28e0 con 0x7f74681566d0 2022-05-11T19:42:53.781 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.776+0000 7f746f4d5700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746806f9a0 con 0x7f7468156300 2022-05-11T19:42:53.782 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.776+0000 7f746f4d5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746806fc80 con 0x7f746806b480 2022-05-11T19:42:53.782 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.776+0000 7f746d271700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7f7468156300 0x7f746806ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.166:52316/0 (socket says 172.21.15.166:52316) 2022-05-11T19:42:53.782 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.776+0000 7f746d271700 1 -- 172.21.15.166:0/388889897 learned_addr learned my addr 172.21.15.166:0/388889897 (peer_addr_for_me v1:172.21.15.166:0/0) 2022-05-11T19:42:53.782 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f746ca70700 1 --2- 172.21.15.166:0/388889897 >> v2:172.21.15.134:3300/0 conn(0x7f746806b480 0x7f746806ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:53.783 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f7457fff700 1 -- 172.21.15.166:0/388889897 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886809429 0 0) 0x7f746806f9a0 con 0x7f7468156300 2022-05-11T19:42:53.783 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f7457fff700 1 -- 172.21.15.166:0/388889897 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74500033f0 con 0x7f7468156300 2022-05-11T19:42:53.783 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f746ca70700 1 -- 172.21.15.166:0/388889897 >> v1:172.21.15.166:6789/0 conn(0x7f7468156300 legacy=0x7f746806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.783 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f746ca70700 1 -- 172.21.15.166:0/388889897 >> v1:172.21.15.134:6789/0 conn(0x7f74681566d0 legacy=0x7f746806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.783 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f746ca70700 1 -- 172.21.15.166:0/388889897 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74680c2290 con 0x7f746806b480 2022-05-11T19:42:53.784 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f746ca70700 1 --2- 172.21.15.166:0/388889897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746806b480 0x7f746806ec70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7458009760 tx=0x7f7458009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4f6ce427b23e8c server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:53.784 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f7457fff700 1 -- 172.21.15.166:0/388889897 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458011630 con 0x7f746806b480 2022-05-11T19:42:53.784 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f7457fff700 1 -- 172.21.15.166:0/388889897 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7458011790 con 0x7f746806b480 2022-05-11T19:42:53.784 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.777+0000 7f7457fff700 1 -- 172.21.15.166:0/388889897 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458011b10 con 0x7f746806b480 2022-05-11T19:42:53.785 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.778+0000 7f746f4d5700 1 -- 172.21.15.166:0/388889897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746806b480 msgr2=0x7f746806ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.785 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.778+0000 7f746f4d5700 1 --2- 172.21.15.166:0/388889897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746806b480 0x7f746806ec70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7458009760 tx=0x7f7458009060 comp rx=0 tx=0).stop 2022-05-11T19:42:53.786 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.778+0000 7f746f4d5700 1 -- 172.21.15.166:0/388889897 shutdown_connections 2022-05-11T19:42:53.786 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.778+0000 7f746f4d5700 1 --2- 172.21.15.166:0/388889897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746806b480 0x7f746806ec70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.786 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.778+0000 7f746f4d5700 1 -- 172.21.15.166:0/388889897 >> 172.21.15.166:0/388889897 conn(0x7f7468069610 msgr2=0x7f74680cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:53.786 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.778+0000 7f746f4d5700 1 -- 172.21.15.166:0/388889897 shutdown_connections 2022-05-11T19:42:53.787 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.778+0000 7f746f4d5700 1 -- 172.21.15.166:0/388889897 wait complete. 2022-05-11T19:42:53.790 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.780+0000 7f746f4d5700 1 Processor -- start 2022-05-11T19:42:53.790 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.780+0000 7f746f4d5700 1 -- start start 2022-05-11T19:42:53.790 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.781+0000 7f746f4d5700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f746806b480 0x7f746815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:53.791 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.781+0000 7f746f4d5700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7468156300 0x7f746815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:53.791 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.781+0000 7f746f4d5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74681566d0 0x7f74680c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:53.791 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.781+0000 7f746f4d5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7468168810 con 0x7f74681566d0 2022-05-11T19:42:53.791 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.781+0000 7f746f4d5700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7468167c90 con 0x7f746806b480 2022-05-11T19:42:53.791 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.781+0000 7f746f4d5700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7468167f70 con 0x7f7468156300 2022-05-11T19:42:53.792 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746d271700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f746806b480 0x7f746815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:53.792 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746ca70700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7468156300 0x7f746815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:53.792 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746ca70700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7468156300 0x7f746815bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3301/0 says I am v2:172.21.15.166:38034/0 (socket says 172.21.15.166:38034) 2022-05-11T19:42:53.792 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746ca70700 1 -- 172.21.15.166:0/355350494 learned_addr learned my addr 172.21.15.166:0/355350494 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:53.793 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746d271700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f746806b480 0x7f746815a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.166:42944/0 (socket says 172.21.15.166:42944) 2022-05-11T19:42:53.793 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746da72700 1 --2- 172.21.15.166:0/355350494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74681566d0 0x7f74680c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:53.793 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746d271700 1 -- 172.21.15.166:0/355350494 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7468156300 msgr2=0x7f746815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.793 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746d271700 1 --2- 172.21.15.166:0/355350494 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7468156300 0x7f746815bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.793 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746d271700 1 -- 172.21.15.166:0/355350494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74681566d0 msgr2=0x7f74680c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.794 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746d271700 1 --2- 172.21.15.166:0/355350494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74681566d0 0x7f74680c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.794 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746d271700 1 -- 172.21.15.166:0/355350494 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74580092a0 con 0x7f746806b480 2022-05-11T19:42:53.794 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746ca70700 1 --2- 172.21.15.166:0/355350494 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7468156300 0x7f746815bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-11T19:42:53.795 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746d271700 1 --2- 172.21.15.166:0/355350494 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f746806b480 0x7f746815a630 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f746400c3f0 tx=0x7f7464007bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:53.795 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f74557fa700 1 -- 172.21.15.166:0/355350494 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640070d0 con 0x7f746806b480 2022-05-11T19:42:53.795 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f74557fa700 1 -- 172.21.15.166:0/355350494 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464007230 con 0x7f746806b480 2022-05-11T19:42:53.795 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746f4d5700 1 -- 172.21.15.166:0/355350494 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7468168250 con 0x7f746806b480 2022-05-11T19:42:53.796 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f74557fa700 1 -- 172.21.15.166:0/355350494 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464007630 con 0x7f746806b480 2022-05-11T19:42:53.796 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f746f4d5700 1 -- 172.21.15.166:0/355350494 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746815ab70 con 0x7f746806b480 2022-05-11T19:42:53.796 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f74557fa700 1 -- 172.21.15.166:0/355350494 <== mon.1 v2:172.21.15.166:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f7464019030 con 0x7f746806b480 2022-05-11T19:42:53.797 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.782+0000 7f74557fa700 1 -- 172.21.15.166:0/355350494 <== mon.1 v2:172.21.15.166:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f746401cbf0 con 0x7f746806b480 2022-05-11T19:42:53.797 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.783+0000 7f746f4d5700 1 -- 172.21.15.166:0/355350494 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746804c7e0 con 0x7f746806b480 2022-05-11T19:42:53.797 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.786+0000 7f74557fa700 1 -- 172.21.15.166:0/355350494 <== mon.1 v2:172.21.15.166:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7f7464017070 con 0x7f746806b480 2022-05-11T19:42:53.801 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:53.798+0000 7fbf733c1000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-05-11T19:42:53.823 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:53.821+0000 7fbd19ff5000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-05-11T19:42:53.870 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.868+0000 7f746f4d5700 1 -- 172.21.15.166:0/355350494 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2a3acee-ede6-47f8-81c4-7e019143a485", "id": 1} v 0) v1 -- 0x7f746816af10 con 0x7f746806b480 2022-05-11T19:42:53.878 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.875+0000 7f74557fa700 1 -- 172.21.15.166:0/355350494 <== mon.1 v2:172.21.15.166:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2a3acee-ede6-47f8-81c4-7e019143a485", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f746816af10 con 0x7f746806b480 2022-05-11T19:42:53.878 INFO:teuthology.orchestra.run.smithi166.stdout:1 2022-05-11T19:42:53.879 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.877+0000 7f746f4d5700 1 -- 172.21.15.166:0/355350494 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f746806b480 msgr2=0x7f746815a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:53.880 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.877+0000 7f746f4d5700 1 --2- 172.21.15.166:0/355350494 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f746806b480 0x7f746815a630 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f746400c3f0 tx=0x7f7464007bb0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.880 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.877+0000 7f746f4d5700 1 -- 172.21.15.166:0/355350494 shutdown_connections 2022-05-11T19:42:53.880 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.877+0000 7f746f4d5700 1 --2- 172.21.15.166:0/355350494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74681566d0 0x7f74680c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.880 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.877+0000 7f746f4d5700 1 --2- 172.21.15.166:0/355350494 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f746806b480 0x7f746815a630 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.881 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.877+0000 7f746f4d5700 1 --2- 172.21.15.166:0/355350494 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7468156300 0x7f746815bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:53.881 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.877+0000 7f746f4d5700 1 -- 172.21.15.166:0/355350494 >> 172.21.15.166:0/355350494 conn(0x7f7468069610 msgr2=0x7f7468150d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:53.881 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.877+0000 7f746f4d5700 1 -- 172.21.15.166:0/355350494 shutdown_connections 2022-05-11T19:42:53.881 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:53.877+0000 7f746f4d5700 1 -- 172.21.15.166:0/355350494 wait complete. 2022-05-11T19:42:53.890 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd new ef94ace6-f5aa-4572-838b-d92a62fd6f42 2 2022-05-11T19:42:54.006 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.004+0000 7fc65acce700 1 Processor -- start 2022-05-11T19:42:54.006 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.004+0000 7fc65acce700 1 -- start start 2022-05-11T19:42:54.009 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.004+0000 7fc65acce700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc654156300 0x7fc65406ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.009 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc65acce700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6540c28e0 con 0x7fc6541566d0 2022-05-11T19:42:54.010 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc65acce700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65406f9a0 con 0x7fc65406f380 2022-05-11T19:42:54.010 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc65acce700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65406fc80 con 0x7fc654156300 2022-05-11T19:42:54.010 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc658a6a700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc654156300 0x7fc65406ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.010 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc65926b700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7fc65406f380 0x7fc6540c2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.166:52332/0 (socket says 172.21.15.166:52332) 2022-05-11T19:42:54.010 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc65926b700 1 -- 172.21.15.166:0/584540677 learned_addr learned my addr 172.21.15.166:0/584540677 (peer_addr_for_me v1:172.21.15.166:0/0) 2022-05-11T19:42:54.011 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc6537fe700 1 -- 172.21.15.166:0/584540677 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661239494 0 0) 0x7fc65406f9a0 con 0x7fc65406f380 2022-05-11T19:42:54.011 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc6537fe700 1 -- 172.21.15.166:0/584540677 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6380033f0 con 0x7fc65406f380 2022-05-11T19:42:54.011 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc658a6a700 1 -- 172.21.15.166:0/584540677 >> v1:172.21.15.166:6789/0 conn(0x7fc65406f380 legacy=0x7fc6540c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.012 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc658a6a700 1 -- 172.21.15.166:0/584540677 >> v1:172.21.15.134:6789/0 conn(0x7fc6541566d0 legacy=0x7fc65406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.012 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc658a6a700 1 -- 172.21.15.166:0/584540677 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540c2290 con 0x7fc654156300 2022-05-11T19:42:54.012 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc658a6a700 1 --2- 172.21.15.166:0/584540677 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc654156300 0x7fc65406ad70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc648009790 tx=0x7fc648009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91dd2f4d5926b611 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.012 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc6537fe700 1 -- 172.21.15.166:0/584540677 <== mon.2 v2:172.21.15.166:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648011630 con 0x7fc654156300 2022-05-11T19:42:54.012 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc6537fe700 1 -- 172.21.15.166:0/584540677 <== mon.2 v2:172.21.15.166:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc648011790 con 0x7fc654156300 2022-05-11T19:42:54.013 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.005+0000 7fc6537fe700 1 -- 172.21.15.166:0/584540677 <== mon.2 v2:172.21.15.166:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648011b10 con 0x7fc654156300 2022-05-11T19:42:54.013 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.006+0000 7fc65acce700 1 -- 172.21.15.166:0/584540677 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc654156300 msgr2=0x7fc65406ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.013 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.006+0000 7fc65acce700 1 --2- 172.21.15.166:0/584540677 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc654156300 0x7fc65406ad70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc648009790 tx=0x7fc648009060 comp rx=0 tx=0).stop 2022-05-11T19:42:54.013 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.006+0000 7fc65acce700 1 -- 172.21.15.166:0/584540677 shutdown_connections 2022-05-11T19:42:54.014 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.006+0000 7fc65acce700 1 --2- 172.21.15.166:0/584540677 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc654156300 0x7fc65406ad70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.014 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.006+0000 7fc65acce700 1 -- 172.21.15.166:0/584540677 >> 172.21.15.166:0/584540677 conn(0x7fc654069610 msgr2=0x7fc6540cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:54.014 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.006+0000 7fc65acce700 1 -- 172.21.15.166:0/584540677 shutdown_connections 2022-05-11T19:42:54.014 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.006+0000 7fc65acce700 1 -- 172.21.15.166:0/584540677 wait complete. 2022-05-11T19:42:54.014 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.007+0000 7fc65acce700 1 Processor -- start 2022-05-11T19:42:54.017 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.007+0000 7fc65acce700 1 -- start start 2022-05-11T19:42:54.017 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc65acce700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc65406f380 0x7fc654158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.018 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc65acce700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc654156300 0x7fc6540c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.018 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc65acce700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc6541566d0 0x7fc65416b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.018 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc65acce700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654156f80 con 0x7fc654156300 2022-05-11T19:42:54.019 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc65acce700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654152f60 con 0x7fc65406f380 2022-05-11T19:42:54.019 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc65acce700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65416c890 con 0x7fc6541566d0 2022-05-11T19:42:54.019 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc65926b700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc6541566d0 0x7fc65416b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.019 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc658a6a700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc65406f380 0x7fc654158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.019 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc65926b700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc6541566d0 0x7fc65416b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3301/0 says I am v2:172.21.15.166:38048/0 (socket says 172.21.15.166:38048) 2022-05-11T19:42:54.020 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc658a6a700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc65406f380 0x7fc654158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.166:42956/0 (socket says 172.21.15.166:42956) 2022-05-11T19:42:54.020 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc65926b700 1 -- 172.21.15.166:0/149201169 learned_addr learned my addr 172.21.15.166:0/149201169 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:54.020 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.008+0000 7fc653fff700 1 --2- 172.21.15.166:0/149201169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc654156300 0x7fc6540c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.020 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc65926b700 1 -- 172.21.15.166:0/149201169 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc65406f380 msgr2=0x7fc654158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.021 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc65926b700 1 --2- 172.21.15.166:0/149201169 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc65406f380 0x7fc654158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.022 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc65926b700 1 -- 172.21.15.166:0/149201169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc654156300 msgr2=0x7fc6540c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.022 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc65926b700 1 --2- 172.21.15.166:0/149201169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc654156300 0x7fc6540c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.022 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc65926b700 1 -- 172.21.15.166:0/149201169 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6480092a0 con 0x7fc6541566d0 2022-05-11T19:42:54.022 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc658a6a700 1 --2- 172.21.15.166:0/149201169 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc65406f380 0x7fc654158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-11T19:42:54.023 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc65926b700 1 --2- 172.21.15.166:0/149201169 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc6541566d0 0x7fc65416b9a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc64c005ad0 tx=0x7fc64c001650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.023 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc650ff9700 1 -- 172.21.15.166:0/149201169 <== mon.2 v2:172.21.15.166:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c005d30 con 0x7fc6541566d0 2022-05-11T19:42:54.023 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc650ff9700 1 -- 172.21.15.166:0/149201169 <== mon.2 v2:172.21.15.166:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c005e90 con 0x7fc6541566d0 2022-05-11T19:42:54.023 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc65acce700 1 -- 172.21.15.166:0/149201169 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65416c5b0 con 0x7fc6541566d0 2022-05-11T19:42:54.023 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc650ff9700 1 -- 172.21.15.166:0/149201169 <== mon.2 v2:172.21.15.166:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c007300 con 0x7fc6541566d0 2022-05-11T19:42:54.024 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.009+0000 7fc65acce700 1 -- 172.21.15.166:0/149201169 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc654152bf0 con 0x7fc6541566d0 2022-05-11T19:42:54.024 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.010+0000 7fc650ff9700 1 -- 172.21.15.166:0/149201169 <== mon.2 v2:172.21.15.166:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fc64c010070 con 0x7fc6541566d0 2022-05-11T19:42:54.024 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.010+0000 7fc650ff9700 1 -- 172.21.15.166:0/149201169 <== mon.2 v2:172.21.15.166:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fc64c01bb00 con 0x7fc6541566d0 2022-05-11T19:42:54.024 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.010+0000 7fc65acce700 1 -- 172.21.15.166:0/149201169 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65404c7e0 con 0x7fc6541566d0 2022-05-11T19:42:54.025 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.014+0000 7fc650ff9700 1 -- 172.21.15.166:0/149201169 <== mon.2 v2:172.21.15.166:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7fc64c0077f0 con 0x7fc6541566d0 2022-05-11T19:42:54.097 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.095+0000 7fc65acce700 1 -- 172.21.15.166:0/149201169 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ef94ace6-f5aa-4572-838b-d92a62fd6f42", "id": 2} v 0) v1 -- 0x7fc6540c2570 con 0x7fc6541566d0 2022-05-11T19:42:54.103 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.100+0000 7fc650ff9700 1 -- 172.21.15.166:0/149201169 <== mon.2 v2:172.21.15.166:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef94ace6-f5aa-4572-838b-d92a62fd6f42", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc64c02a0b0 con 0x7fc6541566d0 2022-05-11T19:42:54.103 INFO:teuthology.orchestra.run.smithi166.stdout:2 2022-05-11T19:42:54.104 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.101+0000 7fc65acce700 1 -- 172.21.15.166:0/149201169 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc6541566d0 msgr2=0x7fc65416b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.105 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.101+0000 7fc65acce700 1 --2- 172.21.15.166:0/149201169 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc6541566d0 0x7fc65416b9a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc64c005ad0 tx=0x7fc64c001650 comp rx=0 tx=0).stop 2022-05-11T19:42:54.105 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.101+0000 7fc65acce700 1 -- 172.21.15.166:0/149201169 shutdown_connections 2022-05-11T19:42:54.105 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.101+0000 7fc65acce700 1 --2- 172.21.15.166:0/149201169 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fc6541566d0 0x7fc65416b9a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.105 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.101+0000 7fc65acce700 1 --2- 172.21.15.166:0/149201169 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fc65406f380 0x7fc654158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.106 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.101+0000 7fc65acce700 1 --2- 172.21.15.166:0/149201169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc654156300 0x7fc6540c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.106 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.102+0000 7fc65acce700 1 -- 172.21.15.166:0/149201169 >> 172.21.15.166:0/149201169 conn(0x7fc654069610 msgr2=0x7fc6540c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:54.106 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.102+0000 7fc65acce700 1 -- 172.21.15.166:0/149201169 shutdown_connections 2022-05-11T19:42:54.106 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.102+0000 7fc65acce700 1 -- 172.21.15.166:0/149201169 wait complete. 2022-05-11T19:42:54.115 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd new fa809b81-371a-4ab7-a648-0f1a5641d33a 3 2022-05-11T19:42:54.231 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.229+0000 7f55ccbcd700 1 Processor -- start 2022-05-11T19:42:54.231 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.229+0000 7f55ccbcd700 1 -- start start 2022-05-11T19:42:54.234 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.229+0000 7f55ccbcd700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f55c80b0c20 0x7f55c815b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.234 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55ccbcd700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80cb3e0 0x7f55c81585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.234 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55ccbcd700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80c3680 con 0x7f55c80b0850 2022-05-11T19:42:54.235 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55ccbcd700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c8157a00 con 0x7f55c80b0c20 2022-05-11T19:42:54.235 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55ccbcd700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8158ae0 con 0x7f55c80cb3e0 2022-05-11T19:42:54.235 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c6d9d700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80cb3e0 0x7f55c81585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.235 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c5d9b700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f55c80b0c20 0x7f55c815b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.235 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c6d9d700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80cb3e0 0x7f55c81585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3301/0 says I am v2:172.21.15.166:38054/0 (socket says 172.21.15.166:38054) 2022-05-11T19:42:54.236 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c6d9d700 1 -- 172.21.15.166:0/1357574360 learned_addr learned my addr 172.21.15.166:0/1357574360 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:54.236 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c6d9d700 1 -- 172.21.15.166:0/1357574360 >> v2:172.21.15.166:3300/0 conn(0x7f55c80b0c20 msgr2=0x7f55c815b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:54.236 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c6d9d700 1 --2- 172.21.15.166:0/1357574360 >> v2:172.21.15.166:3300/0 conn(0x7f55c80b0c20 0x7f55c815b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.236 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c6d9d700 1 -- 172.21.15.166:0/1357574360 >> v1:172.21.15.134:6789/0 conn(0x7f55c80b0850 legacy=0x7f55c80cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.236 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c6d9d700 1 -- 172.21.15.166:0/1357574360 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c815bfd0 con 0x7f55c80cb3e0 2022-05-11T19:42:54.237 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c5d9b700 1 --2- 172.21.15.166:0/1357574360 >> v2:172.21.15.166:3300/0 conn(0x7f55c80b0c20 0x7f55c815b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-11T19:42:54.237 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c6d9d700 1 --2- 172.21.15.166:0/1357574360 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80cb3e0 0x7f55c81585a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009f20 tx=0x7f55c0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e073dae62a986fd server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.237 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c559a700 1 -- 172.21.15.166:0/1357574360 <== mon.2 v2:172.21.15.166:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000e070 con 0x7f55c80cb3e0 2022-05-11T19:42:54.237 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c559a700 1 -- 172.21.15.166:0/1357574360 <== mon.2 v2:172.21.15.166:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c000b9d0 con 0x7f55c80cb3e0 2022-05-11T19:42:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.230+0000 7f55c559a700 1 -- 172.21.15.166:0/1357574360 <== mon.2 v2:172.21.15.166:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c00092e0 con 0x7f55c80cb3e0 2022-05-11T19:42:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.231+0000 7f55ccbcd700 1 -- 172.21.15.166:0/1357574360 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80cb3e0 msgr2=0x7f55c81585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.231+0000 7f55ccbcd700 1 --2- 172.21.15.166:0/1357574360 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80cb3e0 0x7f55c81585a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009f20 tx=0x7f55c0009840 comp rx=0 tx=0).stop 2022-05-11T19:42:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.231+0000 7f55ccbcd700 1 -- 172.21.15.166:0/1357574360 shutdown_connections 2022-05-11T19:42:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.231+0000 7f55ccbcd700 1 --2- 172.21.15.166:0/1357574360 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80cb3e0 0x7f55c81585a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.239 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.231+0000 7f55ccbcd700 1 --2- 172.21.15.166:0/1357574360 >> v2:172.21.15.166:3300/0 conn(0x7f55c80b0c20 0x7f55c815b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.239 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.231+0000 7f55ccbcd700 1 -- 172.21.15.166:0/1357574360 >> 172.21.15.166:0/1357574360 conn(0x7f55c8063620 msgr2=0x7f55c8063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:54.239 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.231+0000 7f55ccbcd700 1 -- 172.21.15.166:0/1357574360 shutdown_connections 2022-05-11T19:42:54.239 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.231+0000 7f55ccbcd700 1 -- 172.21.15.166:0/1357574360 wait complete. 2022-05-11T19:42:54.239 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.232+0000 7f55ccbcd700 1 Processor -- start 2022-05-11T19:42:54.240 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.232+0000 7f55ccbcd700 1 -- start start 2022-05-11T19:42:54.242 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55ccbcd700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f55c80b0850 0x7f55c8169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.243 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55ccbcd700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80b0c20 0x7f55c816a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.243 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55ccbcd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c80cb3e0 0x7f55c80adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.244 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55ccbcd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8151da0 con 0x7f55c80cb3e0 2022-05-11T19:42:54.244 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55ccbcd700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80cd270 con 0x7f55c80b0850 2022-05-11T19:42:54.244 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55ccbcd700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80cccb0 con 0x7f55c80b0c20 2022-05-11T19:42:54.244 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c5d9b700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80b0c20 0x7f55c816a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.245 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c659c700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f55c80b0850 0x7f55c8169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.245 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c5d9b700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80b0c20 0x7f55c816a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3301/0 says I am v2:172.21.15.166:38058/0 (socket says 172.21.15.166:38058) 2022-05-11T19:42:54.245 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c5d9b700 1 -- 172.21.15.166:0/3011370738 learned_addr learned my addr 172.21.15.166:0/3011370738 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:54.245 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c6d9d700 1 --2- 172.21.15.166:0/3011370738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c80cb3e0 0x7f55c80adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.246 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c659c700 1 -- 172.21.15.166:0/3011370738 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80b0c20 msgr2=0x7f55c816a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.246 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c659c700 1 --2- 172.21.15.166:0/3011370738 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80b0c20 0x7f55c816a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.246 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c659c700 1 -- 172.21.15.166:0/3011370738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c80cb3e0 msgr2=0x7f55c80adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.246 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c659c700 1 --2- 172.21.15.166:0/3011370738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c80cb3e0 0x7f55c80adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.246 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c659c700 1 -- 172.21.15.166:0/3011370738 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80092a0 con 0x7f55c80b0850 2022-05-11T19:42:54.247 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c5d9b700 1 --2- 172.21.15.166:0/3011370738 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80b0c20 0x7f55c816a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-11T19:42:54.247 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55c659c700 1 --2- 172.21.15.166:0/3011370738 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f55c80b0850 0x7f55c8169b20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c440 tx=0x7f55b0007d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.247 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55be7fc700 1 -- 172.21.15.166:0/3011370738 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b00050d0 con 0x7f55c80b0850 2022-05-11T19:42:54.247 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55be7fc700 1 -- 172.21.15.166:0/3011370738 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b0005230 con 0x7f55c80b0850 2022-05-11T19:42:54.247 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.233+0000 7f55ccbcd700 1 -- 172.21.15.166:0/3011370738 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c0009ae0 con 0x7f55c80b0850 2022-05-11T19:42:54.248 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.234+0000 7f55be7fc700 1 -- 172.21.15.166:0/3011370738 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0003710 con 0x7f55c80b0850 2022-05-11T19:42:54.248 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.234+0000 7f55ccbcd700 1 -- 172.21.15.166:0/3011370738 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c8151a30 con 0x7f55c80b0850 2022-05-11T19:42:54.248 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.234+0000 7f55be7fc700 1 -- 172.21.15.166:0/3011370738 <== mon.1 v2:172.21.15.166:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f55b0019030 con 0x7f55c80b0850 2022-05-11T19:42:54.248 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.234+0000 7f55be7fc700 1 -- 172.21.15.166:0/3011370738 <== mon.1 v2:172.21.15.166:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f55b00128c0 con 0x7f55c80b0850 2022-05-11T19:42:54.248 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.234+0000 7f55ccbcd700 1 -- 172.21.15.166:0/3011370738 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c8151890 con 0x7f55c80b0850 2022-05-11T19:42:54.249 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.236+0000 7f55be7fc700 1 -- 172.21.15.166:0/3011370738 <== mon.1 v2:172.21.15.166:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7f55c8151890 con 0x7f55c80b0850 2022-05-11T19:42:54.319 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.317+0000 7f55ccbcd700 1 -- 172.21.15.166:0/3011370738 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa809b81-371a-4ab7-a648-0f1a5641d33a", "id": 3} v 0) v1 -- 0x7f55c804c7e0 con 0x7f55c80b0850 2022-05-11T19:42:54.323 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.321+0000 7f55be7fc700 1 -- 172.21.15.166:0/3011370738 <== mon.1 v2:172.21.15.166:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa809b81-371a-4ab7-a648-0f1a5641d33a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f55b0017070 con 0x7f55c80b0850 2022-05-11T19:42:54.323 INFO:teuthology.orchestra.run.smithi166.stdout:3 2022-05-11T19:42:54.324 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.322+0000 7f55ccbcd700 1 -- 172.21.15.166:0/3011370738 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f55c80b0850 msgr2=0x7f55c8169b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.325 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.322+0000 7f55ccbcd700 1 --2- 172.21.15.166:0/3011370738 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f55c80b0850 0x7f55c8169b20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c440 tx=0x7f55b0007d40 comp rx=0 tx=0).stop 2022-05-11T19:42:54.325 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.322+0000 7f55ccbcd700 1 -- 172.21.15.166:0/3011370738 shutdown_connections 2022-05-11T19:42:54.325 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.322+0000 7f55ccbcd700 1 --2- 172.21.15.166:0/3011370738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55c80cb3e0 0x7f55c80adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.325 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.322+0000 7f55ccbcd700 1 --2- 172.21.15.166:0/3011370738 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f55c80b0850 0x7f55c8169b20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.325 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.322+0000 7f55ccbcd700 1 --2- 172.21.15.166:0/3011370738 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f55c80b0c20 0x7f55c816a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.326 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.322+0000 7f55ccbcd700 1 -- 172.21.15.166:0/3011370738 >> 172.21.15.166:0/3011370738 conn(0x7f55c8063620 msgr2=0x7f55c8158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:54.326 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.322+0000 7f55ccbcd700 1 -- 172.21.15.166:0/3011370738 shutdown_connections 2022-05-11T19:42:54.326 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.322+0000 7f55ccbcd700 1 -- 172.21.15.166:0/3011370738 wait complete. 2022-05-11T19:42:54.336 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd new b95f28ff-6fab-44f1-a8d8-ba925d4c0ff6 4 2022-05-11T19:42:54.451 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.449+0000 7f3e423e9700 1 Processor -- start 2022-05-11T19:42:54.452 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.449+0000 7f3e423e9700 1 -- start start 2022-05-11T19:42:54.457 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.450+0000 7f3e423e9700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3e3c0c9960 0x7f3e3c067a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.458 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.450+0000 7f3e423e9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c06ec00 con 0x7f3e3c15cb50 2022-05-11T19:42:54.458 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.450+0000 7f3e423e9700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c06fa60 con 0x7f3e3c0c7ae0 2022-05-11T19:42:54.458 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.450+0000 7f3e423e9700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c06ee50 con 0x7f3e3c0c9960 2022-05-11T19:42:54.458 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.450+0000 7f3e40986700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7f3e3c0c7ae0 0x7f3e3c06ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.166:52356/0 (socket says 172.21.15.166:52356) 2022-05-11T19:42:54.459 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.450+0000 7f3e40986700 1 -- 172.21.15.166:0/2032680890 learned_addr learned my addr 172.21.15.166:0/2032680890 (peer_addr_for_me v1:172.21.15.166:0/0) 2022-05-11T19:42:54.459 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.450+0000 7f3e3b7fe700 1 --2- 172.21.15.166:0/2032680890 >> v2:172.21.15.134:3300/0 conn(0x7f3e3c0c9960 0x7f3e3c067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.459 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.450+0000 7f3e3affd700 1 -- 172.21.15.166:0/2032680890 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002380971 0 0) 0x7f3e3c06fa60 con 0x7f3e3c0c7ae0 2022-05-11T19:42:54.459 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.450+0000 7f3e3affd700 1 -- 172.21.15.166:0/2032680890 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e280033f0 con 0x7f3e3c0c7ae0 2022-05-11T19:42:54.459 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e3b7fe700 1 -- 172.21.15.166:0/2032680890 >> v1:172.21.15.166:6789/0 conn(0x7f3e3c0c7ae0 legacy=0x7f3e3c06ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.460 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e3b7fe700 1 -- 172.21.15.166:0/2032680890 >> v1:172.21.15.134:6789/0 conn(0x7f3e3c15cb50 legacy=0x7f3e3c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.460 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e3b7fe700 1 -- 172.21.15.166:0/2032680890 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c06f130 con 0x7f3e3c0c9960 2022-05-11T19:42:54.460 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e3b7fe700 1 --2- 172.21.15.166:0/2032680890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e3c0c9960 0x7f3e3c067a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009760 tx=0x7f3e30009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd4bb2867480a3 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.460 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e3affd700 1 -- 172.21.15.166:0/2032680890 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30011630 con 0x7f3e3c0c9960 2022-05-11T19:42:54.460 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e3affd700 1 -- 172.21.15.166:0/2032680890 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e30011790 con 0x7f3e3c0c9960 2022-05-11T19:42:54.461 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e3affd700 1 -- 172.21.15.166:0/2032680890 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30011b30 con 0x7f3e3c0c9960 2022-05-11T19:42:54.461 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e423e9700 1 -- 172.21.15.166:0/2032680890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e3c0c9960 msgr2=0x7f3e3c067a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.461 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e423e9700 1 --2- 172.21.15.166:0/2032680890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e3c0c9960 0x7f3e3c067a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009760 tx=0x7f3e30009060 comp rx=0 tx=0).stop 2022-05-11T19:42:54.461 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e423e9700 1 -- 172.21.15.166:0/2032680890 shutdown_connections 2022-05-11T19:42:54.462 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e423e9700 1 --2- 172.21.15.166:0/2032680890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e3c0c9960 0x7f3e3c067a70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.462 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.451+0000 7f3e423e9700 1 -- 172.21.15.166:0/2032680890 >> 172.21.15.166:0/2032680890 conn(0x7f3e3c069610 msgr2=0x7f3e3c0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:54.462 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.452+0000 7f3e423e9700 1 -- 172.21.15.166:0/2032680890 shutdown_connections 2022-05-11T19:42:54.462 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.452+0000 7f3e423e9700 1 -- 172.21.15.166:0/2032680890 wait complete. 2022-05-11T19:42:54.462 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.453+0000 7f3e423e9700 1 Processor -- start 2022-05-11T19:42:54.463 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.453+0000 7f3e423e9700 1 -- start start 2022-05-11T19:42:54.463 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.453+0000 7f3e423e9700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f3e3c0c7ae0 0x7f3e3c0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.463 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e423e9700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3e3c0c9960 0x7f3e3c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.463 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e423e9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e3c15cb50 0x7f3e3c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.464 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e423e9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b27d0 con 0x7f3e3c15cb50 2022-05-11T19:42:54.464 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e423e9700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b12d0 con 0x7f3e3c0c9960 2022-05-11T19:42:54.464 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e423e9700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b1550 con 0x7f3e3c0c7ae0 2022-05-11T19:42:54.464 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3b7fe700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3e3c0c9960 0x7f3e3c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.465 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3b7fe700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3e3c0c9960 0x7f3e3c0b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.166:42982/0 (socket says 172.21.15.166:42982) 2022-05-11T19:42:54.465 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3b7fe700 1 -- 172.21.15.166:0/493196221 learned_addr learned my addr 172.21.15.166:0/493196221 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:54.465 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3bfff700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f3e3c0c7ae0 0x7f3e3c0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.465 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e40986700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e3c15cb50 0x7f3e3c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.465 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3b7fe700 1 -- 172.21.15.166:0/493196221 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f3e3c0c7ae0 msgr2=0x7f3e3c0c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.466 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3b7fe700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f3e3c0c7ae0 0x7f3e3c0c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.466 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3b7fe700 1 -- 172.21.15.166:0/493196221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e3c15cb50 msgr2=0x7f3e3c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.466 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3b7fe700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e3c15cb50 0x7f3e3c0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.466 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3b7fe700 1 -- 172.21.15.166:0/493196221 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300092a0 con 0x7f3e3c0c9960 2022-05-11T19:42:54.467 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3bfff700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f3e3c0c7ae0 0x7f3e3c0c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-11T19:42:54.467 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e3b7fe700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3e3c0c9960 0x7f3e3c0b2c60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e30013000 tx=0x7f3e30017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.467 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e23fff700 1 -- 172.21.15.166:0/493196221 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30000bc0 con 0x7f3e3c0c9960 2022-05-11T19:42:54.467 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e23fff700 1 -- 172.21.15.166:0/493196221 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e30011900 con 0x7f3e3c0c9960 2022-05-11T19:42:54.468 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e23fff700 1 -- 172.21.15.166:0/493196221 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30000d20 con 0x7f3e3c0c9960 2022-05-11T19:42:54.468 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e423e9700 1 -- 172.21.15.166:0/493196221 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c0b1ee0 con 0x7f3e3c0c9960 2022-05-11T19:42:54.468 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.454+0000 7f3e423e9700 1 -- 172.21.15.166:0/493196221 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c0b2460 con 0x7f3e3c0c9960 2022-05-11T19:42:54.468 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.455+0000 7f3e23fff700 1 -- 172.21.15.166:0/493196221 <== mon.1 v2:172.21.15.166:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f3e3002c030 con 0x7f3e3c0c9960 2022-05-11T19:42:54.468 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.455+0000 7f3e23fff700 1 -- 172.21.15.166:0/493196221 <== mon.1 v2:172.21.15.166:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f3e3002e8c0 con 0x7f3e3c0c9960 2022-05-11T19:42:54.469 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.455+0000 7f3e423e9700 1 -- 172.21.15.166:0/493196221 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c04c7e0 con 0x7f3e3c0c9960 2022-05-11T19:42:54.469 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.458+0000 7f3e23fff700 1 -- 172.21.15.166:0/493196221 <== mon.1 v2:172.21.15.166:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7f3e3002a070 con 0x7f3e3c0c9960 2022-05-11T19:42:54.541 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.539+0000 7f3e423e9700 1 -- 172.21.15.166:0/493196221 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b95f28ff-6fab-44f1-a8d8-ba925d4c0ff6", "id": 4} v 0) v1 -- 0x7f3e3c06f410 con 0x7f3e3c0c9960 2022-05-11T19:42:54.544 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.542+0000 7f3e23fff700 1 -- 172.21.15.166:0/493196221 <== mon.1 v2:172.21.15.166:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b95f28ff-6fab-44f1-a8d8-ba925d4c0ff6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3e30015020 con 0x7f3e3c0c9960 2022-05-11T19:42:54.545 INFO:teuthology.orchestra.run.smithi166.stdout:4 2022-05-11T19:42:54.547 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.543+0000 7f3e423e9700 1 -- 172.21.15.166:0/493196221 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3e3c0c9960 msgr2=0x7f3e3c0b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.547 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.543+0000 7f3e423e9700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3e3c0c9960 0x7f3e3c0b2c60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e30013000 tx=0x7f3e30017000 comp rx=0 tx=0).stop 2022-05-11T19:42:54.547 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.543+0000 7f3e423e9700 1 -- 172.21.15.166:0/493196221 shutdown_connections 2022-05-11T19:42:54.548 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.543+0000 7f3e423e9700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e3c15cb50 0x7f3e3c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.548 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.543+0000 7f3e423e9700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f3e3c0c7ae0 0x7f3e3c0c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.548 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.543+0000 7f3e423e9700 1 --2- 172.21.15.166:0/493196221 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f3e3c0c9960 0x7f3e3c0b2c60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.549 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.543+0000 7f3e423e9700 1 -- 172.21.15.166:0/493196221 >> 172.21.15.166:0/493196221 conn(0x7f3e3c069610 msgr2=0x7f3e3c0c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:54.549 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.544+0000 7f3e423e9700 1 -- 172.21.15.166:0/493196221 shutdown_connections 2022-05-11T19:42:54.549 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.544+0000 7f3e423e9700 1 -- 172.21.15.166:0/493196221 wait complete. 2022-05-11T19:42:54.558 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd new dc4d2a03-2b7d-4e90-a1ea-cafef55b6fa9 5 2022-05-11T19:42:54.674 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.672+0000 7f7335327700 1 Processor -- start 2022-05-11T19:42:54.674 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.672+0000 7f7335327700 1 -- start start 2022-05-11T19:42:54.678 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.672+0000 7f7335327700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7330159a00 0x7f73300c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.678 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.672+0000 7f7335327700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7330064200 0x7f73300c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.678 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.672+0000 7f7335327700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f73300d1190 0x7f73300c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.678 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.672+0000 7f7335327700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733008a020 con 0x7f7330064200 2022-05-11T19:42:54.679 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.672+0000 7f7335327700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73300c7180 con 0x7f73300d1190 2022-05-11T19:42:54.679 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.672+0000 7f7335327700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73300c7b50 con 0x7f7330159a00 2022-05-11T19:42:54.679 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732effd700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7330159a00 0x7f73300c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.679 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732f7fe700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f73300d1190 0x7f73300c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.680 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732effd700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7330159a00 0x7f73300c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3301/0 says I am v2:172.21.15.166:38074/0 (socket says 172.21.15.166:38074) 2022-05-11T19:42:54.680 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732effd700 1 -- 172.21.15.166:0/2881122188 learned_addr learned my addr 172.21.15.166:0/2881122188 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:54.680 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732e7fc700 1 --2- 172.21.15.166:0/2881122188 >> v2:172.21.15.134:3300/0 conn(0x7f7330064200 0x7f73300c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.680 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732effd700 1 -- 172.21.15.166:0/2881122188 >> v2:172.21.15.166:3300/0 conn(0x7f73300d1190 msgr2=0x7f73300c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:54.680 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732effd700 1 --2- 172.21.15.166:0/2881122188 >> v2:172.21.15.166:3300/0 conn(0x7f73300d1190 0x7f73300c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.681 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732effd700 1 -- 172.21.15.166:0/2881122188 >> v2:172.21.15.134:3300/0 conn(0x7f7330064200 msgr2=0x7f73300c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:54.681 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732effd700 1 --2- 172.21.15.166:0/2881122188 >> v2:172.21.15.134:3300/0 conn(0x7f7330064200 0x7f73300c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.681 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732effd700 1 -- 172.21.15.166:0/2881122188 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73300c6bc0 con 0x7f7330159a00 2022-05-11T19:42:54.681 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732f7fe700 1 --2- 172.21.15.166:0/2881122188 >> v2:172.21.15.166:3300/0 conn(0x7f73300d1190 0x7f73300c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-11T19:42:54.681 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732e7fc700 1 --2- 172.21.15.166:0/2881122188 >> v2:172.21.15.134:3300/0 conn(0x7f7330064200 0x7f73300c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-11T19:42:54.682 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732effd700 1 --2- 172.21.15.166:0/2881122188 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7330159a00 0x7f73300c7610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f733009e590 tx=0x7f7328009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b24e699faab9eab1 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.682 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732dffb700 1 -- 172.21.15.166:0/2881122188 <== mon.2 v2:172.21.15.166:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328005a90 con 0x7f7330159a00 2022-05-11T19:42:54.682 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732dffb700 1 -- 172.21.15.166:0/2881122188 <== mon.2 v2:172.21.15.166:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7328005bf0 con 0x7f7330159a00 2022-05-11T19:42:54.682 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.673+0000 7f732dffb700 1 -- 172.21.15.166:0/2881122188 <== mon.2 v2:172.21.15.166:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328006030 con 0x7f7330159a00 2022-05-11T19:42:54.683 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.674+0000 7f7335327700 1 -- 172.21.15.166:0/2881122188 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7330159a00 msgr2=0x7f73300c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.683 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.674+0000 7f7335327700 1 --2- 172.21.15.166:0/2881122188 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7330159a00 0x7f73300c7610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f733009e590 tx=0x7f7328009060 comp rx=0 tx=0).stop 2022-05-11T19:42:54.683 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.674+0000 7f7335327700 1 -- 172.21.15.166:0/2881122188 shutdown_connections 2022-05-11T19:42:54.683 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.674+0000 7f7335327700 1 --2- 172.21.15.166:0/2881122188 >> v2:172.21.15.166:3300/0 conn(0x7f73300d1190 0x7f73300c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.684 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.674+0000 7f7335327700 1 --2- 172.21.15.166:0/2881122188 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f7330159a00 0x7f73300c7610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.684 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.674+0000 7f7335327700 1 --2- 172.21.15.166:0/2881122188 >> v2:172.21.15.134:3300/0 conn(0x7f7330064200 0x7f73300c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.684 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.674+0000 7f7335327700 1 -- 172.21.15.166:0/2881122188 >> 172.21.15.166:0/2881122188 conn(0x7f7330063e00 msgr2=0x7f73300d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:54.684 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.674+0000 7f7335327700 1 -- 172.21.15.166:0/2881122188 shutdown_connections 2022-05-11T19:42:54.684 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.674+0000 7f7335327700 1 -- 172.21.15.166:0/2881122188 wait complete. 2022-05-11T19:42:54.685 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.675+0000 7f7335327700 1 Processor -- start 2022-05-11T19:42:54.685 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.675+0000 7f7335327700 1 -- start start 2022-05-11T19:42:54.687 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f7335327700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7330064200 0x7f733016a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.688 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f7335327700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f73300d1190 0x7f733015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.688 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f7335327700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7330159a00 0x7f733016cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.688 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f7335327700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73300b44d0 con 0x7f7330159a00 2022-05-11T19:42:54.688 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f7335327700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73300b3950 con 0x7f7330064200 2022-05-11T19:42:54.688 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f7335327700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73300b3c30 con 0x7f73300d1190 2022-05-11T19:42:54.689 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732effd700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7330064200 0x7f733016a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.689 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732effd700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7330064200 0x7f733016a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.166:42992/0 (socket says 172.21.15.166:42992) 2022-05-11T19:42:54.689 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732e7fc700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f73300d1190 0x7f733015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.689 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732effd700 1 -- 172.21.15.166:0/3989513177 learned_addr learned my addr 172.21.15.166:0/3989513177 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:54.689 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732f7fe700 1 --2- 172.21.15.166:0/3989513177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7330159a00 0x7f733016cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.690 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732effd700 1 -- 172.21.15.166:0/3989513177 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f73300d1190 msgr2=0x7f733015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.690 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732effd700 1 --2- 172.21.15.166:0/3989513177 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f73300d1190 0x7f733015dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.690 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732effd700 1 -- 172.21.15.166:0/3989513177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7330159a00 msgr2=0x7f733016cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.690 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732effd700 1 --2- 172.21.15.166:0/3989513177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7330159a00 0x7f733016cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.691 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.676+0000 7f732effd700 1 -- 172.21.15.166:0/3989513177 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320009a20 con 0x7f7330064200 2022-05-11T19:42:54.691 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.677+0000 7f732effd700 1 --2- 172.21.15.166:0/3989513177 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7330064200 0x7f733016a3c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7328006910 tx=0x7f7328016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.691 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.677+0000 7f7326ffd700 1 -- 172.21.15.166:0/3989513177 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732801b690 con 0x7f7330064200 2022-05-11T19:42:54.691 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.677+0000 7f7326ffd700 1 -- 172.21.15.166:0/3989513177 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732801b7f0 con 0x7f7330064200 2022-05-11T19:42:54.691 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.677+0000 7f7335327700 1 -- 172.21.15.166:0/3989513177 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7328009300 con 0x7f7330064200 2022-05-11T19:42:54.692 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.677+0000 7f7326ffd700 1 -- 172.21.15.166:0/3989513177 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732801bbb0 con 0x7f7330064200 2022-05-11T19:42:54.692 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.677+0000 7f7335327700 1 -- 172.21.15.166:0/3989513177 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73300b41f0 con 0x7f7330064200 2022-05-11T19:42:54.692 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.677+0000 7f7326ffd700 1 -- 172.21.15.166:0/3989513177 <== mon.1 v2:172.21.15.166:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f732802c020 con 0x7f7330064200 2022-05-11T19:42:54.692 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.677+0000 7f7326ffd700 1 -- 172.21.15.166:0/3989513177 <== mon.1 v2:172.21.15.166:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f73280269c0 con 0x7f7330064200 2022-05-11T19:42:54.693 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.678+0000 7f7335327700 1 -- 172.21.15.166:0/3989513177 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733004c7e0 con 0x7f7330064200 2022-05-11T19:42:54.693 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.680+0000 7f7326ffd700 1 -- 172.21.15.166:0/3989513177 <== mon.1 v2:172.21.15.166:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7f7328026ca0 con 0x7f7330064200 2022-05-11T19:42:54.693 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:54.685+0000 7fbf733c1000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-05-11T19:42:54.770 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:54.768+0000 7fbd19ff5000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-05-11T19:42:54.771 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.769+0000 7f7335327700 1 -- 172.21.15.166:0/3989513177 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc4d2a03-2b7d-4e90-a1ea-cafef55b6fa9", "id": 5} v 0) v1 -- 0x7f73300c6ea0 con 0x7f7330064200 2022-05-11T19:42:54.775 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.773+0000 7f7326ffd700 1 -- 172.21.15.166:0/3989513177 <== mon.1 v2:172.21.15.166:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc4d2a03-2b7d-4e90-a1ea-cafef55b6fa9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f732802f850 con 0x7f7330064200 2022-05-11T19:42:54.776 INFO:teuthology.orchestra.run.smithi166.stdout:5 2022-05-11T19:42:54.777 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.774+0000 7f7335327700 1 -- 172.21.15.166:0/3989513177 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7330064200 msgr2=0x7f733016a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.777 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.774+0000 7f7335327700 1 --2- 172.21.15.166:0/3989513177 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7330064200 0x7f733016a3c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7328006910 tx=0x7f7328016000 comp rx=0 tx=0).stop 2022-05-11T19:42:54.777 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.774+0000 7f7335327700 1 -- 172.21.15.166:0/3989513177 shutdown_connections 2022-05-11T19:42:54.778 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.774+0000 7f7335327700 1 --2- 172.21.15.166:0/3989513177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7330159a00 0x7f733016cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.778 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.774+0000 7f7335327700 1 --2- 172.21.15.166:0/3989513177 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f7330064200 0x7f733016a3c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.778 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.774+0000 7f7335327700 1 --2- 172.21.15.166:0/3989513177 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f73300d1190 0x7f733015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.778 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.774+0000 7f7335327700 1 -- 172.21.15.166:0/3989513177 >> 172.21.15.166:0/3989513177 conn(0x7f7330063e00 msgr2=0x7f73300c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:54.778 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.774+0000 7f7335327700 1 -- 172.21.15.166:0/3989513177 shutdown_connections 2022-05-11T19:42:54.779 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.774+0000 7f7335327700 1 -- 172.21.15.166:0/3989513177 wait complete. 2022-05-11T19:42:54.788 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd new 020f0004-538e-44cd-88be-e899baf94d29 6 2022-05-11T19:42:54.898 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:54.896+0000 7fbf733c1000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-05-11T19:42:54.904 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.902+0000 7f5bf85c0700 1 Processor -- start 2022-05-11T19:42:54.905 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.902+0000 7f5bf85c0700 1 -- start start 2022-05-11T19:42:54.907 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.903+0000 7f5bf85c0700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f5bf0155a10 0x7f5bf00688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.907 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.903+0000 7f5bf85c0700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf0068440 con 0x7f5bf006a610 2022-05-11T19:42:54.908 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.903+0000 7f5bf85c0700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf0069270 con 0x7f5bf0155de0 2022-05-11T19:42:54.908 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.903+0000 7f5bf85c0700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf00c8740 con 0x7f5bf0155a10 2022-05-11T19:42:54.908 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.903+0000 7f5bf635c700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f5bf0155a10 0x7f5bf00688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.908 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf635c700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f5bf0155a10 0x7f5bf00688d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.166:42998/0 (socket says 172.21.15.166:42998) 2022-05-11T19:42:54.910 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf5b5b700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7f5bf0155de0 0x7f5bf00c7c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.166:52378/0 (socket says 172.21.15.166:52378) 2022-05-11T19:42:54.910 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf635c700 1 -- 172.21.15.166:0/677738399 learned_addr learned my addr 172.21.15.166:0/677738399 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:54.911 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf635c700 1 -- 172.21.15.166:0/677738399 >> v1:172.21.15.166:6789/0 conn(0x7f5bf0155de0 legacy=0x7f5bf00c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.911 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf635c700 1 -- 172.21.15.166:0/677738399 >> v1:172.21.15.134:6789/0 conn(0x7f5bf006a610 legacy=0x7f5bf00c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.911 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf635c700 1 -- 172.21.15.166:0/677738399 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0067b10 con 0x7f5bf0155a10 2022-05-11T19:42:54.911 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf635c700 1 --2- 172.21.15.166:0/677738399 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5bf0155a10 0x7f5bf00688d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5bec006fd0 tx=0x7f5bec0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b82cb4091d0f6fb5 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.911 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf535a700 1 -- 172.21.15.166:0/677738399 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec004030 con 0x7f5bf0155a10 2022-05-11T19:42:54.912 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf535a700 1 -- 172.21.15.166:0/677738399 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec0041b0 con 0x7f5bf0155a10 2022-05-11T19:42:54.912 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.904+0000 7f5bf535a700 1 -- 172.21.15.166:0/677738399 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec011650 con 0x7f5bf0155a10 2022-05-11T19:42:54.912 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.905+0000 7f5bf85c0700 1 -- 172.21.15.166:0/677738399 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5bf0155a10 msgr2=0x7f5bf00688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.912 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.905+0000 7f5bf85c0700 1 --2- 172.21.15.166:0/677738399 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5bf0155a10 0x7f5bf00688d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5bec006fd0 tx=0x7f5bec0090f0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.913 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.905+0000 7f5bf85c0700 1 -- 172.21.15.166:0/677738399 shutdown_connections 2022-05-11T19:42:54.913 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.905+0000 7f5bf85c0700 1 --2- 172.21.15.166:0/677738399 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5bf0155a10 0x7f5bf00688d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.913 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.905+0000 7f5bf85c0700 1 -- 172.21.15.166:0/677738399 >> 172.21.15.166:0/677738399 conn(0x7f5bf00cd500 msgr2=0x7f5bf00c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:54.913 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.905+0000 7f5bf85c0700 1 -- 172.21.15.166:0/677738399 shutdown_connections 2022-05-11T19:42:54.914 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.905+0000 7f5bf85c0700 1 -- 172.21.15.166:0/677738399 wait complete. 2022-05-11T19:42:54.917 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.906+0000 7f5bf85c0700 1 Processor -- start 2022-05-11T19:42:54.917 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.906+0000 7f5bf85c0700 1 -- start start 2022-05-11T19:42:54.918 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf85c0700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f5bf006a610 0x7f5bf0144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.918 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf85c0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bf0155a10 0x7f5bf016d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.918 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf85c0700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5bf0155de0 0x7f5bf013d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:54.918 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf85c0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0143a90 con 0x7f5bf0155a10 2022-05-11T19:42:54.919 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf85c0700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0142e80 con 0x7f5bf0155de0 2022-05-11T19:42:54.919 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf85c0700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0143160 con 0x7f5bf006a610 2022-05-11T19:42:54.919 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf635c700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f5bf006a610 0x7f5bf0144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.919 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf6b5d700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5bf0155de0 0x7f5bf013d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.919 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf635c700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f5bf006a610 0x7f5bf0144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3301/0 says I am v2:172.21.15.166:38092/0 (socket says 172.21.15.166:38092) 2022-05-11T19:42:54.920 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf635c700 1 -- 172.21.15.166:0/3831728799 learned_addr learned my addr 172.21.15.166:0/3831728799 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:54.920 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf5b5b700 1 --2- 172.21.15.166:0/3831728799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bf0155a10 0x7f5bf016d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:54.920 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf635c700 1 -- 172.21.15.166:0/3831728799 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5bf0155de0 msgr2=0x7f5bf013d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.920 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf635c700 1 --2- 172.21.15.166:0/3831728799 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5bf0155de0 0x7f5bf013d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.921 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf635c700 1 -- 172.21.15.166:0/3831728799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bf0155a10 msgr2=0x7f5bf016d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:54.921 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf635c700 1 --2- 172.21.15.166:0/3831728799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bf0155a10 0x7f5bf016d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:54.921 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.907+0000 7f5bf635c700 1 -- 172.21.15.166:0/3831728799 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009370 con 0x7f5bf006a610 2022-05-11T19:42:54.921 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.908+0000 7f5bf635c700 1 --2- 172.21.15.166:0/3831728799 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f5bf006a610 0x7f5bf0144a50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0069bb0 tx=0x7f5bec016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:54.921 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.908+0000 7f5bde7fc700 1 -- 172.21.15.166:0/3831728799 <== mon.2 v2:172.21.15.166:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0036f0 con 0x7f5bf006a610 2022-05-11T19:42:54.922 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.908+0000 7f5bde7fc700 1 -- 172.21.15.166:0/3831728799 <== mon.2 v2:172.21.15.166:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec003890 con 0x7f5bf006a610 2022-05-11T19:42:54.922 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.908+0000 7f5bf85c0700 1 -- 172.21.15.166:0/3831728799 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf0143440 con 0x7f5bf006a610 2022-05-11T19:42:54.922 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.908+0000 7f5bde7fc700 1 -- 172.21.15.166:0/3831728799 <== mon.2 v2:172.21.15.166:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec003c50 con 0x7f5bf006a610 2022-05-11T19:42:54.922 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.908+0000 7f5bf85c0700 1 -- 172.21.15.166:0/3831728799 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf016e0f0 con 0x7f5bf006a610 2022-05-11T19:42:54.923 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.908+0000 7f5bde7fc700 1 -- 172.21.15.166:0/3831728799 <== mon.2 v2:172.21.15.166:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f5bec02b030 con 0x7f5bf006a610 2022-05-11T19:42:54.923 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.908+0000 7f5bde7fc700 1 -- 172.21.15.166:0/3831728799 <== mon.2 v2:172.21.15.166:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f5bec02e440 con 0x7f5bf006a610 2022-05-11T19:42:54.923 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.909+0000 7f5bf85c0700 1 -- 172.21.15.166:0/3831728799 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf00c3c00 con 0x7f5bf006a610 2022-05-11T19:42:54.923 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.911+0000 7f5bde7fc700 1 -- 172.21.15.166:0/3831728799 <== mon.2 v2:172.21.15.166:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7f5bec033060 con 0x7f5bf006a610 2022-05-11T19:42:54.990 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:54.987+0000 7fbf733c1000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-05-11T19:42:54.995 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:54.993+0000 7fbd19ff5000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-05-11T19:42:54.995 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.993+0000 7f5bf85c0700 1 -- 172.21.15.166:0/3831728799 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_command({"prefix": "osd new", "uuid": "020f0004-538e-44cd-88be-e899baf94d29", "id": 6} v 0) v1 -- 0x7f5bf00ca080 con 0x7f5bf006a610 2022-05-11T19:42:55.000 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.998+0000 7f5bde7fc700 1 -- 172.21.15.166:0/3831728799 <== mon.2 v2:172.21.15.166:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "020f0004-538e-44cd-88be-e899baf94d29", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5bec029070 con 0x7f5bf006a610 2022-05-11T19:42:55.001 INFO:teuthology.orchestra.run.smithi166.stdout:6 2022-05-11T19:42:55.003 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.999+0000 7f5bf85c0700 1 -- 172.21.15.166:0/3831728799 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f5bf006a610 msgr2=0x7f5bf0144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.004 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.999+0000 7f5bf85c0700 1 --2- 172.21.15.166:0/3831728799 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f5bf006a610 0x7f5bf0144a50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0069bb0 tx=0x7f5bec016000 comp rx=0 tx=0).stop 2022-05-11T19:42:55.004 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.999+0000 7f5bf85c0700 1 -- 172.21.15.166:0/3831728799 shutdown_connections 2022-05-11T19:42:55.004 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.999+0000 7f5bf85c0700 1 --2- 172.21.15.166:0/3831728799 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f5bf0155de0 0x7f5bf013d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.005 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.999+0000 7f5bf85c0700 1 --2- 172.21.15.166:0/3831728799 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f5bf006a610 0x7f5bf0144a50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.005 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.999+0000 7f5bf85c0700 1 --2- 172.21.15.166:0/3831728799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bf0155a10 0x7f5bf016d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.005 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.999+0000 7f5bf85c0700 1 -- 172.21.15.166:0/3831728799 >> 172.21.15.166:0/3831728799 conn(0x7f5bf00cd500 msgr2=0x7f5bf00cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:55.006 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:54.999+0000 7f5bf85c0700 1 -- 172.21.15.166:0/3831728799 shutdown_connections 2022-05-11T19:42:55.006 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.000+0000 7f5bf85c0700 1 -- 172.21.15.166:0/3831728799 wait complete. 2022-05-11T19:42:55.013 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd new 6f9faa65-8da9-441c-b260-430f2b0621fb 7 2022-05-11T19:42:55.084 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:55.081+0000 7fbd19ff5000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-05-11T19:42:55.129 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.127+0000 7f8616481700 1 Processor -- start 2022-05-11T19:42:55.130 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.127+0000 7f8616481700 1 -- start start 2022-05-11T19:42:55.133 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f8616481700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f86100aef60 0x7f8610068960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:55.133 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f8616481700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86100c3630 0x7f86100c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:55.133 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f8616481700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86100c2d10 con 0x7f86100af330 2022-05-11T19:42:55.133 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f8616481700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8610068ea0 con 0x7f86100c3630 2022-05-11T19:42:55.134 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f8616481700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8610067ba0 con 0x7f86100aef60 2022-05-11T19:42:55.134 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f860ffff700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f86100aef60 0x7f8610068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:55.134 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f8614a1e700 1 --1- >> v1:172.21.15.166:6789/0 conn(0x7f86100af330 0x7f86100c73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.166:6789/0 says I am v1:172.21.15.166:52390/0 (socket says 172.21.15.166:52390) 2022-05-11T19:42:55.134 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f8614a1e700 1 -- 172.21.15.166:0/3345263086 learned_addr learned my addr 172.21.15.166:0/3345263086 (peer_addr_for_me v1:172.21.15.166:0/0) 2022-05-11T19:42:55.134 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f860f7fe700 1 --2- 172.21.15.166:0/3345263086 >> v2:172.21.15.134:3300/0 conn(0x7f86100c3630 0x7f86100c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:55.135 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f860effd700 1 -- 172.21.15.166:0/3345263086 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449466369 0 0) 0x7f86100c2d10 con 0x7f86100af330 2022-05-11T19:42:55.135 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f860effd700 1 -- 172.21.15.166:0/3345263086 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85fc0033f0 con 0x7f86100af330 2022-05-11T19:42:55.135 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f860ffff700 1 -- 172.21.15.166:0/3345263086 >> v2:172.21.15.134:3300/0 conn(0x7f86100c3630 msgr2=0x7f86100c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:55.135 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f860ffff700 1 --2- 172.21.15.166:0/3345263086 >> v2:172.21.15.134:3300/0 conn(0x7f86100c3630 0x7f86100c2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.136 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f860ffff700 1 -- 172.21.15.166:0/3345263086 >> v1:172.21.15.166:6789/0 conn(0x7f86100af330 legacy=0x7f86100c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.136 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.128+0000 7f860ffff700 1 -- 172.21.15.166:0/3345263086 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8610067e80 con 0x7f86100aef60 2022-05-11T19:42:55.136 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f860ffff700 1 --2- 172.21.15.166:0/3345263086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 0x7f8610068960 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8600009760 tx=0x7f8600009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a99b166b6360e3f server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:55.136 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f860effd700 1 -- 172.21.15.166:0/3345263086 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000105b0 con 0x7f86100aef60 2022-05-11T19:42:55.136 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f860effd700 1 -- 172.21.15.166:0/3345263086 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8600010710 con 0x7f86100aef60 2022-05-11T19:42:55.137 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f860effd700 1 -- 172.21.15.166:0/3345263086 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600010ad0 con 0x7f86100aef60 2022-05-11T19:42:55.137 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f8616481700 1 -- 172.21.15.166:0/3345263086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 msgr2=0x7f8610068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.137 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f8616481700 1 --2- 172.21.15.166:0/3345263086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 0x7f8610068960 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8600009760 tx=0x7f8600009060 comp rx=0 tx=0).stop 2022-05-11T19:42:55.137 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f8616481700 1 -- 172.21.15.166:0/3345263086 shutdown_connections 2022-05-11T19:42:55.138 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f8616481700 1 --2- 172.21.15.166:0/3345263086 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 0x7f8610068960 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.138 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f8616481700 1 --2- 172.21.15.166:0/3345263086 >> v2:172.21.15.134:3300/0 conn(0x7f86100c3630 0x7f86100c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.138 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f8616481700 1 -- 172.21.15.166:0/3345263086 >> 172.21.15.166:0/3345263086 conn(0x7f86100cd500 msgr2=0x7f86100c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:55.139 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f8616481700 1 -- 172.21.15.166:0/3345263086 shutdown_connections 2022-05-11T19:42:55.139 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.129+0000 7f8616481700 1 -- 172.21.15.166:0/3345263086 wait complete. 2022-05-11T19:42:55.139 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.130+0000 7f8616481700 1 Processor -- start 2022-05-11T19:42:55.139 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.131+0000 7f8616481700 1 -- start start 2022-05-11T19:42:55.142 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.131+0000 7f8616481700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 0x7f861015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:55.142 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.131+0000 7f8616481700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86100af330 0x7f86100ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:55.142 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.131+0000 7f8616481700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f86100c3630 0x7f86100c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:55.143 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.131+0000 7f8616481700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86100ae960 con 0x7f86100af330 2022-05-11T19:42:55.143 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.131+0000 7f8616481700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861015cd90 con 0x7f86100aef60 2022-05-11T19:42:55.143 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.131+0000 7f8616481700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86100c55d0 con 0x7f86100c3630 2022-05-11T19:42:55.143 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.131+0000 7f860ffff700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 0x7f861015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:55.143 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f860ffff700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 0x7f861015c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.166:43014/0 (socket says 172.21.15.166:43014) 2022-05-11T19:42:55.144 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f860ffff700 1 -- 172.21.15.166:0/4047337202 learned_addr learned my addr 172.21.15.166:0/4047337202 (peer_addr_for_me v2:172.21.15.166:0/0) 2022-05-11T19:42:55.144 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f8614a1e700 1 --2- 172.21.15.166:0/4047337202 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f86100c3630 0x7f86100c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:55.144 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f860f7fe700 1 --2- 172.21.15.166:0/4047337202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86100af330 0x7f86100ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:55.144 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f860ffff700 1 -- 172.21.15.166:0/4047337202 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f86100c3630 msgr2=0x7f86100c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.145 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f860ffff700 1 --2- 172.21.15.166:0/4047337202 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f86100c3630 0x7f86100c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.145 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f860ffff700 1 -- 172.21.15.166:0/4047337202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86100af330 msgr2=0x7f86100ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.145 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f860ffff700 1 --2- 172.21.15.166:0/4047337202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86100af330 0x7f86100ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.145 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f860ffff700 1 -- 172.21.15.166:0/4047337202 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000092a0 con 0x7f86100aef60 2022-05-11T19:42:55.145 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f860ffff700 1 --2- 172.21.15.166:0/4047337202 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 0x7f861015c5d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8600010f90 tx=0x7f8600016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:55.146 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f85f7fff700 1 -- 172.21.15.166:0/4047337202 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000105b0 con 0x7f86100aef60 2022-05-11T19:42:55.146 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f8616481700 1 -- 172.21.15.166:0/4047337202 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861015cb10 con 0x7f86100aef60 2022-05-11T19:42:55.146 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f85f7fff700 1 -- 172.21.15.166:0/4047337202 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8600009120 con 0x7f86100aef60 2022-05-11T19:42:55.146 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f85f7fff700 1 -- 172.21.15.166:0/4047337202 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600006990 con 0x7f86100aef60 2022-05-11T19:42:55.146 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f8616481700 1 -- 172.21.15.166:0/4047337202 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86100c4f80 con 0x7f86100aef60 2022-05-11T19:42:55.147 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f85f7fff700 1 -- 172.21.15.166:0/4047337202 <== mon.1 v2:172.21.15.166:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f860000f070 con 0x7f86100aef60 2022-05-11T19:42:55.147 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.132+0000 7f85f7fff700 1 -- 172.21.15.166:0/4047337202 <== mon.1 v2:172.21.15.166:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f8600025680 con 0x7f86100aef60 2022-05-11T19:42:55.147 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.133+0000 7f8616481700 1 -- 172.21.15.166:0/4047337202 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86100c58b0 con 0x7f86100aef60 2022-05-11T19:42:55.147 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.135+0000 7f85f7fff700 1 -- 172.21.15.166:0/4047337202 <== mon.1 v2:172.21.15.166:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7f860002a020 con 0x7f86100aef60 2022-05-11T19:42:55.148 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:55.144+0000 7fbf733c1000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-05-11T19:42:55.219 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.217+0000 7f8616481700 1 -- 172.21.15.166:0/4047337202 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6f9faa65-8da9-441c-b260-430f2b0621fb", "id": 7} v 0) v1 -- 0x7f8610068160 con 0x7f86100aef60 2022-05-11T19:42:55.227 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.224+0000 7f85f7fff700 1 -- 172.21.15.166:0/4047337202 <== mon.1 v2:172.21.15.166:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f9faa65-8da9-441c-b260-430f2b0621fb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8600025bd0 con 0x7f86100aef60 2022-05-11T19:42:55.227 INFO:teuthology.orchestra.run.smithi166.stdout:7 2022-05-11T19:42:55.229 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.225+0000 7f8616481700 1 -- 172.21.15.166:0/4047337202 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 msgr2=0x7f861015c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.229 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.225+0000 7f8616481700 1 --2- 172.21.15.166:0/4047337202 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 0x7f861015c5d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8600010f90 tx=0x7f8600016000 comp rx=0 tx=0).stop 2022-05-11T19:42:55.229 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.225+0000 7f8616481700 1 -- 172.21.15.166:0/4047337202 shutdown_connections 2022-05-11T19:42:55.230 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.225+0000 7f8616481700 1 --2- 172.21.15.166:0/4047337202 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f86100c3630 0x7f86100c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.230 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.225+0000 7f8616481700 1 --2- 172.21.15.166:0/4047337202 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f86100aef60 0x7f861015c5d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.231 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.225+0000 7f8616481700 1 --2- 172.21.15.166:0/4047337202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86100af330 0x7f86100ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.231 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.225+0000 7f8616481700 1 -- 172.21.15.166:0/4047337202 >> 172.21.15.166:0/4047337202 conn(0x7f86100cd500 msgr2=0x7f861006b470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:55.232 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.226+0000 7f8616481700 1 -- 172.21.15.166:0/4047337202 shutdown_connections 2022-05-11T19:42:55.232 INFO:teuthology.orchestra.run.smithi166.stderr:2022-05-11T19:42:55.226+0000 7f8616481700 1 -- 172.21.15.166:0/4047337202 wait complete. 2022-05-11T19:42:55.240 INFO:tasks.ceph.osd.0:Restarting daemon 2022-05-11T19:42:55.241 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-05-11T19:42:55.247 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:55.244+0000 7fbd19ff5000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-05-11T19:42:55.248 INFO:tasks.ceph.osd.0:Started 2022-05-11T19:42:55.249 INFO:tasks.ceph.osd.1:Restarting daemon 2022-05-11T19:42:55.249 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-05-11T19:42:55.252 INFO:tasks.ceph.osd.1:Started 2022-05-11T19:42:55.253 INFO:tasks.ceph.osd.2:Restarting daemon 2022-05-11T19:42:55.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-05-11T19:42:55.257 INFO:tasks.ceph.osd.2:Started 2022-05-11T19:42:55.258 INFO:tasks.ceph.osd.3:Restarting daemon 2022-05-11T19:42:55.258 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-05-11T19:42:55.261 INFO:tasks.ceph.osd.3:Started 2022-05-11T19:42:55.262 INFO:tasks.ceph.osd.4:Restarting daemon 2022-05-11T19:42:55.262 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-05-11T19:42:55.268 INFO:tasks.ceph.osd.4:Started 2022-05-11T19:42:55.269 INFO:tasks.ceph.osd.5:Restarting daemon 2022-05-11T19:42:55.269 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-05-11T19:42:55.273 INFO:tasks.ceph.osd.5:Started 2022-05-11T19:42:55.275 INFO:tasks.ceph.osd.6:Restarting daemon 2022-05-11T19:42:55.275 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-05-11T19:42:55.278 INFO:tasks.ceph.osd.6:Started 2022-05-11T19:42:55.278 INFO:tasks.ceph.osd.7:Restarting daemon 2022-05-11T19:42:55.278 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-05-11T19:42:55.281 INFO:tasks.ceph.osd.7:Started 2022-05-11T19:42:55.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-11T19:42:55.424 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.422+0000 7fa24ce2a700 1 Processor -- start 2022-05-11T19:42:55.424 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.422+0000 7fa24ce2a700 1 -- start start 2022-05-11T19:42:55.426 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa24ce2a700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fa248158430 0x7fa248067ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa24ce2a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa248068420 con 0x7fa248157950 2022-05-11T19:42:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa24ce2a700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2480afe40 con 0x7fa248067a70 2022-05-11T19:42:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa24ce2a700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa248158f20 con 0x7fa248158430 2022-05-11T19:42:55.427 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa24659c700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa248157950 0x7fa24806b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:46512/0 (socket says 172.21.15.134:46512) 2022-05-11T19:42:55.428 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa24659c700 1 -- 172.21.15.134:0/1922257538 learned_addr learned my addr 172.21.15.134:0/1922257538 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:42:55.428 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa246d9d700 1 --2- 172.21.15.134:0/1922257538 >> v2:172.21.15.166:3300/0 conn(0x7fa248158430 0x7fa248067ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:55.428 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa24559a700 1 -- 172.21.15.134:0/1922257538 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598386902 0 0) 0x7fa248068420 con 0x7fa248157950 2022-05-11T19:42:55.428 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa24559a700 1 -- 172.21.15.134:0/1922257538 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa22c0033f0 con 0x7fa248157950 2022-05-11T19:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.423+0000 7fa24559a700 1 -- 172.21.15.134:0/1922257538 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2040255791 0 0) 0x7fa22c0033f0 con 0x7fa248157950 2022-05-11T19:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.424+0000 7fa246d9d700 1 -- 172.21.15.134:0/1922257538 >> v1:172.21.15.166:6789/0 conn(0x7fa248067a70 legacy=0x7fa248157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.424+0000 7fa246d9d700 1 -- 172.21.15.134:0/1922257538 >> v1:172.21.15.134:6789/0 conn(0x7fa248157950 legacy=0x7fa24806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.424+0000 7fa246d9d700 1 -- 172.21.15.134:0/1922257538 --> v2:172.21.15.166:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24806bdb0 con 0x7fa248158430 2022-05-11T19:42:55.429 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.424+0000 7fa246d9d700 1 --2- 172.21.15.134:0/1922257538 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa248158430 0x7fa248067ee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa240009e60 tx=0x7fa240009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cae932d27c6dc8f9 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:55.430 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.424+0000 7fa24559a700 1 -- 172.21.15.134:0/1922257538 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000e070 con 0x7fa248158430 2022-05-11T19:42:55.430 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.424+0000 7fa24559a700 1 -- 172.21.15.134:0/1922257538 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa240003860 con 0x7fa248158430 2022-05-11T19:42:55.430 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.424+0000 7fa24559a700 1 -- 172.21.15.134:0/1922257538 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238001470 con 0x7fa248158430 2022-05-11T19:42:55.430 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.424+0000 7fa24ce2a700 1 -- 172.21.15.134:0/1922257538 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa248158430 msgr2=0x7fa248067ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.430 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.424+0000 7fa24ce2a700 1 --2- 172.21.15.134:0/1922257538 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa248158430 0x7fa248067ee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa240009e60 tx=0x7fa240009780 comp rx=0 tx=0).stop 2022-05-11T19:42:55.431 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.425+0000 7fa24ce2a700 1 -- 172.21.15.134:0/1922257538 shutdown_connections 2022-05-11T19:42:55.431 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.425+0000 7fa24ce2a700 1 --2- 172.21.15.134:0/1922257538 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa248158430 0x7fa248067ee0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.431 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.425+0000 7fa24ce2a700 1 -- 172.21.15.134:0/1922257538 >> 172.21.15.134:0/1922257538 conn(0x7fa248069610 msgr2=0x7fa2480cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:55.431 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.425+0000 7fa24ce2a700 1 -- 172.21.15.134:0/1922257538 shutdown_connections 2022-05-11T19:42:55.432 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.425+0000 7fa24ce2a700 1 -- 172.21.15.134:0/1922257538 wait complete. 2022-05-11T19:42:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.426+0000 7fa24ce2a700 1 Processor -- start 2022-05-11T19:42:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.426+0000 7fa24ce2a700 1 -- start start 2022-05-11T19:42:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.426+0000 7fa24ce2a700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa248067a70 0x7fa2480c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.426+0000 7fa24ce2a700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa248157950 0x7fa2480ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:55.436 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.426+0000 7fa24ce2a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa248158430 0x7fa2480ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:55.436 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.426+0000 7fa24ce2a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480c7d90 con 0x7fa248158430 2022-05-11T19:42:55.436 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.426+0000 7fa24ce2a700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480c8070 con 0x7fa248157950 2022-05-11T19:42:55.436 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.426+0000 7fa24ce2a700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480c8350 con 0x7fa248067a70 2022-05-11T19:42:55.437 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa246d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa248158430 0x7fa2480ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:55.437 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa246d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa248158430 0x7fa2480ad160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39676/0 (socket says 172.21.15.134:39676) 2022-05-11T19:42:55.437 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa246d9d700 1 -- 172.21.15.134:0/2309630180 learned_addr learned my addr 172.21.15.134:0/2309630180 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:42:55.437 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa245d9b700 1 --2- 172.21.15.134:0/2309630180 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa248157950 0x7fa2480ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa24659c700 1 --2- 172.21.15.134:0/2309630180 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa248067a70 0x7fa2480c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa246d9d700 1 -- 172.21.15.134:0/2309630180 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa248067a70 msgr2=0x7fa2480c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa246d9d700 1 --2- 172.21.15.134:0/2309630180 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa248067a70 0x7fa2480c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa246d9d700 1 -- 172.21.15.134:0/2309630180 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa248157950 msgr2=0x7fa2480ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.438 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa246d9d700 1 --2- 172.21.15.134:0/2309630180 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa248157950 0x7fa2480ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.439 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa246d9d700 1 -- 172.21.15.134:0/2309630180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009a20 con 0x7fa248158430 2022-05-11T19:42:55.439 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa246d9d700 1 --2- 172.21.15.134:0/2309630180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa248158430 0x7fa2480ad160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa24806e430 tx=0x7fa240017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:55.439 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa2367fc700 1 -- 172.21.15.134:0/2309630180 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240004340 con 0x7fa248158430 2022-05-11T19:42:55.439 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa2367fc700 1 -- 172.21.15.134:0/2309630180 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2400044c0 con 0x7fa248158430 2022-05-11T19:42:55.440 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa24ce2a700 1 -- 172.21.15.134:0/2309630180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2480c8630 con 0x7fa248158430 2022-05-11T19:42:55.440 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa2367fc700 1 -- 172.21.15.134:0/2309630180 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240004880 con 0x7fa248158430 2022-05-11T19:42:55.440 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa24ce2a700 1 -- 172.21.15.134:0/2309630180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2480c9770 con 0x7fa248158430 2022-05-11T19:42:55.440 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.427+0000 7fa2367fc700 1 -- 172.21.15.134:0/2309630180 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fa240012660 con 0x7fa248158430 2022-05-11T19:42:55.440 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.428+0000 7fa2367fc700 1 -- 172.21.15.134:0/2309630180 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fa240026ae0 con 0x7fa248158430 2022-05-11T19:42:55.441 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.428+0000 7fa24ce2a700 1 -- 172.21.15.134:0/2309630180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24804c7e0 con 0x7fa248158430 2022-05-11T19:42:55.441 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.430+0000 7fa2367fc700 1 -- 172.21.15.134:0/2309630180 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7fa24002b060 con 0x7fa248158430 2022-05-11T19:42:55.526 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.524+0000 7fa24ce2a700 1 -- 172.21.15.134:0/2309630180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa24806d100 con 0x7fa248158430 2022-05-11T19:42:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.525+0000 7fa2367fc700 1 -- 172.21.15.134:0/2309630180 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa240034090 con 0x7fa248158430 2022-05-11T19:42:55.528 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:42:55.528 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":10,"fsid":"ccb62be3-03e9-4327-8bbc-0e532a97b11c","created":"2022-05-11T19:42:52.825477+0000","modified":"2022-05-11T19:42:55.219204+0000","last_up_change":"0.000000","last_in_change":"2022-05-11T19:42:55.219204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"56e1cfec-aefb-4fe9-b5a7-b6dda26a7f5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2a3acee-ede6-47f8-81c4-7e019143a485","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef94ace6-f5aa-4572-838b-d92a62fd6f42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa809b81-371a-4ab7-a648-0f1a5641d33a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b95f28ff-6fab-44f1-a8d8-ba925d4c0ff6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc4d2a03-2b7d-4e90-a1ea-cafef55b6fa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"020f0004-538e-44cd-88be-e899baf94d29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f9faa65-8da9-441c-b260-430f2b0621fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-11T19:42:55.529 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.526+0000 7fa24ce2a700 1 -- 172.21.15.134:0/2309630180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa248158430 msgr2=0x7fa2480ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:55.529 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.526+0000 7fa24ce2a700 1 --2- 172.21.15.134:0/2309630180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa248158430 0x7fa2480ad160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa24806e430 tx=0x7fa240017000 comp rx=0 tx=0).stop 2022-05-11T19:42:55.529 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.526+0000 7fa24ce2a700 1 -- 172.21.15.134:0/2309630180 shutdown_connections 2022-05-11T19:42:55.530 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.526+0000 7fa24ce2a700 1 --2- 172.21.15.134:0/2309630180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa248158430 0x7fa2480ad160 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.530 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.526+0000 7fa24ce2a700 1 --2- 172.21.15.134:0/2309630180 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fa248067a70 0x7fa2480c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.530 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.526+0000 7fa24ce2a700 1 --2- 172.21.15.134:0/2309630180 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fa248157950 0x7fa2480ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:55.530 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.526+0000 7fa24ce2a700 1 -- 172.21.15.134:0/2309630180 >> 172.21.15.134:0/2309630180 conn(0x7fa248069610 msgr2=0x7fa248156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.526+0000 7fa24ce2a700 1 -- 172.21.15.134:0/2309630180 shutdown_connections 2022-05-11T19:42:55.531 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:42:55.526+0000 7fa24ce2a700 1 -- 172.21.15.134:0/2309630180 wait complete. 2022-05-11T19:42:55.544 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-05-11T19:42:55.545 INFO:tasks.ceph:Waiting for OSDs to come up 2022-05-11T19:42:55.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2022-05-11T19:42:55.610+0000 7fae2607c3c0 -1 Falling back to public interface 2022-05-11T19:42:55.626 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:55.624+0000 7fbf733c1000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-05-11T19:42:55.725 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:55.723+0000 7fbd19ff5000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-05-11T19:42:55.829 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:55.828+0000 7fbf733c1000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-05-11T19:42:55.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2022-05-11T19:42:55.864+0000 7f19a481c3c0 -1 Falling back to public interface 2022-05-11T19:42:55.874 INFO:tasks.ceph.osd.3.smithi134.stderr:2022-05-11T19:42:55.872+0000 7fc96e90d3c0 -1 Falling back to public interface 2022-05-11T19:42:55.874 INFO:tasks.ceph.osd.2.smithi134.stderr:2022-05-11T19:42:55.872+0000 7fc6f93c03c0 -1 Falling back to public interface 2022-05-11T19:42:55.881 INFO:tasks.ceph.osd.4.smithi166.stderr:2022-05-11T19:42:55.878+0000 7f24813da3c0 -1 Falling back to public interface 2022-05-11T19:42:55.885 INFO:tasks.ceph.osd.6.smithi166.stderr:2022-05-11T19:42:55.882+0000 7fcc24b063c0 -1 Falling back to public interface 2022-05-11T19:42:55.892 INFO:tasks.ceph.osd.5.smithi166.stderr:2022-05-11T19:42:55.890+0000 7fdaced3d3c0 -1 Falling back to public interface 2022-05-11T19:42:55.893 INFO:tasks.ceph.osd.7.smithi166.stderr:2022-05-11T19:42:55.891+0000 7f5e546b83c0 -1 Falling back to public interface 2022-05-11T19:42:55.912 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:55.910+0000 7fbf733c1000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-05-11T19:42:55.931 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:55.929+0000 7fbd19ff5000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-05-11T19:42:55.992 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:55.991+0000 7fbf733c1000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-05-11T19:42:56.009 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:56.006+0000 7fbd19ff5000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-05-11T19:42:56.089 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:56.087+0000 7fbd19ff5000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-05-11T19:42:56.137 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:56.136+0000 7fbf733c1000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-05-11T19:42:56.216 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:56.214+0000 7fbf733c1000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-05-11T19:42:56.237 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:56.235+0000 7fbd19ff5000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-05-11T19:42:56.313 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:56.311+0000 7fbd19ff5000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-05-11T19:42:56.350 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-05-11T19:42:56.462 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.460+0000 7f01def56700 1 Processor -- start 2022-05-11T19:42:56.462 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.460+0000 7f01def56700 1 -- start start 2022-05-11T19:42:56.469 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.461+0000 7f01def56700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f01d806a7f0 0x7f01d81575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:56.469 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.461+0000 7f01def56700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d80aca10 con 0x7f01d81571e0 2022-05-11T19:42:56.470 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.461+0000 7f01def56700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d8068120 con 0x7f01d80ac5f0 2022-05-11T19:42:56.470 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.461+0000 7f01def56700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d8067b10 con 0x7f01d806a7f0 2022-05-11T19:42:56.470 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.461+0000 7f01dccf2700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f01d81571e0 0x7f01d80c2c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:46524/0 (socket says 172.21.15.134:46524) 2022-05-11T19:42:56.470 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.461+0000 7f01dccf2700 1 -- 172.21.15.134:0/992749616 learned_addr learned my addr 172.21.15.134:0/992749616 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:42:56.471 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.461+0000 7f01d7fff700 1 --2- 172.21.15.134:0/992749616 >> v2:172.21.15.166:3300/0 conn(0x7f01d806a7f0 0x7f01d81575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:56.471 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.461+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476459997 0 0) 0x7f01d0001490 con 0x7f01d81571e0 2022-05-11T19:42:56.471 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.461+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b80033f0 con 0x7f01d81571e0 2022-05-11T19:42:56.471 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460452039 0 0) 0x7f01d8068120 con 0x7f01d80ac5f0 2022-05-11T19:42:56.472 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d0001490 con 0x7f01d80ac5f0 2022-05-11T19:42:56.472 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2816990095 0 0) 0x7f01b80033f0 con 0x7f01d81571e0 2022-05-11T19:42:56.472 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 >> v2:172.21.15.166:3300/0 conn(0x7f01d806a7f0 msgr2=0x7f01d81575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:56.472 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 --2- 172.21.15.134:0/992749616 >> v2:172.21.15.166:3300/0 conn(0x7f01d806a7f0 0x7f01d81575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.472 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 >> v1:172.21.15.166:6789/0 conn(0x7f01d80ac5f0 legacy=0x7f01d806b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:56.473 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80c3500 con 0x7f01d81571e0 2022-05-11T19:42:56.473 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 667751508 0 0) 0x7f01d0001980 con 0x7f01d81571e0 2022-05-11T19:42:56.476 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 >> v1:172.21.15.134:6789/0 conn(0x7f01d81571e0 legacy=0x7f01d80c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:56.476 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f01b8003ac0 0x7f01b8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:56.476 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b8004690 0x7f01b8004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:56.476 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b8005090 0x7f01b800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:56.477 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8067b10 con 0x7f01b8004690 2022-05-11T19:42:56.477 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b800bfb0 con 0x7f01b8005090 2022-05-11T19:42:56.477 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b800c140 con 0x7f01b8003ac0 2022-05-11T19:42:56.477 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d7fff700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b8004690 0x7f01b8004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:56.477 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01dd4f3700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b8005090 0x7f01b800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:56.478 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01dccf2700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f01b8003ac0 0x7f01b8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:56.478 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01dd4f3700 1 -- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f01b8003ac0 msgr2=0x7f01b8003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:56.478 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01dd4f3700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f01b8003ac0 0x7f01b8003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.478 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01dd4f3700 1 -- 172.21.15.134:0/992749616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b8004690 msgr2=0x7f01b8004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:42:56.479 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01dd4f3700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b8004690 0x7f01b8004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.479 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01dd4f3700 1 -- 172.21.15.134:0/992749616 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b80033f0 con 0x7f01b8005090 2022-05-11T19:42:56.479 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d7fff700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b8004690 0x7f01b8004b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-11T19:42:56.479 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01dd4f3700 1 -- 172.21.15.134:0/992749616 reap_dead start 2022-05-11T19:42:56.479 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01dd4f3700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b8005090 0x7f01b800b8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f01c8001890 tx=0x7f01c8007bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4fb467425b3247c server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:56.480 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.462+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80050d0 con 0x7f01b8005090 2022-05-11T19:42:56.480 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.463+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8005270 con 0x7f01b8005090 2022-05-11T19:42:56.480 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.463+0000 7f01d77fe700 1 -- 172.21.15.134:0/992749616 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8003710 con 0x7f01b8005090 2022-05-11T19:42:56.480 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.463+0000 7f01def56700 1 -- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b8005090 msgr2=0x7f01b800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:56.481 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.463+0000 7f01def56700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b8005090 0x7f01b800b8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f01c8001890 tx=0x7f01c8007bb0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.481 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.463+0000 7f01def56700 1 -- 172.21.15.134:0/992749616 shutdown_connections 2022-05-11T19:42:56.481 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.463+0000 7f01def56700 1 --2- 172.21.15.134:0/992749616 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01b8005090 0x7f01b800b8e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.481 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.463+0000 7f01def56700 1 -- 172.21.15.134:0/992749616 >> 172.21.15.134:0/992749616 conn(0x7f01d80c9460 msgr2=0x7f01d80c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:56.482 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.463+0000 7f01def56700 1 -- 172.21.15.134:0/992749616 shutdown_connections 2022-05-11T19:42:56.482 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.463+0000 7f01def56700 1 -- 172.21.15.134:0/992749616 wait complete. 2022-05-11T19:42:56.482 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.464+0000 7f01def56700 1 Processor -- start 2022-05-11T19:42:56.482 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.464+0000 7f01def56700 1 -- start start 2022-05-11T19:42:56.482 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01def56700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f01b8005090 0x7f01d815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:56.483 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01def56700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01d80b01f0 0x7f01d8159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:56.483 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01def56700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d80b0660 0x7f01d815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:42:56.483 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01def56700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80b1b00 con 0x7f01d80b0660 2022-05-11T19:42:56.483 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01def56700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80b0ef0 con 0x7f01d80b01f0 2022-05-11T19:42:56.484 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01def56700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80b11d0 con 0x7f01b8005090 2022-05-11T19:42:56.484 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01dd4f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d80b0660 0x7f01d815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:56.484 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01dd4f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d80b0660 0x7f01d815a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39694/0 (socket says 172.21.15.134:39694) 2022-05-11T19:42:56.484 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01dd4f3700 1 -- 172.21.15.134:0/263272229 learned_addr learned my addr 172.21.15.134:0/263272229 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:42:56.484 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01d7fff700 1 --2- 172.21.15.134:0/263272229 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01d80b01f0 0x7f01d8159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:56.485 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.465+0000 7f01dccf2700 1 --2- 172.21.15.134:0/263272229 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f01b8005090 0x7f01d815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:42:56.485 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01dd4f3700 1 -- 172.21.15.134:0/263272229 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f01b8005090 msgr2=0x7f01d815c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:56.485 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01dd4f3700 1 --2- 172.21.15.134:0/263272229 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f01b8005090 0x7f01d815c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.485 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01dd4f3700 1 -- 172.21.15.134:0/263272229 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01d80b01f0 msgr2=0x7f01d8159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:56.486 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01dd4f3700 1 --2- 172.21.15.134:0/263272229 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01d80b01f0 0x7f01d8159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.486 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01dd4f3700 1 -- 172.21.15.134:0/263272229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80b14b0 con 0x7f01d80b0660 2022-05-11T19:42:56.486 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01dd4f3700 1 --2- 172.21.15.134:0/263272229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d80b0660 0x7f01d815a200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f01d806e440 tx=0x7f01c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:42:56.486 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01d4ff9700 1 -- 172.21.15.134:0/263272229 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80050d0 con 0x7f01d80b0660 2022-05-11T19:42:56.486 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01d4ff9700 1 -- 172.21.15.134:0/263272229 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c801d630 con 0x7f01d80b0660 2022-05-11T19:42:56.487 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01d4ff9700 1 -- 172.21.15.134:0/263272229 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c801d9f0 con 0x7f01d80b0660 2022-05-11T19:42:56.487 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01def56700 1 -- 172.21.15.134:0/263272229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d80b1790 con 0x7f01d80b0660 2022-05-11T19:42:56.487 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01def56700 1 -- 172.21.15.134:0/263272229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d815cdf0 con 0x7f01d80b0660 2022-05-11T19:42:56.487 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01d4ff9700 1 -- 172.21.15.134:0/263272229 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f01c8010050 con 0x7f01d80b0660 2022-05-11T19:42:56.488 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.466+0000 7f01d4ff9700 1 -- 172.21.15.134:0/263272229 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f01c8012420 con 0x7f01d80b0660 2022-05-11T19:42:56.488 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.467+0000 7f01def56700 1 -- 172.21.15.134:0/263272229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d80c6de0 con 0x7f01d80b0660 2022-05-11T19:42:56.488 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.469+0000 7f01d4ff9700 1 -- 172.21.15.134:0/263272229 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70809 (secure 0 0 0) 0x7f01c8022070 con 0x7f01d80b0660 2022-05-11T19:42:56.495 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:56.493+0000 7fbf733c1000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-05-11T19:42:56.538 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.537+0000 7f01def56700 1 -- 172.21.15.134:0/263272229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01d804c7e0 con 0x7f01d80b0660 2022-05-11T19:42:56.539 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.538+0000 7f01d4ff9700 1 -- 172.21.15.134:0/263272229 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f01c8017070 con 0x7f01d80b0660 2022-05-11T19:42:56.540 INFO:teuthology.misc.health.smithi134.stdout: 2022-05-11T19:42:56.540 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":10,"fsid":"ccb62be3-03e9-4327-8bbc-0e532a97b11c","created":"2022-05-11T19:42:52.825477+0000","modified":"2022-05-11T19:42:55.219204+0000","last_up_change":"0.000000","last_in_change":"2022-05-11T19:42:55.219204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"56e1cfec-aefb-4fe9-b5a7-b6dda26a7f5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2a3acee-ede6-47f8-81c4-7e019143a485","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef94ace6-f5aa-4572-838b-d92a62fd6f42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa809b81-371a-4ab7-a648-0f1a5641d33a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b95f28ff-6fab-44f1-a8d8-ba925d4c0ff6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc4d2a03-2b7d-4e90-a1ea-cafef55b6fa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"020f0004-538e-44cd-88be-e899baf94d29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f9faa65-8da9-441c-b260-430f2b0621fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-11T19:42:56.541 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.539+0000 7f01def56700 1 -- 172.21.15.134:0/263272229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d80b0660 msgr2=0x7f01d815a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:42:56.541 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.539+0000 7f01def56700 1 --2- 172.21.15.134:0/263272229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d80b0660 0x7f01d815a200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f01d806e440 tx=0x7f01c8015000 comp rx=0 tx=0).stop 2022-05-11T19:42:56.542 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.539+0000 7f01def56700 1 -- 172.21.15.134:0/263272229 shutdown_connections 2022-05-11T19:42:56.542 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.539+0000 7f01def56700 1 --2- 172.21.15.134:0/263272229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d80b0660 0x7f01d815a200 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.542 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.539+0000 7f01def56700 1 --2- 172.21.15.134:0/263272229 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f01b8005090 0x7f01d815c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.542 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.539+0000 7f01def56700 1 --2- 172.21.15.134:0/263272229 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f01d80b01f0 0x7f01d8159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:42:56.542 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.539+0000 7f01def56700 1 -- 172.21.15.134:0/263272229 >> 172.21.15.134:0/263272229 conn(0x7f01d80c9460 msgr2=0x7f01d8152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:42:56.543 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.539+0000 7f01def56700 1 -- 172.21.15.134:0/263272229 shutdown_connections 2022-05-11T19:42:56.543 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:42:56.539+0000 7f01def56700 1 -- 172.21.15.134:0/263272229 wait complete. 2022-05-11T19:42:56.551 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-05-11T19:42:56.588 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:56.586+0000 7fbd19ff5000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-05-11T19:42:56.647 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:56.645+0000 7fbf733c1000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-05-11T19:42:56.739 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:56.737+0000 7fbd19ff5000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-05-11T19:42:56.957 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:56.955+0000 7fbf733c1000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-05-11T19:42:57.038 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:57.035+0000 7fbf733c1000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-05-11T19:42:57.052 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:57.050+0000 7fbd19ff5000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-05-11T19:42:57.129 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:57.126+0000 7fbd19ff5000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-05-11T19:42:57.322 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:57.320+0000 7fbf733c1000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-05-11T19:42:57.415 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:57.413+0000 7fbd19ff5000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-05-11T19:42:57.493 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:57.491+0000 7fbf733c1000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-05-11T19:42:57.588 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:57.586+0000 7fbd19ff5000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-05-11T19:42:57.760 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:57.759+0000 7fbf733c1000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-05-11T19:42:57.831 INFO:tasks.ceph.mgr.y.smithi134.stderr:2022-05-11T19:42:57.830+0000 7fbf733c1000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-05-11T19:42:57.857 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:57.855+0000 7fbd19ff5000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-05-11T19:42:57.928 INFO:tasks.ceph.mgr.x.smithi166.stderr:2022-05-11T19:42:57.926+0000 7fbd19ff5000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-05-11T19:42:59.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2022-05-11T19:42:59.171+0000 7fae2607c3c0 -1 osd.0 0 log_to_monitors true 2022-05-11T19:42:59.408 INFO:tasks.ceph.osd.4.smithi166.stderr:2022-05-11T19:42:59.406+0000 7f24813da3c0 -1 osd.4 0 log_to_monitors true 2022-05-11T19:42:59.424 INFO:tasks.ceph.osd.3.smithi134.stderr:2022-05-11T19:42:59.422+0000 7fc96e90d3c0 -1 osd.3 0 log_to_monitors true 2022-05-11T19:42:59.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2022-05-11T19:42:59.438+0000 7f19a481c3c0 -1 osd.1 0 log_to_monitors true 2022-05-11T19:42:59.449 INFO:tasks.ceph.osd.2.smithi134.stderr:2022-05-11T19:42:59.448+0000 7fc6f93c03c0 -1 osd.2 0 log_to_monitors true 2022-05-11T19:42:59.457 INFO:tasks.ceph.osd.6.smithi166.stderr:2022-05-11T19:42:59.455+0000 7fcc24b063c0 -1 osd.6 0 log_to_monitors true 2022-05-11T19:42:59.458 INFO:tasks.ceph.osd.5.smithi166.stderr:2022-05-11T19:42:59.455+0000 7fdaced3d3c0 -1 osd.5 0 log_to_monitors true 2022-05-11T19:42:59.504 INFO:tasks.ceph.osd.7.smithi166.stderr:2022-05-11T19:42:59.501+0000 7f5e546b83c0 -1 osd.7 0 log_to_monitors true 2022-05-11T19:43:03.013 INFO:tasks.ceph.osd.2.smithi134.stderr:2022-05-11T19:43:03.009+0000 7fc6effde700 -1 osd.2 0 waiting for initial osdmap 2022-05-11T19:43:03.016 INFO:tasks.ceph.osd.2.smithi134.stderr:2022-05-11T19:43:03.015+0000 7fc6e8970700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-11T19:43:03.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2022-05-11T19:43:03.024+0000 7f199b43a700 -1 osd.1 0 waiting for initial osdmap 2022-05-11T19:43:03.029 INFO:tasks.ceph.osd.1.smithi134.stderr:2022-05-11T19:43:03.028+0000 7f1993dcc700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-11T19:43:03.044 INFO:tasks.ceph.osd.3.smithi134.stderr:2022-05-11T19:43:03.043+0000 7fc96552b700 -1 osd.3 0 waiting for initial osdmap 2022-05-11T19:43:03.048 INFO:tasks.ceph.osd.3.smithi134.stderr:2022-05-11T19:43:03.047+0000 7fc95debd700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-11T19:43:03.062 INFO:tasks.ceph.osd.6.smithi166.stderr:2022-05-11T19:43:03.059+0000 7fcc1b724700 -1 osd.6 0 waiting for initial osdmap 2022-05-11T19:43:03.068 INFO:tasks.ceph.osd.6.smithi166.stderr:2022-05-11T19:43:03.064+0000 7fcc140b6700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-11T19:43:03.071 INFO:tasks.ceph.osd.5.smithi166.stderr:2022-05-11T19:43:03.069+0000 7fdac595b700 -1 osd.5 0 waiting for initial osdmap 2022-05-11T19:43:03.077 INFO:tasks.ceph.osd.5.smithi166.stderr:2022-05-11T19:43:03.075+0000 7fdabe2ed700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-11T19:43:03.086 INFO:tasks.ceph.osd.7.smithi166.stderr:2022-05-11T19:43:03.083+0000 7f5e4b2d6700 -1 osd.7 0 waiting for initial osdmap 2022-05-11T19:43:03.086 INFO:tasks.ceph.osd.4.smithi166.stderr:2022-05-11T19:43:03.084+0000 7f2477ff8700 -1 osd.4 0 waiting for initial osdmap 2022-05-11T19:43:03.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2022-05-11T19:43:03.087+0000 7fae1cc9a700 -1 osd.0 0 waiting for initial osdmap 2022-05-11T19:43:03.089 INFO:tasks.ceph.osd.7.smithi166.stderr:2022-05-11T19:43:03.088+0000 7f5e43c68700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-11T19:43:03.091 INFO:tasks.ceph.osd.4.smithi166.stderr:2022-05-11T19:43:03.089+0000 7f247098a700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-11T19:43:03.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2022-05-11T19:43:03.090+0000 7fae1562c700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-05-11T19:43:03.358 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-05-11T19:43:03.465 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.464+0000 7f053f0a6700 1 Processor -- start 2022-05-11T19:43:03.466 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.464+0000 7f053f0a6700 1 -- start start 2022-05-11T19:43:03.469 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053f0a6700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f053813db90 0x7f053813df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:03.469 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053f0a6700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f05380ca040 0x7f05380ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:03.469 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053f0a6700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca9d0 0x7f053815b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:03.470 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053f0a6700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05380c7110 con 0x7f053813db90 2022-05-11T19:43:03.470 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053f0a6700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05380cae50 con 0x7f05380ca040 2022-05-11T19:43:03.470 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053f0a6700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05380c6ae0 con 0x7f05380ca9d0 2022-05-11T19:43:03.470 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053ce42700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f053813db90 0x7f053813df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:03.471 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053ce42700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f053813db90 0x7f053813df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39796/0 (socket says 172.21.15.134:39796) 2022-05-11T19:43:03.471 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053ce42700 1 -- 172.21.15.134:0/2519149037 learned_addr learned my addr 172.21.15.134:0/2519149037 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:03.471 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f0537fff700 1 --2- 172.21.15.134:0/2519149037 >> v2:172.21.15.166:3300/0 conn(0x7f05380ca040 0x7f05380ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:03.471 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053d643700 1 --2- 172.21.15.134:0/2519149037 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca9d0 0x7f053815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:03.471 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053ce42700 1 -- 172.21.15.134:0/2519149037 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca9d0 msgr2=0x7f053815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:03.472 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053ce42700 1 --2- 172.21.15.134:0/2519149037 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca9d0 0x7f053815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.472 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053ce42700 1 -- 172.21.15.134:0/2519149037 >> v2:172.21.15.166:3300/0 conn(0x7f05380ca040 msgr2=0x7f05380ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:03.472 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053ce42700 1 --2- 172.21.15.134:0/2519149037 >> v2:172.21.15.166:3300/0 conn(0x7f05380ca040 0x7f05380ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.472 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053ce42700 1 -- 172.21.15.134:0/2519149037 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05380c1460 con 0x7f053813db90 2022-05-11T19:43:03.473 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053d643700 1 --2- 172.21.15.134:0/2519149037 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca9d0 0x7f053815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-05-11T19:43:03.473 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f053ce42700 1 --2- 172.21.15.134:0/2519149037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f053813db90 0x7f053813df60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05380cbb60 tx=0x7f052c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37ed163a7d12628 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:03.473 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f05377fe700 1 -- 172.21.15.134:0/2519149037 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c004030 con 0x7f053813db90 2022-05-11T19:43:03.473 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f05377fe700 1 -- 172.21.15.134:0/2519149037 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c0041d0 con 0x7f053813db90 2022-05-11T19:43:03.474 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.465+0000 7f05377fe700 1 -- 172.21.15.134:0/2519149037 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c011630 con 0x7f053813db90 2022-05-11T19:43:03.474 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.466+0000 7f053f0a6700 1 -- 172.21.15.134:0/2519149037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f053813db90 msgr2=0x7f053813df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:03.474 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.466+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2519149037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f053813db90 0x7f053813df60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05380cbb60 tx=0x7f052c0090f0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.474 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.466+0000 7f053f0a6700 1 -- 172.21.15.134:0/2519149037 shutdown_connections 2022-05-11T19:43:03.475 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.466+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2519149037 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca9d0 0x7f053815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.475 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.466+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2519149037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f053813db90 0x7f053813df60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.475 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.466+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2519149037 >> v2:172.21.15.166:3300/0 conn(0x7f05380ca040 0x7f05380ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.475 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.466+0000 7f053f0a6700 1 -- 172.21.15.134:0/2519149037 >> 172.21.15.134:0/2519149037 conn(0x7f05380c8be0 msgr2=0x7f05380c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:03.475 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.466+0000 7f053f0a6700 1 -- 172.21.15.134:0/2519149037 shutdown_connections 2022-05-11T19:43:03.476 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.466+0000 7f053f0a6700 1 -- 172.21.15.134:0/2519149037 wait complete. 2022-05-11T19:43:03.476 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.467+0000 7f053f0a6700 1 Processor -- start 2022-05-11T19:43:03.476 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.468+0000 7f053f0a6700 1 -- start start 2022-05-11T19:43:03.480 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.468+0000 7f053f0a6700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca040 0x7f0538157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:03.480 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.468+0000 7f053f0a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05380ca9d0 0x7f05380b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:03.480 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.468+0000 7f053f0a6700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f053813db90 0x7f05381549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:03.480 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f053f0a6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05380c5610 con 0x7f05380ca9d0 2022-05-11T19:43:03.481 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f053f0a6700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0538154f30 con 0x7f053813db90 2022-05-11T19:43:03.481 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f053f0a6700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0538157670 con 0x7f05380ca040 2022-05-11T19:43:03.481 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0537fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05380ca9d0 0x7f05380b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:03.481 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0537fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05380ca9d0 0x7f05380b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39806/0 (socket says 172.21.15.134:39806) 2022-05-11T19:43:03.482 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0537fff700 1 -- 172.21.15.134:0/2681094763 learned_addr learned my addr 172.21.15.134:0/2681094763 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:03.482 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f053d643700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f053813db90 0x7f05381549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:03.482 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f053ce42700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca040 0x7f0538157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:03.482 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0537fff700 1 -- 172.21.15.134:0/2681094763 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca040 msgr2=0x7f0538157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:03.483 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0537fff700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca040 0x7f0538157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.483 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0537fff700 1 -- 172.21.15.134:0/2681094763 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f053813db90 msgr2=0x7f05381549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:03.483 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0537fff700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f053813db90 0x7f05381549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.483 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0537fff700 1 -- 172.21.15.134:0/2681094763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009370 con 0x7f05380ca9d0 2022-05-11T19:43:03.483 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0537fff700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05380ca9d0 0x7f05380b00a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f052400d890 tx=0x7f0524008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:03.484 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0534ff9700 1 -- 172.21.15.134:0/2681094763 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524014620 con 0x7f05380ca9d0 2022-05-11T19:43:03.484 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0534ff9700 1 -- 172.21.15.134:0/2681094763 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0524014780 con 0x7f05380ca9d0 2022-05-11T19:43:03.484 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05380c4ce0 con 0x7f05380ca9d0 2022-05-11T19:43:03.484 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f0534ff9700 1 -- 172.21.15.134:0/2681094763 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524014b20 con 0x7f05380ca9d0 2022-05-11T19:43:03.485 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.469+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05380c52a0 con 0x7f05380ca9d0 2022-05-11T19:43:03.485 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.470+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05380c57c0 con 0x7f05380ca9d0 2022-05-11T19:43:03.485 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.471+0000 7f0534ff9700 1 -- 172.21.15.134:0/2681094763 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 81880+0+0 (secure 0 0 0) 0x7f0524024070 con 0x7f05380ca9d0 2022-05-11T19:43:03.485 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.471+0000 7f0534ff9700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f0520063c70 0x7f0520066120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:03.486 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.471+0000 7f0534ff9700 1 -- 172.21.15.134:0/2681094763 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f052407fed0 con 0x7f05380ca9d0 2022-05-11T19:43:03.486 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.471+0000 7f053ce42700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f0520063c70 0x7f0520066120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:03.486 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.471+0000 7f053ce42700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f0520063c70 0x7f0520066120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f052c009340 tx=0x7f052c016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:03.486 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.475+0000 7f0534ff9700 1 -- 172.21.15.134:0/2681094763 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7f052404fa00 con 0x7f05380ca9d0 2022-05-11T19:43:03.654 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.653+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05380c1740 con 0x7f05380ca9d0 2022-05-11T19:43:03.655 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.653+0000 7f0534ff9700 1 -- 172.21.15.134:0/2681094763 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f0524053020 con 0x7f05380ca9d0 2022-05-11T19:43:03.655 INFO:teuthology.misc.health.smithi134.stdout: 2022-05-11T19:43:03.656 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":12,"fsid":"ccb62be3-03e9-4327-8bbc-0e532a97b11c","created":"2022-05-11T19:42:52.825477+0000","modified":"2022-05-11T19:43:00.995270+0000","last_up_change":"0.000000","last_in_change":"2022-05-11T19:42:55.219204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"56e1cfec-aefb-4fe9-b5a7-b6dda26a7f5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2a3acee-ede6-47f8-81c4-7e019143a485","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef94ace6-f5aa-4572-838b-d92a62fd6f42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa809b81-371a-4ab7-a648-0f1a5641d33a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b95f28ff-6fab-44f1-a8d8-ba925d4c0ff6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc4d2a03-2b7d-4e90-a1ea-cafef55b6fa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"020f0004-538e-44cd-88be-e899baf94d29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f9faa65-8da9-441c-b260-430f2b0621fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-11T19:43:03.657 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f0520063c70 msgr2=0x7f0520066120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:03.657 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f0520063c70 0x7f0520066120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f052c009340 tx=0x7f052c016000 comp rx=0 tx=0).stop 2022-05-11T19:43:03.657 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05380ca9d0 msgr2=0x7f05380b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:03.658 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05380ca9d0 0x7f05380b00a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f052400d890 tx=0x7f0524008040 comp rx=0 tx=0).stop 2022-05-11T19:43:03.658 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 shutdown_connections 2022-05-11T19:43:03.658 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f053813db90 0x7f05381549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.658 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f05380ca040 0x7f0538157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.659 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f0520063c70 0x7f0520066120 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.659 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 --2- 172.21.15.134:0/2681094763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05380ca9d0 0x7f05380b00a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:03.659 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 >> 172.21.15.134:0/2681094763 conn(0x7f05380c8be0 msgr2=0x7f0538159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:03.659 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 shutdown_connections 2022-05-11T19:43:03.660 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:03.655+0000 7f053f0a6700 1 -- 172.21.15.134:0/2681094763 wait complete. 2022-05-11T19:43:03.667 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-05-11T19:43:10.475 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-05-11T19:43:10.592 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.591+0000 7fd14f578700 1 Processor -- start 2022-05-11T19:43:10.593 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.591+0000 7fd14f578700 1 -- start start 2022-05-11T19:43:10.596 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14f578700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7fd1480c5c60 0x7fd1480c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.596 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14f578700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd1480caf90 0x7fd1480cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.596 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14f578700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1480c73f0 con 0x7fd1481599f0 2022-05-11T19:43:10.596 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14f578700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd148159dc0 con 0x7fd1480caf90 2022-05-11T19:43:10.597 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14f578700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1480ae680 con 0x7fd1480c5c60 2022-05-11T19:43:10.597 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14db15700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd1480caf90 0x7fd1480cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.597 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14db15700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd1480caf90 0x7fd1480cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40040/0 (socket says 172.21.15.134:40040) 2022-05-11T19:43:10.598 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14db15700 1 -- 172.21.15.134:0/816609253 learned_addr learned my addr 172.21.15.134:0/816609253 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:10.598 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14cb13700 1 --2- 172.21.15.134:0/816609253 >> v2:172.21.15.166:3300/0 conn(0x7fd1480c5c60 0x7fd1480c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.598 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14db15700 1 -- 172.21.15.134:0/816609253 >> v2:172.21.15.166:3300/0 conn(0x7fd1480c5c60 msgr2=0x7fd1480c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:10.599 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14db15700 1 --2- 172.21.15.134:0/816609253 >> v2:172.21.15.166:3300/0 conn(0x7fd1480c5c60 0x7fd1480c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.599 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14db15700 1 -- 172.21.15.134:0/816609253 >> v1:172.21.15.166:6789/0 conn(0x7fd1481599f0 legacy=0x7fd148069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.599 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14db15700 1 -- 172.21.15.134:0/816609253 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1480ae960 con 0x7fd1480caf90 2022-05-11T19:43:10.599 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd14db15700 1 --2- 172.21.15.134:0/816609253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 0x7fd1480cb360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd14806fc90 tx=0x7fd140009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543a3c84a5cea8cb server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:10.599 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.592+0000 7fd137fff700 1 -- 172.21.15.134:0/816609253 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14000e070 con 0x7fd1480caf90 2022-05-11T19:43:10.600 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd137fff700 1 -- 172.21.15.134:0/816609253 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14000ba50 con 0x7fd1480caf90 2022-05-11T19:43:10.600 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd137fff700 1 -- 172.21.15.134:0/816609253 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400092e0 con 0x7fd1480caf90 2022-05-11T19:43:10.600 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd14f578700 1 -- 172.21.15.134:0/816609253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 msgr2=0x7fd1480cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.600 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd14f578700 1 --2- 172.21.15.134:0/816609253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 0x7fd1480cb360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd14806fc90 tx=0x7fd140009840 comp rx=0 tx=0).stop 2022-05-11T19:43:10.600 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd14f578700 1 -- 172.21.15.134:0/816609253 shutdown_connections 2022-05-11T19:43:10.601 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd14f578700 1 --2- 172.21.15.134:0/816609253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 0x7fd1480cb360 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.601 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd14f578700 1 --2- 172.21.15.134:0/816609253 >> v2:172.21.15.166:3300/0 conn(0x7fd1480c5c60 0x7fd1480c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.601 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd14f578700 1 -- 172.21.15.134:0/816609253 >> 172.21.15.134:0/816609253 conn(0x7fd148063e00 msgr2=0x7fd148087f70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:10.601 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd14f578700 1 -- 172.21.15.134:0/816609253 shutdown_connections 2022-05-11T19:43:10.602 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.593+0000 7fd14f578700 1 -- 172.21.15.134:0/816609253 wait complete. 2022-05-11T19:43:10.602 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.594+0000 7fd14f578700 1 Processor -- start 2022-05-11T19:43:10.602 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.594+0000 7fd14f578700 1 -- start start 2022-05-11T19:43:10.605 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.595+0000 7fd14f578700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd1480c5c60 0x7fd14816a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.605 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.595+0000 7fd14f578700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 0x7fd148156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.605 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.595+0000 7fd14f578700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fd1481599f0 0x7fd14816d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.605 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.595+0000 7fd14f578700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd148157130 con 0x7fd1480caf90 2022-05-11T19:43:10.606 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.595+0000 7fd14f578700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14816db00 con 0x7fd1480c5c60 2022-05-11T19:43:10.606 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.595+0000 7fd14f578700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14816dde0 con 0x7fd1481599f0 2022-05-11T19:43:10.606 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.595+0000 7fd14cb13700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 0x7fd148156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.606 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.595+0000 7fd14cb13700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 0x7fd148156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40044/0 (socket says 172.21.15.134:40044) 2022-05-11T19:43:10.607 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.595+0000 7fd14cb13700 1 -- 172.21.15.134:0/2500652767 learned_addr learned my addr 172.21.15.134:0/2500652767 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:10.607 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14d314700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd1480c5c60 0x7fd14816a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.607 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14db15700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fd1481599f0 0x7fd14816d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.607 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14cb13700 1 -- 172.21.15.134:0/2500652767 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fd1481599f0 msgr2=0x7fd14816d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.608 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14cb13700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fd1481599f0 0x7fd14816d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.608 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14cb13700 1 -- 172.21.15.134:0/2500652767 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd1480c5c60 msgr2=0x7fd14816a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.608 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14cb13700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd1480c5c60 0x7fd14816a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.608 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14cb13700 1 -- 172.21.15.134:0/2500652767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140009ae0 con 0x7fd1480caf90 2022-05-11T19:43:10.609 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14cb13700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 0x7fd148156bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd14400d890 tx=0x7fd144008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:10.609 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd1357fa700 1 -- 172.21.15.134:0/2500652767 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1440125f0 con 0x7fd1480caf90 2022-05-11T19:43:10.609 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd1357fa700 1 -- 172.21.15.134:0/2500652767 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144012750 con 0x7fd1480caf90 2022-05-11T19:43:10.609 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd148169da0 con 0x7fd1480caf90 2022-05-11T19:43:10.609 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd1357fa700 1 -- 172.21.15.134:0/2500652767 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144012b10 con 0x7fd1480caf90 2022-05-11T19:43:10.610 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.596+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd148157590 con 0x7fd1480caf90 2022-05-11T19:43:10.610 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.597+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14804c7e0 con 0x7fd1480caf90 2022-05-11T19:43:10.610 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.597+0000 7fd1357fa700 1 -- 172.21.15.134:0/2500652767 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7fd14401e460 con 0x7fd1480caf90 2022-05-11T19:43:10.610 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.598+0000 7fd1357fa700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fd128063cc0 0x7fd128066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.611 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.598+0000 7fd1357fa700 1 -- 172.21.15.134:0/2500652767 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd144080990 con 0x7fd1480caf90 2022-05-11T19:43:10.611 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.598+0000 7fd14d314700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fd128063cc0 0x7fd128066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.611 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.598+0000 7fd14d314700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fd128063cc0 0x7fd128066170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd138007fd0 tx=0x7fd138009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:10.611 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.602+0000 7fd1357fa700 1 -- 172.21.15.134:0/2500652767 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7fd14404f9d0 con 0x7fd1480caf90 2022-05-11T19:43:10.778 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.777+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd14808a940 con 0x7fd1480caf90 2022-05-11T19:43:10.779 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.778+0000 7fd1357fa700 1 -- 172.21.15.134:0/2500652767 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12271 (secure 0 0 0) 0x7fd144052ff0 con 0x7fd1480caf90 2022-05-11T19:43:10.780 INFO:teuthology.misc.health.smithi134.stdout: 2022-05-11T19:43:10.780 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":17,"fsid":"ccb62be3-03e9-4327-8bbc-0e532a97b11c","created":"2022-05-11T19:42:52.825477+0000","modified":"2022-05-11T19:43:08.086064+0000","last_up_change":"2022-05-11T19:43:04.020564+0000","last_in_change":"2022-05-11T19:42:55.219204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-11T19:43:06.032854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"56e1cfec-aefb-4fe9-b5a7-b6dda26a7f5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":122590},{"type":"v1","addr":"172.21.15.134:6801","nonce":122590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":122590},{"type":"v1","addr":"172.21.15.134:6803","nonce":122590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":122590},{"type":"v1","addr":"172.21.15.134:6807","nonce":122590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":122590},{"type":"v1","addr":"172.21.15.134:6805","nonce":122590}]},"public_addr":"172.21.15.134:6801/122590","cluster_addr":"172.21.15.134:6803/122590","heartbeat_back_addr":"172.21.15.134:6807/122590","heartbeat_front_addr":"172.21.15.134:6805/122590","state":["exists","up"]},{"osd":1,"uuid":"d2a3acee-ede6-47f8-81c4-7e019143a485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":122589},{"type":"v1","addr":"172.21.15.134:6809","nonce":122589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":122589},{"type":"v1","addr":"172.21.15.134:6811","nonce":122589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":122589},{"type":"v1","addr":"172.21.15.134:6815","nonce":122589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":122589},{"type":"v1","addr":"172.21.15.134:6813","nonce":122589}]},"public_addr":"172.21.15.134:6809/122589","cluster_addr":"172.21.15.134:6811/122589","heartbeat_back_addr":"172.21.15.134:6815/122589","heartbeat_front_addr":"172.21.15.134:6813/122589","state":["exists","up"]},{"osd":2,"uuid":"ef94ace6-f5aa-4572-838b-d92a62fd6f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":122592},{"type":"v1","addr":"172.21.15.134:6819","nonce":122592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":122592},{"type":"v1","addr":"172.21.15.134:6823","nonce":122592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":122592},{"type":"v1","addr":"172.21.15.134:6831","nonce":122592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":122592},{"type":"v1","addr":"172.21.15.134:6827","nonce":122592}]},"public_addr":"172.21.15.134:6819/122592","cluster_addr":"172.21.15.134:6823/122592","heartbeat_back_addr":"172.21.15.134:6831/122592","heartbeat_front_addr":"172.21.15.134:6827/122592","state":["exists","up"]},{"osd":3,"uuid":"fa809b81-371a-4ab7-a648-0f1a5641d33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":122591},{"type":"v1","addr":"172.21.15.134:6818","nonce":122591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":122591},{"type":"v1","addr":"172.21.15.134:6822","nonce":122591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":122591},{"type":"v1","addr":"172.21.15.134:6830","nonce":122591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":122591},{"type":"v1","addr":"172.21.15.134:6826","nonce":122591}]},"public_addr":"172.21.15.134:6818/122591","cluster_addr":"172.21.15.134:6822/122591","heartbeat_back_addr":"172.21.15.134:6830/122591","heartbeat_front_addr":"172.21.15.134:6826/122591","state":["exists","up"]},{"osd":4,"uuid":"b95f28ff-6fab-44f1-a8d8-ba925d4c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6800","nonce":122910},{"type":"v1","addr":"172.21.15.166:6801","nonce":122910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":122910},{"type":"v1","addr":"172.21.15.166:6803","nonce":122910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":122910},{"type":"v1","addr":"172.21.15.166:6807","nonce":122910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":122910},{"type":"v1","addr":"172.21.15.166:6805","nonce":122910}]},"public_addr":"172.21.15.166:6801/122910","cluster_addr":"172.21.15.166:6803/122910","heartbeat_back_addr":"172.21.15.166:6807/122910","heartbeat_front_addr":"172.21.15.166:6805/122910","state":["exists","up"]},{"osd":5,"uuid":"dc4d2a03-2b7d-4e90-a1ea-cafef55b6fa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":122925},{"type":"v1","addr":"172.21.15.166:6817","nonce":122925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":122925},{"type":"v1","addr":"172.21.15.166:6819","nonce":122925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":122925},{"type":"v1","addr":"172.21.15.166:6827","nonce":122925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":122925},{"type":"v1","addr":"172.21.15.166:6823","nonce":122925}]},"public_addr":"172.21.15.166:6817/122925","cluster_addr":"172.21.15.166:6819/122925","heartbeat_back_addr":"172.21.15.166:6827/122925","heartbeat_front_addr":"172.21.15.166:6823/122925","state":["exists","up"]},{"osd":6,"uuid":"020f0004-538e-44cd-88be-e899baf94d29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":122911},{"type":"v1","addr":"172.21.15.166:6809","nonce":122911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":122911},{"type":"v1","addr":"172.21.15.166:6811","nonce":122911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":122911},{"type":"v1","addr":"172.21.15.166:6815","nonce":122911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":122911},{"type":"v1","addr":"172.21.15.166:6813","nonce":122911}]},"public_addr":"172.21.15.166:6809/122911","cluster_addr":"172.21.15.166:6811/122911","heartbeat_back_addr":"172.21.15.166:6815/122911","heartbeat_front_addr":"172.21.15.166:6813/122911","state":["exists","up"]},{"osd":7,"uuid":"6f9faa65-8da9-441c-b260-430f2b0621fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":122912},{"type":"v1","addr":"172.21.15.166:6822","nonce":122912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":122912},{"type":"v1","addr":"172.21.15.166:6826","nonce":122912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6830","nonce":122912},{"type":"v1","addr":"172.21.15.166:6831","nonce":122912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":122912},{"type":"v1","addr":"172.21.15.166:6829","nonce":122912}]},"public_addr":"172.21.15.166:6822/122912","cluster_addr":"172.21.15.166:6826/122912","heartbeat_back_addr":"172.21.15.166:6831/122912","heartbeat_front_addr":"172.21.15.166:6829/122912","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.126431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.489364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.420767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.383215+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.380408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.423371+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.453214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.461833+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-11T19:43:10.781 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fd128063cc0 msgr2=0x7fd128066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.781 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fd128063cc0 0x7fd128066170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd138007fd0 tx=0x7fd138009040 comp rx=0 tx=0).stop 2022-05-11T19:43:10.782 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 msgr2=0x7fd148156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.782 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 0x7fd148156bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd14400d890 tx=0x7fd144008040 comp rx=0 tx=0).stop 2022-05-11T19:43:10.782 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 shutdown_connections 2022-05-11T19:43:10.782 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fd1481599f0 0x7fd14816d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.783 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fd1480c5c60 0x7fd14816a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.783 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fd128063cc0 0x7fd128066170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.783 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 --2- 172.21.15.134:0/2500652767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1480caf90 0x7fd148156bf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.784 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 >> 172.21.15.134:0/2500652767 conn(0x7fd148063e00 msgr2=0x7fd148159050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:10.784 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.779+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 shutdown_connections 2022-05-11T19:43:10.784 INFO:teuthology.misc.health.smithi134.stderr:2022-05-11T19:43:10.780+0000 7fd14f578700 1 -- 172.21.15.134:0/2500652767 wait complete. 2022-05-11T19:43:10.792 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-05-11T19:43:10.792 INFO:tasks.ceph:Creating RBD pool 2022-05-11T19:43:10.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd pool create rbd 8 2022-05-11T19:43:10.907 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.905+0000 7f04ef441700 1 Processor -- start 2022-05-11T19:43:10.908 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.906+0000 7f04ef441700 1 -- start start 2022-05-11T19:43:10.910 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.906+0000 7f04ef441700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f04e80c3630 0x7f04e80c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.911 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.906+0000 7f04ef441700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e80c2d10 con 0x7f04e80aef60 2022-05-11T19:43:10.911 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.906+0000 7f04ef441700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e8067ba0 con 0x7f04e80af330 2022-05-11T19:43:10.911 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.906+0000 7f04ef441700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e8067e80 con 0x7f04e80c3630 2022-05-11T19:43:10.911 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.906+0000 7f04ec9dc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f04e80c3630 0x7f04e80c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.912 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04ec9dc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f04e80c3630 0x7f04e80c2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40052/0 (socket says 172.21.15.134:40052) 2022-05-11T19:43:10.912 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04ed1dd700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f04e80aef60 0x7f04e8068960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:46896/0 (socket says 172.21.15.134:46896) 2022-05-11T19:43:10.912 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04ec9dc700 1 -- 172.21.15.134:0/9261462 learned_addr learned my addr 172.21.15.134:0/9261462 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:10.912 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04ec9dc700 1 -- 172.21.15.134:0/9261462 >> v1:172.21.15.166:6789/0 conn(0x7f04e80af330 legacy=0x7f04e80c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.913 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04ec9dc700 1 -- 172.21.15.134:0/9261462 >> v1:172.21.15.134:6789/0 conn(0x7f04e80aef60 legacy=0x7f04e8068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.913 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04ec9dc700 1 -- 172.21.15.134:0/9261462 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8068160 con 0x7f04e80c3630 2022-05-11T19:43:10.913 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04d7fff700 1 -- 172.21.15.134:0/9261462 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841315238 0 0) 0x7f04e80c2d10 con 0x7f04e80aef60 2022-05-11T19:43:10.913 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04ec9dc700 1 --2- 172.21.15.134:0/9261462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80c3630 0x7f04e80c2430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f04d8006fd0 tx=0x7f04d80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3a8bb6326d341a server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:10.914 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04d7fff700 1 -- 172.21.15.134:0/9261462 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8004030 con 0x7f04e80c3630 2022-05-11T19:43:10.914 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04d7fff700 1 -- 172.21.15.134:0/9261462 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d80041b0 con 0x7f04e80c3630 2022-05-11T19:43:10.914 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.907+0000 7f04d7fff700 1 -- 172.21.15.134:0/9261462 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8011630 con 0x7f04e80c3630 2022-05-11T19:43:10.914 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.908+0000 7f04ef441700 1 -- 172.21.15.134:0/9261462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80c3630 msgr2=0x7f04e80c2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.915 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.908+0000 7f04ef441700 1 --2- 172.21.15.134:0/9261462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80c3630 0x7f04e80c2430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f04d8006fd0 tx=0x7f04d80090f0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.915 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.908+0000 7f04ef441700 1 -- 172.21.15.134:0/9261462 shutdown_connections 2022-05-11T19:43:10.915 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.908+0000 7f04ef441700 1 --2- 172.21.15.134:0/9261462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80c3630 0x7f04e80c2430 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.915 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.908+0000 7f04ef441700 1 -- 172.21.15.134:0/9261462 >> 172.21.15.134:0/9261462 conn(0x7f04e80cd500 msgr2=0x7f04e80c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:10.915 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.908+0000 7f04ef441700 1 -- 172.21.15.134:0/9261462 shutdown_connections 2022-05-11T19:43:10.916 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.908+0000 7f04ef441700 1 -- 172.21.15.134:0/9261462 wait complete. 2022-05-11T19:43:10.916 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.909+0000 7f04ef441700 1 Processor -- start 2022-05-11T19:43:10.916 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.909+0000 7f04ef441700 1 -- start start 2022-05-11T19:43:10.919 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ef441700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80aef60 0x7f04e8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.920 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ef441700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f04e80af330 0x7f04e80b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.920 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ef441700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f04e80c3630 0x7f04e815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.920 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ef441700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c5900 con 0x7f04e80aef60 2022-05-11T19:43:10.920 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ef441700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c4cf0 con 0x7f04e80c3630 2022-05-11T19:43:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ef441700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c4fd0 con 0x7f04e80af330 2022-05-11T19:43:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed1dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80aef60 0x7f04e8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed1dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80aef60 0x7f04e8157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40056/0 (socket says 172.21.15.134:40056) 2022-05-11T19:43:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed1dd700 1 -- 172.21.15.134:0/2481713430 learned_addr learned my addr 172.21.15.134:0/2481713430 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:10.921 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed9de700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f04e80c3630 0x7f04e815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.922 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ec9dc700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f04e80af330 0x7f04e80b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.922 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed1dd700 1 -- 172.21.15.134:0/2481713430 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f04e80af330 msgr2=0x7f04e80b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.922 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed1dd700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f04e80af330 0x7f04e80b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.922 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed1dd700 1 -- 172.21.15.134:0/2481713430 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f04e80c3630 msgr2=0x7f04e815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:10.923 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed1dd700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f04e80c3630 0x7f04e815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:10.923 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed1dd700 1 -- 172.21.15.134:0/2481713430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d8009370 con 0x7f04e80aef60 2022-05-11T19:43:10.923 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed9de700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f04e80c3630 0x7f04e815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-11T19:43:10.923 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ed1dd700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80aef60 0x7f04e8157e70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c960 tx=0x7f04e0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:10.923 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04d57fa700 1 -- 172.21.15.134:0/2481713430 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0004c40 con 0x7f04e80aef60 2022-05-11T19:43:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04d57fa700 1 -- 172.21.15.134:0/2481713430 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e0004de0 con 0x7f04e80aef60 2022-05-11T19:43:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e80c52b0 con 0x7f04e80aef60 2022-05-11T19:43:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.910+0000 7f04d57fa700 1 -- 172.21.15.134:0/2481713430 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e00073a0 con 0x7f04e80aef60 2022-05-11T19:43:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.911+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e80c6820 con 0x7f04e80aef60 2022-05-11T19:43:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.911+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e804c7e0 con 0x7f04e80aef60 2022-05-11T19:43:10.925 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.912+0000 7f04d57fa700 1 -- 172.21.15.134:0/2481713430 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7f04e001a030 con 0x7f04e80aef60 2022-05-11T19:43:10.925 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.912+0000 7f04d57fa700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f04c8063cc0 0x7f04c8066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:10.925 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.912+0000 7f04d57fa700 1 -- 172.21.15.134:0/2481713430 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f04e007f9b0 con 0x7f04e80aef60 2022-05-11T19:43:10.925 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.912+0000 7f04ec9dc700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f04c8063cc0 0x7f04c8066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:10.925 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.913+0000 7f04ec9dc700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f04c8063cc0 0x7f04c8066170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04d8006fd0 tx=0x7f04d8016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:10.916+0000 7f04d57fa700 1 -- 172.21.15.134:0/2481713430 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7f04e004a420 con 0x7f04e80aef60 2022-05-11T19:43:11.093 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.092+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f04e8068440 con 0x7f04e80aef60 2022-05-11T19:43:11.168 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.167+0000 7f04d57fa700 1 -- 172.21.15.134:0/2481713430 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f04e0018070 con 0x7f04e80aef60 2022-05-11T19:43:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f04c8063cc0 msgr2=0x7f04c8066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:11.171 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f04c8063cc0 0x7f04c8066170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04d8006fd0 tx=0x7f04d8016000 comp rx=0 tx=0).stop 2022-05-11T19:43:11.172 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80aef60 msgr2=0x7f04e8157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:11.172 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80aef60 0x7f04e8157e70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c960 tx=0x7f04e0001630 comp rx=0 tx=0).stop 2022-05-11T19:43:11.172 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 shutdown_connections 2022-05-11T19:43:11.172 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f04e80c3630 0x7f04e815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f04c8063cc0 0x7f04c8066170 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04e80aef60 0x7f04e8157e70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 --2- 172.21.15.134:0/2481713430 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f04e80af330 0x7f04e80b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.173 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 >> 172.21.15.134:0/2481713430 conn(0x7f04e80cd500 msgr2=0x7f04e80c72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:11.174 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 shutdown_connections 2022-05-11T19:43:11.174 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.169+0000 7f04ef441700 1 -- 172.21.15.134:0/2481713430 wait complete. 2022-05-11T19:43:11.174 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'rbd' created 2022-05-11T19:43:11.183 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-05-11T19:43:11.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.298+0000 7efd85283700 1 Processor -- start 2022-05-11T19:43:11.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.298+0000 7efd85283700 1 -- start start 2022-05-11T19:43:11.306 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd85283700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 0x7efd800c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd85283700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd800ad300 0x7efd800ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd85283700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7efd800ce9f0 0x7efd800ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd85283700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd80159ef0 con 0x7efd800ad300 2022-05-11T19:43:11.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd85283700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800ad800 con 0x7efd800ce9f0 2022-05-11T19:43:11.308 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd85283700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800adae0 con 0x7efd800b2e10 2022-05-11T19:43:11.308 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7e7fc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd800ad300 0x7efd800ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:11.308 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7e7fc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd800ad300 0x7efd800ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40066/0 (socket says 172.21.15.134:40066) 2022-05-11T19:43:11.308 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7e7fc700 1 -- 172.21.15.134:0/166444843 learned_addr learned my addr 172.21.15.134:0/166444843 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7f7fe700 1 --2- 172.21.15.134:0/166444843 >> v2:172.21.15.166:3300/0 conn(0x7efd800ce9f0 0x7efd800ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7effd700 1 --2- 172.21.15.134:0/166444843 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 0x7efd800c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7e7fc700 1 -- 172.21.15.134:0/166444843 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 msgr2=0x7efd800c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7e7fc700 1 --2- 172.21.15.134:0/166444843 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 0x7efd800c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7e7fc700 1 -- 172.21.15.134:0/166444843 >> v2:172.21.15.166:3300/0 conn(0x7efd800ce9f0 msgr2=0x7efd800ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:11.310 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7e7fc700 1 --2- 172.21.15.134:0/166444843 >> v2:172.21.15.166:3300/0 conn(0x7efd800ce9f0 0x7efd800ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.310 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.299+0000 7efd7e7fc700 1 -- 172.21.15.134:0/166444843 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd800addc0 con 0x7efd800ad300 2022-05-11T19:43:11.310 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd7e7fc700 1 --2- 172.21.15.134:0/166444843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 0x7efd800ce4b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd800681a0 tx=0x7efd700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88185157c8a9a0ef server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:11.310 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd7dffb700 1 -- 172.21.15.134:0/166444843 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70004030 con 0x7efd800ad300 2022-05-11T19:43:11.311 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd7dffb700 1 -- 172.21.15.134:0/166444843 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd700041b0 con 0x7efd800ad300 2022-05-11T19:43:11.311 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd7dffb700 1 -- 172.21.15.134:0/166444843 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70011630 con 0x7efd800ad300 2022-05-11T19:43:11.311 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd85283700 1 -- 172.21.15.134:0/166444843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 msgr2=0x7efd800ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:11.311 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd85283700 1 --2- 172.21.15.134:0/166444843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 0x7efd800ce4b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd800681a0 tx=0x7efd700090f0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.311 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd85283700 1 -- 172.21.15.134:0/166444843 shutdown_connections 2022-05-11T19:43:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd85283700 1 --2- 172.21.15.134:0/166444843 >> v2:172.21.15.166:3300/0 conn(0x7efd800ce9f0 0x7efd800ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd85283700 1 --2- 172.21.15.134:0/166444843 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 0x7efd800c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd85283700 1 --2- 172.21.15.134:0/166444843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 0x7efd800ce4b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd85283700 1 -- 172.21.15.134:0/166444843 >> 172.21.15.134:0/166444843 conn(0x7efd80099bd0 msgr2=0x7efd80063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:11.312 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd85283700 1 -- 172.21.15.134:0/166444843 shutdown_connections 2022-05-11T19:43:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.300+0000 7efd85283700 1 -- 172.21.15.134:0/166444843 wait complete. 2022-05-11T19:43:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.301+0000 7efd85283700 1 Processor -- start 2022-05-11T19:43:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd85283700 1 -- start start 2022-05-11T19:43:11.313 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd85283700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 0x7efd80146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd85283700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 0x7efd800c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd85283700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efd800ce9f0 0x7efd800c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd85283700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8009e390 con 0x7efd800ad300 2022-05-11T19:43:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd85283700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8009d710 con 0x7efd800ce9f0 2022-05-11T19:43:11.314 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd85283700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8009d9f0 con 0x7efd800b2e10 2022-05-11T19:43:11.315 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd7effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 0x7efd80146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:11.315 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd7effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 0x7efd80146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40070/0 (socket says 172.21.15.134:40070) 2022-05-11T19:43:11.315 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd7effd700 1 -- 172.21.15.134:0/3530983264 learned_addr learned my addr 172.21.15.134:0/3530983264 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:11.315 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd7e7fc700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 0x7efd800c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.302+0000 7efd7f7fe700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efd800ce9f0 0x7efd800c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd7effd700 1 -- 172.21.15.134:0/3530983264 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 msgr2=0x7efd800c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd7effd700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 0x7efd800c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd7effd700 1 -- 172.21.15.134:0/3530983264 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efd800ce9f0 msgr2=0x7efd800c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:11.316 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd7effd700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efd800ce9f0 0x7efd800c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd7effd700 1 -- 172.21.15.134:0/3530983264 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009370 con 0x7efd800ad300 2022-05-11T19:43:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd7effd700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 0x7efd80146960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd7400d890 tx=0x7efd74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd66ffd700 1 -- 172.21.15.134:0/3530983264 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd740125f0 con 0x7efd800ad300 2022-05-11T19:43:11.317 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd66ffd700 1 -- 172.21.15.134:0/3530983264 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74012750 con 0x7efd800ad300 2022-05-11T19:43:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8009dcd0 con 0x7efd800ad300 2022-05-11T19:43:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd66ffd700 1 -- 172.21.15.134:0/3530983264 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74012b10 con 0x7efd800ad300 2022-05-11T19:43:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.303+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd80146ea0 con 0x7efd800ad300 2022-05-11T19:43:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.304+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd80147120 con 0x7efd800ad300 2022-05-11T19:43:11.318 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.304+0000 7efd66ffd700 1 -- 172.21.15.134:0/3530983264 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7efd7401e460 con 0x7efd800ad300 2022-05-11T19:43:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.305+0000 7efd66ffd700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7efd60063cc0 0x7efd60066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.305+0000 7efd66ffd700 1 -- 172.21.15.134:0/3530983264 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5195+0+0 (secure 0 0 0) 0x7efd74080ac0 con 0x7efd800ad300 2022-05-11T19:43:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.305+0000 7efd7e7fc700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7efd60063cc0 0x7efd60066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:11.319 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.305+0000 7efd7e7fc700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7efd60063cc0 0x7efd60066170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd70009340 tx=0x7efd70016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:11.320 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.309+0000 7efd66ffd700 1 -- 172.21.15.134:0/3530983264 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7efd7404f9b0 con 0x7efd800ad300 2022-05-11T19:43:11.488 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:11.487+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efd800b2890 con 0x7efd800ad300 2022-05-11T19:43:12.176 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.173+0000 7efd66ffd700 1 -- 172.21.15.134:0/3530983264 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7efd74052fd0 con 0x7efd800ad300 2022-05-11T19:43:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7efd60063cc0 msgr2=0x7efd60066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7efd60063cc0 0x7efd60066170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd70009340 tx=0x7efd70016000 comp rx=0 tx=0).stop 2022-05-11T19:43:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 msgr2=0x7efd80146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.179 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 0x7efd80146960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd7400d890 tx=0x7efd74008040 comp rx=0 tx=0).stop 2022-05-11T19:43:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 shutdown_connections 2022-05-11T19:43:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7efd800ce9f0 0x7efd800c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7efd60063cc0 0x7efd60066170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd800ad300 0x7efd80146960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.180 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 --2- 172.21.15.134:0/3530983264 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7efd800b2e10 0x7efd800c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 >> 172.21.15.134:0/3530983264 conn(0x7efd80099bd0 msgr2=0x7efd800b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 shutdown_connections 2022-05-11T19:43:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.176+0000 7efd85283700 1 -- 172.21.15.134:0/3530983264 wait complete. 2022-05-11T19:43:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rbd' on pool 'rbd' 2022-05-11T19:43:12.194 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-05-11T19:43:12.194 INFO:tasks.ceph.mds.a:Restarting daemon 2022-05-11T19:43:12.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-05-11T19:43:12.197 INFO:tasks.ceph.mds.a:Started 2022-05-11T19:43:12.198 INFO:tasks.ceph.mds.c:Restarting daemon 2022-05-11T19:43:12.198 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-05-11T19:43:12.200 INFO:tasks.ceph.mds.c:Started 2022-05-11T19:43:12.201 INFO:tasks.ceph.mds.b:Restarting daemon 2022-05-11T19:43:12.201 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-05-11T19:43:12.204 INFO:tasks.ceph.mds.b:Started 2022-05-11T19:43:12.204 INFO:tasks.ceph.mds.d:Restarting daemon 2022-05-11T19:43:12.204 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-05-11T19:43:12.207 INFO:tasks.ceph.mds.d:Started 2022-05-11T19:43:12.207 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-05-11T19:43:12.208 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-11T19:43:12.275 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2022-05-11T19:43:12.275 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2022-05-11T19:43:12.287 INFO:tasks.ceph.mds.b.smithi166.stdout:starting mds.b at 2022-05-11T19:43:12.288 INFO:tasks.ceph.mds.d.smithi166.stdout:starting mds.d at 2022-05-11T19:43:12.332 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.329+0000 7f697c893700 1 Processor -- start 2022-05-11T19:43:12.332 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.329+0000 7f697c893700 1 -- start start 2022-05-11T19:43:12.335 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.330+0000 7f697c893700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f6978155a10 0x7f69780688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.335 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.330+0000 7f697c893700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6978068440 con 0x7f697806a610 2022-05-11T19:43:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.330+0000 7f697c893700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6978069270 con 0x7f6978155de0 2022-05-11T19:43:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.330+0000 7f697c893700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780c8740 con 0x7f6978155a10 2022-05-11T19:43:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.330+0000 7f6976d9d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f697806a610 0x7f69780c2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:46956/0 (socket says 172.21.15.134:46956) 2022-05-11T19:43:12.336 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.330+0000 7f6976d9d700 1 -- 172.21.15.134:0/2222473393 learned_addr learned my addr 172.21.15.134:0/2222473393 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:43:12.337 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.330+0000 7f697659c700 1 --2- 172.21.15.134:0/2222473393 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f6978155a10 0x7f69780688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.337 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697559a700 1 -- 172.21.15.134:0/2222473393 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737079138 0 0) 0x7f6978068440 con 0x7f697806a610 2022-05-11T19:43:12.337 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697559a700 1 -- 172.21.15.134:0/2222473393 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f695c0033f0 con 0x7f697806a610 2022-05-11T19:43:12.337 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697559a700 1 -- 172.21.15.134:0/2222473393 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862479251 0 0) 0x7f6978069270 con 0x7f6978155de0 2022-05-11T19:43:12.337 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697659c700 1 -- 172.21.15.134:0/2222473393 >> v1:172.21.15.166:6789/0 conn(0x7f6978155de0 legacy=0x7f69780c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697659c700 1 -- 172.21.15.134:0/2222473393 >> v1:172.21.15.134:6789/0 conn(0x7f697806a610 legacy=0x7f69780c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697659c700 1 -- 172.21.15.134:0/2222473393 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978067b10 con 0x7f6978155a10 2022-05-11T19:43:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697659c700 1 --2- 172.21.15.134:0/2222473393 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f6978155a10 0x7f69780688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6970009e90 tx=0x7f6970009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=437bae3c4bea5d29 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:12.338 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697559a700 1 -- 172.21.15.134:0/2222473393 <== mon.2 v2:172.21.15.166:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000e070 con 0x7f6978155a10 2022-05-11T19:43:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697559a700 1 -- 172.21.15.134:0/2222473393 <== mon.2 v2:172.21.15.166:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697000bc30 con 0x7f6978155a10 2022-05-11T19:43:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.331+0000 7f697559a700 1 -- 172.21.15.134:0/2222473393 <== mon.2 v2:172.21.15.166:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970012430 con 0x7f6978155a10 2022-05-11T19:43:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.332+0000 7f697c893700 1 -- 172.21.15.134:0/2222473393 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f6978155a10 msgr2=0x7f69780688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.332+0000 7f697c893700 1 --2- 172.21.15.134:0/2222473393 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f6978155a10 0x7f69780688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6970009e90 tx=0x7f6970009780 comp rx=0 tx=0).stop 2022-05-11T19:43:12.339 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.332+0000 7f697c893700 1 -- 172.21.15.134:0/2222473393 shutdown_connections 2022-05-11T19:43:12.340 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.332+0000 7f697c893700 1 --2- 172.21.15.134:0/2222473393 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f6978155a10 0x7f69780688d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.340 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.332+0000 7f697c893700 1 -- 172.21.15.134:0/2222473393 >> 172.21.15.134:0/2222473393 conn(0x7f69780cd500 msgr2=0x7f69780c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:12.340 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.332+0000 7f697c893700 1 -- 172.21.15.134:0/2222473393 shutdown_connections 2022-05-11T19:43:12.340 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.332+0000 7f697c893700 1 -- 172.21.15.134:0/2222473393 wait complete. 2022-05-11T19:43:12.340 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.333+0000 7f697c893700 1 Processor -- start 2022-05-11T19:43:12.341 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.333+0000 7f697c893700 1 -- start start 2022-05-11T19:43:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697c893700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f697806a610 0x7f6978146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697c893700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978155a10 0x7f6978153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697c893700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6978155de0 0x7f6978154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697c893700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697816b2a0 con 0x7f6978155a10 2022-05-11T19:43:12.345 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697c893700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697816c100 con 0x7f6978155de0 2022-05-11T19:43:12.345 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697c893700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69781469a0 con 0x7f697806a610 2022-05-11T19:43:12.345 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6975d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978155a10 0x7f6978153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.345 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6975d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978155a10 0x7f6978153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40114/0 (socket says 172.21.15.134:40114) 2022-05-11T19:43:12.345 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6975d9b700 1 -- 172.21.15.134:0/1881185292 learned_addr learned my addr 172.21.15.134:0/1881185292 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:12.346 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697659c700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f697806a610 0x7f6978146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.346 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6976d9d700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6978155de0 0x7f6978154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.346 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6975d9b700 1 -- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f697806a610 msgr2=0x7f6978146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.346 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6975d9b700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f697806a610 0x7f6978146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.346 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6975d9b700 1 -- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6978155de0 msgr2=0x7f6978154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.347 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6975d9b700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6978155de0 0x7f6978154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.347 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6975d9b700 1 -- 172.21.15.134:0/1881185292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009a20 con 0x7f6978155a10 2022-05-11T19:43:12.347 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6976d9d700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6978155de0 0x7f6978154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-11T19:43:12.347 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697659c700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f697806a610 0x7f6978146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-11T19:43:12.348 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f6975d9b700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978155a10 0x7f6978153e50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f696c00c4c0 tx=0x7f696c007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:12.348 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f69667fc700 1 -- 172.21.15.134:0/1881185292 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0052e0 con 0x7f6978155a10 2022-05-11T19:43:12.348 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f69667fc700 1 -- 172.21.15.134:0/1881185292 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c0034c0 con 0x7f6978155a10 2022-05-11T19:43:12.348 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697816b4f0 con 0x7f6978155a10 2022-05-11T19:43:12.348 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f69667fc700 1 -- 172.21.15.134:0/1881185292 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c003880 con 0x7f6978155a10 2022-05-11T19:43:12.349 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.334+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697816bab0 con 0x7f6978155a10 2022-05-11T19:43:12.349 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.335+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69780ca590 con 0x7f6978155a10 2022-05-11T19:43:12.349 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.336+0000 7f69667fc700 1 -- 172.21.15.134:0/1881185292 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7f696c019030 con 0x7f6978155a10 2022-05-11T19:43:12.349 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.336+0000 7f69667fc700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f6954063cc0 0x7f6954066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.349 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.336+0000 7f69667fc700 1 -- 172.21.15.134:0/1881185292 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f696c07f760 con 0x7f6978155a10 2022-05-11T19:43:12.350 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.336+0000 7f697659c700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f6954063cc0 0x7f6954066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.350 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.336+0000 7f697659c700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f6954063cc0 0x7f6954066170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6970009de0 tx=0x7f6970019000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:12.350 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.340+0000 7f69667fc700 1 -- 172.21.15.134:0/1881185292 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7f696c04e6a0 con 0x7f6978155a10 2022-05-11T19:43:12.518 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.515+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69780c8470 con 0x7f6978155a10 2022-05-11T19:43:12.519 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.516+0000 7f69667fc700 1 -- 172.21.15.134:0/1881185292 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13804 (secure 0 0 0) 0x7f696c017030 con 0x7f6978155a10 2022-05-11T19:43:12.519 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:43:12.519 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":19,"fsid":"ccb62be3-03e9-4327-8bbc-0e532a97b11c","created":"2022-05-11T19:42:52.825477+0000","modified":"2022-05-11T19:43:12.163801+0000","last_up_change":"2022-05-11T19:43:04.020564+0000","last_in_change":"2022-05-11T19:42:55.219204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-11T19:43:06.032854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-11T19:43:11.109880+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"56e1cfec-aefb-4fe9-b5a7-b6dda26a7f5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":122590},{"type":"v1","addr":"172.21.15.134:6801","nonce":122590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":122590},{"type":"v1","addr":"172.21.15.134:6803","nonce":122590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":122590},{"type":"v1","addr":"172.21.15.134:6807","nonce":122590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":122590},{"type":"v1","addr":"172.21.15.134:6805","nonce":122590}]},"public_addr":"172.21.15.134:6801/122590","cluster_addr":"172.21.15.134:6803/122590","heartbeat_back_addr":"172.21.15.134:6807/122590","heartbeat_front_addr":"172.21.15.134:6805/122590","state":["exists","up"]},{"osd":1,"uuid":"d2a3acee-ede6-47f8-81c4-7e019143a485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":122589},{"type":"v1","addr":"172.21.15.134:6809","nonce":122589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":122589},{"type":"v1","addr":"172.21.15.134:6811","nonce":122589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":122589},{"type":"v1","addr":"172.21.15.134:6815","nonce":122589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":122589},{"type":"v1","addr":"172.21.15.134:6813","nonce":122589}]},"public_addr":"172.21.15.134:6809/122589","cluster_addr":"172.21.15.134:6811/122589","heartbeat_back_addr":"172.21.15.134:6815/122589","heartbeat_front_addr":"172.21.15.134:6813/122589","state":["exists","up"]},{"osd":2,"uuid":"ef94ace6-f5aa-4572-838b-d92a62fd6f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":122592},{"type":"v1","addr":"172.21.15.134:6819","nonce":122592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":122592},{"type":"v1","addr":"172.21.15.134:6823","nonce":122592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":122592},{"type":"v1","addr":"172.21.15.134:6831","nonce":122592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":122592},{"type":"v1","addr":"172.21.15.134:6827","nonce":122592}]},"public_addr":"172.21.15.134:6819/122592","cluster_addr":"172.21.15.134:6823/122592","heartbeat_back_addr":"172.21.15.134:6831/122592","heartbeat_front_addr":"172.21.15.134:6827/122592","state":["exists","up"]},{"osd":3,"uuid":"fa809b81-371a-4ab7-a648-0f1a5641d33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":122591},{"type":"v1","addr":"172.21.15.134:6818","nonce":122591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":122591},{"type":"v1","addr":"172.21.15.134:6822","nonce":122591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":122591},{"type":"v1","addr":"172.21.15.134:6830","nonce":122591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":122591},{"type":"v1","addr":"172.21.15.134:6826","nonce":122591}]},"public_addr":"172.21.15.134:6818/122591","cluster_addr":"172.21.15.134:6822/122591","heartbeat_back_addr":"172.21.15.134:6830/122591","heartbeat_front_addr":"172.21.15.134:6826/122591","state":["exists","up"]},{"osd":4,"uuid":"b95f28ff-6fab-44f1-a8d8-ba925d4c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6800","nonce":122910},{"type":"v1","addr":"172.21.15.166:6801","nonce":122910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":122910},{"type":"v1","addr":"172.21.15.166:6803","nonce":122910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":122910},{"type":"v1","addr":"172.21.15.166:6807","nonce":122910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":122910},{"type":"v1","addr":"172.21.15.166:6805","nonce":122910}]},"public_addr":"172.21.15.166:6801/122910","cluster_addr":"172.21.15.166:6803/122910","heartbeat_back_addr":"172.21.15.166:6807/122910","heartbeat_front_addr":"172.21.15.166:6805/122910","state":["exists","up"]},{"osd":5,"uuid":"dc4d2a03-2b7d-4e90-a1ea-cafef55b6fa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":122925},{"type":"v1","addr":"172.21.15.166:6817","nonce":122925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":122925},{"type":"v1","addr":"172.21.15.166:6819","nonce":122925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":122925},{"type":"v1","addr":"172.21.15.166:6827","nonce":122925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":122925},{"type":"v1","addr":"172.21.15.166:6823","nonce":122925}]},"public_addr":"172.21.15.166:6817/122925","cluster_addr":"172.21.15.166:6819/122925","heartbeat_back_addr":"172.21.15.166:6827/122925","heartbeat_front_addr":"172.21.15.166:6823/122925","state":["exists","up"]},{"osd":6,"uuid":"020f0004-538e-44cd-88be-e899baf94d29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":122911},{"type":"v1","addr":"172.21.15.166:6809","nonce":122911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":122911},{"type":"v1","addr":"172.21.15.166:6811","nonce":122911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":122911},{"type":"v1","addr":"172.21.15.166:6815","nonce":122911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":122911},{"type":"v1","addr":"172.21.15.166:6813","nonce":122911}]},"public_addr":"172.21.15.166:6809/122911","cluster_addr":"172.21.15.166:6811/122911","heartbeat_back_addr":"172.21.15.166:6815/122911","heartbeat_front_addr":"172.21.15.166:6813/122911","state":["exists","up"]},{"osd":7,"uuid":"6f9faa65-8da9-441c-b260-430f2b0621fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":122912},{"type":"v1","addr":"172.21.15.166:6822","nonce":122912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":122912},{"type":"v1","addr":"172.21.15.166:6826","nonce":122912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6830","nonce":122912},{"type":"v1","addr":"172.21.15.166:6831","nonce":122912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":122912},{"type":"v1","addr":"172.21.15.166:6829","nonce":122912}]},"public_addr":"172.21.15.166:6822/122912","cluster_addr":"172.21.15.166:6826/122912","heartbeat_back_addr":"172.21.15.166:6831/122912","heartbeat_front_addr":"172.21.15.166:6829/122912","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.126431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.489364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.420767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.383215+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.380408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.423371+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.453214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.461833+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-11T19:43:12.521 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f6954063cc0 msgr2=0x7f6954066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.521 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f6954063cc0 0x7f6954066170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6970009de0 tx=0x7f6970019000 comp rx=0 tx=0).stop 2022-05-11T19:43:12.521 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978155a10 msgr2=0x7f6978153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.521 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978155a10 0x7f6978153e50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f696c00c4c0 tx=0x7f696c007d70 comp rx=0 tx=0).stop 2022-05-11T19:43:12.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 shutdown_connections 2022-05-11T19:43:12.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f6978155de0 0x7f6978154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f697806a610 0x7f6978146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f6954063cc0 0x7f6954066170 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 --2- 172.21.15.134:0/1881185292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978155a10 0x7f6978153e50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.523 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 >> 172.21.15.134:0/1881185292 conn(0x7f69780cd500 msgr2=0x7f69780b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:12.523 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 shutdown_connections 2022-05-11T19:43:12.523 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.518+0000 7f697c893700 1 -- 172.21.15.134:0/1881185292 wait complete. 2022-05-11T19:43:12.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-05-11T19:43:06.032854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-05-11T19:43:11.109880+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-05-11T19:43:12.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-05-11T19:43:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.648+0000 7f8bccfbf700 1 Processor -- start 2022-05-11T19:43:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.648+0000 7f8bccfbf700 1 -- start start 2022-05-11T19:43:12.654 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.649+0000 7f8bccfbf700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8bc80c3d80 0x7f8bc806f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.654 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.649+0000 7f8bccfbf700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc80c28e0 con 0x7f8bc8156300 2022-05-11T19:43:12.654 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.649+0000 7f8bccfbf700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc806f9a0 con 0x7f8bc806b480 2022-05-11T19:43:12.655 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.649+0000 7f8bccfbf700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc806fc80 con 0x7f8bc80c3d80 2022-05-11T19:43:12.655 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.649+0000 7f8bc6d9d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8bc80c3d80 0x7f8bc806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.655 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.649+0000 7f8bc659c700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8bc8156300 0x7f8bc806ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:46966/0 (socket says 172.21.15.134:46966) 2022-05-11T19:43:12.655 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.649+0000 7f8bc659c700 1 -- 172.21.15.134:0/685050398 learned_addr learned my addr 172.21.15.134:0/685050398 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:43:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bc6d9d700 1 -- 172.21.15.134:0/685050398 >> v1:172.21.15.166:6789/0 conn(0x7f8bc806b480 legacy=0x7f8bc806ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bc6d9d700 1 -- 172.21.15.134:0/685050398 >> v1:172.21.15.134:6789/0 conn(0x7f8bc8156300 legacy=0x7f8bc806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bc559a700 1 -- 172.21.15.134:0/685050398 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055355798 0 0) 0x7f8bc80c28e0 con 0x7f8bc8156300 2022-05-11T19:43:12.656 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bc6d9d700 1 -- 172.21.15.134:0/685050398 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc80c2290 con 0x7f8bc80c3d80 2022-05-11T19:43:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bc6d9d700 1 --2- 172.21.15.134:0/685050398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc80c3d80 0x7f8bc806f380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009e60 tx=0x7f8bc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759f651a10d14869 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bc559a700 1 -- 172.21.15.134:0/685050398 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc000e070 con 0x7f8bc80c3d80 2022-05-11T19:43:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bc559a700 1 -- 172.21.15.134:0/685050398 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc000bc30 con 0x7f8bc80c3d80 2022-05-11T19:43:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bc559a700 1 -- 172.21.15.134:0/685050398 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0012430 con 0x7f8bc80c3d80 2022-05-11T19:43:12.657 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bccfbf700 1 -- 172.21.15.134:0/685050398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc80c3d80 msgr2=0x7f8bc806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.658 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bccfbf700 1 --2- 172.21.15.134:0/685050398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc80c3d80 0x7f8bc806f380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009e60 tx=0x7f8bc0009780 comp rx=0 tx=0).stop 2022-05-11T19:43:12.658 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.650+0000 7f8bccfbf700 1 -- 172.21.15.134:0/685050398 shutdown_connections 2022-05-11T19:43:12.658 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.651+0000 7f8bccfbf700 1 --2- 172.21.15.134:0/685050398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc80c3d80 0x7f8bc806f380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.658 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.651+0000 7f8bccfbf700 1 -- 172.21.15.134:0/685050398 >> 172.21.15.134:0/685050398 conn(0x7f8bc8069610 msgr2=0x7f8bc80cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.651+0000 7f8bccfbf700 1 -- 172.21.15.134:0/685050398 shutdown_connections 2022-05-11T19:43:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.651+0000 7f8bccfbf700 1 -- 172.21.15.134:0/685050398 wait complete. 2022-05-11T19:43:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.652+0000 7f8bccfbf700 1 Processor -- start 2022-05-11T19:43:12.659 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.652+0000 7f8bccfbf700 1 -- start start 2022-05-11T19:43:12.663 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.652+0000 7f8bccfbf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc806b480 0x7f8bc81502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.663 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.652+0000 7f8bccfbf700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8bc80c3d80 0x7f8bc8067a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.663 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.652+0000 7f8bccfbf700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8bc8156300 0x7f8bc8067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.663 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.652+0000 7f8bccfbf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc8157480 con 0x7f8bc806b480 2022-05-11T19:43:12.664 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.652+0000 7f8bccfbf700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc8156870 con 0x7f8bc8156300 2022-05-11T19:43:12.664 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.652+0000 7f8bccfbf700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc8156b50 con 0x7f8bc80c3d80 2022-05-11T19:43:12.664 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc806b480 0x7f8bc81502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.664 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc806b480 0x7f8bc81502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40124/0 (socket says 172.21.15.134:40124) 2022-05-11T19:43:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc659c700 1 -- 172.21.15.134:0/262317786 learned_addr learned my addr 172.21.15.134:0/262317786 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc6d9d700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8bc8156300 0x7f8bc8067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc5d9b700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8bc80c3d80 0x7f8bc8067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc659c700 1 -- 172.21.15.134:0/262317786 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8bc80c3d80 msgr2=0x7f8bc8067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc659c700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8bc80c3d80 0x7f8bc8067a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.666 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc659c700 1 -- 172.21.15.134:0/262317786 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8bc8156300 msgr2=0x7f8bc8067fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.666 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc659c700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8bc8156300 0x7f8bc8067fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.666 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc659c700 1 -- 172.21.15.134:0/262317786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009a20 con 0x7f8bc806b480 2022-05-11T19:43:12.666 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc5d9b700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8bc80c3d80 0x7f8bc8067a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-11T19:43:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bc659c700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc806b480 0x7f8bc81502c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c440 tx=0x7f8bbc007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bb67fc700 1 -- 172.21.15.134:0/262317786 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc007360 con 0x7f8bc806b480 2022-05-11T19:43:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bb67fc700 1 -- 172.21.15.134:0/262317786 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc0074c0 con 0x7f8bc806b480 2022-05-11T19:43:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bb67fc700 1 -- 172.21.15.134:0/262317786 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc004900 con 0x7f8bc806b480 2022-05-11T19:43:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc8156e30 con 0x7f8bc806b480 2022-05-11T19:43:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.653+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc8150800 con 0x7f8bc806b480 2022-05-11T19:43:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.654+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc8157760 con 0x7f8bc806b480 2022-05-11T19:43:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.655+0000 7f8bb67fc700 1 -- 172.21.15.134:0/262317786 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7f8bbc010030 con 0x7f8bc806b480 2022-05-11T19:43:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.655+0000 7f8bb67fc700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8ba4063cc0 0x7f8ba4066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.669 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.655+0000 7f8bb67fc700 1 -- 172.21.15.134:0/262317786 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8bbc07ffa0 con 0x7f8bc806b480 2022-05-11T19:43:12.669 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.655+0000 7f8bc5d9b700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8ba4063cc0 0x7f8ba4066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.669 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.655+0000 7f8bc5d9b700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8ba4063cc0 0x7f8ba4066170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bc81596d0 tx=0x7f8bb8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:12.669 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.659+0000 7f8bb67fc700 1 -- 172.21.15.134:0/262317786 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7f8bbc04ef60 con 0x7f8bc806b480 2022-05-11T19:43:12.835 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.832+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bc804c7e0 con 0x7f8bc806b480 2022-05-11T19:43:12.836 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.833+0000 7f8bb67fc700 1 -- 172.21.15.134:0/262317786 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bbc004cb0 con 0x7f8bc806b480 2022-05-11T19:43:12.836 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2022-05-11T19:43:12.837 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8ba4063cc0 msgr2=0x7f8ba4066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.838 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8ba4063cc0 0x7f8ba4066170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bc81596d0 tx=0x7f8bb8009040 comp rx=0 tx=0).stop 2022-05-11T19:43:12.838 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc806b480 msgr2=0x7f8bc81502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.838 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc806b480 0x7f8bc81502c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c440 tx=0x7f8bbc007d90 comp rx=0 tx=0).stop 2022-05-11T19:43:12.839 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 shutdown_connections 2022-05-11T19:43:12.839 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8bc8156300 0x7f8bc8067fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.839 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8ba4063cc0 0x7f8ba4066170 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.839 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bc806b480 0x7f8bc81502c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.839 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 --2- 172.21.15.134:0/262317786 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8bc80c3d80 0x7f8bc8067a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.840 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 >> 172.21.15.134:0/262317786 conn(0x7f8bc8069610 msgr2=0x7f8bc80b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:12.840 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 shutdown_connections 2022-05-11T19:43:12.840 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.835+0000 7f8bccfbf700 1 -- 172.21.15.134:0/262317786 wait complete. 2022-05-11T19:43:12.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-05-11T19:43:12.967 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.964+0000 7ff6d167b700 1 Processor -- start 2022-05-11T19:43:12.967 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.964+0000 7ff6d167b700 1 -- start start 2022-05-11T19:43:12.970 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6d167b700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7ff6cc1562c0 0x7ff6cc156690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6d167b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6cc0c9430 0x7ff6cc06ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6d167b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc06bdd0 con 0x7ff6cc15ae50 2022-05-11T19:43:12.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6d167b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc15a9c0 con 0x7ff6cc0c9430 2022-05-11T19:43:12.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6d167b700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc0c9900 con 0x7ff6cc1562c0 2022-05-11T19:43:12.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6cb7fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6cc0c9430 0x7ff6cc06ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.972 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6ca7fc700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff6cc15ae50 0x7ff6cc0c8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:46978/0 (socket says 172.21.15.134:46978) 2022-05-11T19:43:12.972 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6ca7fc700 1 -- 172.21.15.134:0/464625977 learned_addr learned my addr 172.21.15.134:0/464625977 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:43:12.972 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6caffd700 1 --2- 172.21.15.134:0/464625977 >> v2:172.21.15.166:3300/0 conn(0x7ff6cc1562c0 0x7ff6cc156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.972 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6cb7fe700 1 -- 172.21.15.134:0/464625977 >> v2:172.21.15.166:3300/0 conn(0x7ff6cc1562c0 msgr2=0x7ff6cc156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:12.973 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6cb7fe700 1 --2- 172.21.15.134:0/464625977 >> v2:172.21.15.166:3300/0 conn(0x7ff6cc1562c0 0x7ff6cc156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.973 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6cb7fe700 1 -- 172.21.15.134:0/464625977 >> v1:172.21.15.134:6789/0 conn(0x7ff6cc15ae50 legacy=0x7ff6cc0c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.973 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6cb7fe700 1 -- 172.21.15.134:0/464625977 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc15a370 con 0x7ff6cc0c9430 2022-05-11T19:43:12.973 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.965+0000 7ff6c9ffb700 1 -- 172.21.15.134:0/464625977 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467900146 0 0) 0x7ff6cc06bdd0 con 0x7ff6cc15ae50 2022-05-11T19:43:12.974 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6cb7fe700 1 --2- 172.21.15.134:0/464625977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc0c9430 0x7ff6cc06ad70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc06db40 tx=0x7ff6c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7269fbf74e9439a6 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:12.974 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6c9ffb700 1 -- 172.21.15.134:0/464625977 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c400e070 con 0x7ff6cc0c9430 2022-05-11T19:43:12.974 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6c9ffb700 1 -- 172.21.15.134:0/464625977 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c400bcc0 con 0x7ff6cc0c9430 2022-05-11T19:43:12.974 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6c9ffb700 1 -- 172.21.15.134:0/464625977 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4012680 con 0x7ff6cc0c9430 2022-05-11T19:43:12.975 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6d167b700 1 -- 172.21.15.134:0/464625977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc0c9430 msgr2=0x7ff6cc06ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.975 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6d167b700 1 --2- 172.21.15.134:0/464625977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc0c9430 0x7ff6cc06ad70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc06db40 tx=0x7ff6c4009780 comp rx=0 tx=0).stop 2022-05-11T19:43:12.975 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6d167b700 1 -- 172.21.15.134:0/464625977 shutdown_connections 2022-05-11T19:43:12.975 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6d167b700 1 --2- 172.21.15.134:0/464625977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc0c9430 0x7ff6cc06ad70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.975 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6d167b700 1 --2- 172.21.15.134:0/464625977 >> v2:172.21.15.166:3300/0 conn(0x7ff6cc1562c0 0x7ff6cc156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.976 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6d167b700 1 -- 172.21.15.134:0/464625977 >> 172.21.15.134:0/464625977 conn(0x7ff6cc069610 msgr2=0x7ff6cc0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:12.976 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6d167b700 1 -- 172.21.15.134:0/464625977 shutdown_connections 2022-05-11T19:43:12.976 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.966+0000 7ff6d167b700 1 -- 172.21.15.134:0/464625977 wait complete. 2022-05-11T19:43:12.976 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.968+0000 7ff6d167b700 1 Processor -- start 2022-05-11T19:43:12.976 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.968+0000 7ff6d167b700 1 -- start start 2022-05-11T19:43:12.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6d167b700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff6cc0c9430 0x7ff6cc150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6d167b700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff6cc1562c0 0x7ff6cc0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6d167b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc15ae50 0x7ff6cc0c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6d167b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0c56f0 con 0x7ff6cc15ae50 2022-05-11T19:43:12.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6d167b700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc150570 con 0x7ff6cc0c9430 2022-05-11T19:43:12.981 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6d167b700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc157bf0 con 0x7ff6cc1562c0 2022-05-11T19:43:12.981 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6cb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc15ae50 0x7ff6cc0c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.981 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6cb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc15ae50 0x7ff6cc0c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40140/0 (socket says 172.21.15.134:40140) 2022-05-11T19:43:12.981 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6cb7fe700 1 -- 172.21.15.134:0/2734263135 learned_addr learned my addr 172.21.15.134:0/2734263135 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:12.982 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6ca7fc700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff6cc1562c0 0x7ff6cc0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.982 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6cb7fe700 1 -- 172.21.15.134:0/2734263135 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff6cc1562c0 msgr2=0x7ff6cc0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.982 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6cb7fe700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff6cc1562c0 0x7ff6cc0c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.982 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6cb7fe700 1 -- 172.21.15.134:0/2734263135 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff6cc0c9430 msgr2=0x7ff6cc150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:12.982 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6cb7fe700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff6cc0c9430 0x7ff6cc150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6cb7fe700 1 -- 172.21.15.134:0/2734263135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4009a20 con 0x7ff6cc15ae50 2022-05-11T19:43:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.969+0000 7ff6cb7fe700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc15ae50 0x7ff6cc0c4870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4013000 tx=0x7ff6c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.970+0000 7ff6b2ffd700 1 -- 172.21.15.134:0/2734263135 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4003a70 con 0x7ff6cc15ae50 2022-05-11T19:43:12.983 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.970+0000 7ff6b2ffd700 1 -- 172.21.15.134:0/2734263135 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c4003bf0 con 0x7ff6cc15ae50 2022-05-11T19:43:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.970+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc157ed0 con 0x7ff6cc15ae50 2022-05-11T19:43:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.970+0000 7ff6b2ffd700 1 -- 172.21.15.134:0/2734263135 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4004040 con 0x7ff6cc15ae50 2022-05-11T19:43:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.970+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc158490 con 0x7ff6cc15ae50 2022-05-11T19:43:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.971+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc152970 con 0x7ff6cc15ae50 2022-05-11T19:43:12.984 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.971+0000 7ff6b2ffd700 1 -- 172.21.15.134:0/2734263135 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7ff6c40043f0 con 0x7ff6cc15ae50 2022-05-11T19:43:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.971+0000 7ff6b2ffd700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff6ac063cc0 0x7ff6ac066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.971+0000 7ff6b2ffd700 1 -- 172.21.15.134:0/2734263135 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff6c4082fb0 con 0x7ff6cc15ae50 2022-05-11T19:43:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.971+0000 7ff6caffd700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff6ac063cc0 0x7ff6ac066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.972+0000 7ff6caffd700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff6ac063cc0 0x7ff6ac066170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000b8f0 tx=0x7ff6c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:12.985 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:12.976+0000 7ff6b2ffd700 1 -- 172.21.15.134:0/2734263135 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7ff6c4051ef0 con 0x7ff6cc15ae50 2022-05-11T19:43:13.155 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.153+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff6cc04c810 con 0x7ff6cc15ae50 2022-05-11T19:43:13.156 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.153+0000 7ff6b2ffd700 1 -- 172.21.15.134:0/2734263135 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff6c4055510 con 0x7ff6cc15ae50 2022-05-11T19:43:13.156 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 8 2022-05-11T19:43:13.158 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff6ac063cc0 msgr2=0x7ff6ac066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.158 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff6ac063cc0 0x7ff6ac066170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000b8f0 tx=0x7ff6c0008040 comp rx=0 tx=0).stop 2022-05-11T19:43:13.158 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc15ae50 msgr2=0x7ff6cc0c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.159 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc15ae50 0x7ff6cc0c4870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4013000 tx=0x7ff6c4019000 comp rx=0 tx=0).stop 2022-05-11T19:43:13.159 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 shutdown_connections 2022-05-11T19:43:13.159 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff6ac063cc0 0x7ff6ac066170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.159 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6cc15ae50 0x7ff6cc0c4870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.160 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff6cc0c9430 0x7ff6cc150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.160 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 --2- 172.21.15.134:0/2734263135 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff6cc1562c0 0x7ff6cc0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.160 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 >> 172.21.15.134:0/2734263135 conn(0x7ff6cc069610 msgr2=0x7ff6cc0ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:13.160 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 shutdown_connections 2022-05-11T19:43:13.160 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.155+0000 7ff6d167b700 1 -- 172.21.15.134:0/2734263135 wait complete. 2022-05-11T19:43:13.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-05-11T19:43:13.285 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.282+0000 7f80fc7c2700 1 Processor -- start 2022-05-11T19:43:13.285 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.282+0000 7f80fc7c2700 1 -- start start 2022-05-11T19:43:13.292 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.283+0000 7f80fc7c2700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f40aef60 0x7f80f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.292 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.283+0000 7f80fc7c2700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f40c2d10 con 0x7f80f40c3630 2022-05-11T19:43:13.292 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.283+0000 7f80fc7c2700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f4068ea0 con 0x7f80f40af330 2022-05-11T19:43:13.293 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.283+0000 7f80fc7c2700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4067ba0 con 0x7f80f40aef60 2022-05-11T19:43:13.293 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.283+0000 7f80f9d5d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f80f40c3630 0x7f80f40c2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:46990/0 (socket says 172.21.15.134:46990) 2022-05-11T19:43:13.293 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.283+0000 7f80f9d5d700 1 -- 172.21.15.134:0/517945406 learned_addr learned my addr 172.21.15.134:0/517945406 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:43:13.293 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.283+0000 7f80fa55e700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f40aef60 0x7f80f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.293 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156655753 0 0) 0x7f80f40c2d10 con 0x7f80f40c3630 2022-05-11T19:43:13.294 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80dc0033f0 con 0x7f80f40c3630 2022-05-11T19:43:13.294 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670299681 0 0) 0x7f80f4068ea0 con 0x7f80f40af330 2022-05-11T19:43:13.294 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f40c2d10 con 0x7f80f40af330 2022-05-11T19:43:13.294 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4229747509 0 0) 0x7f80dc0033f0 con 0x7f80f40c3630 2022-05-11T19:43:13.295 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f40aef60 msgr2=0x7f80f4068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:13.295 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f40aef60 0x7f80f4068960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.295 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 >> v1:172.21.15.166:6789/0 conn(0x7f80f40af330 legacy=0x7f80f40c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.295 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f4067e80 con 0x7f80f40c3630 2022-05-11T19:43:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 667751508 0 0) 0x7f80f0001470 con 0x7f80f40c3630 2022-05-11T19:43:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 >> v1:172.21.15.134:6789/0 conn(0x7f80f40c3630 legacy=0x7f80f40c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80dc003aa0 0x7f80dc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.296 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc004690 0x7f80dc004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80dc005040 0x7f80dc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4067ba0 con 0x7f80dc005040 2022-05-11T19:43:13.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc00c030 con 0x7f80dc004690 2022-05-11T19:43:13.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc00c1f0 con 0x7f80dc003aa0 2022-05-11T19:43:13.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80fa55e700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f40aef60 0x7f80f4068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-05-11T19:43:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80fad5f700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80dc005040 0x7f80dc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80f9d5d700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc004690 0x7f80dc004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80fa55e700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80dc003aa0 0x7f80dc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.298 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80fad5f700 1 -- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80dc003aa0 msgr2=0x7f80dc003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80fad5f700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80dc003aa0 0x7f80dc003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80fad5f700 1 -- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc004690 msgr2=0x7f80dc004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80fad5f700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc004690 0x7f80dc004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80fad5f700 1 -- 172.21.15.134:0/517945406 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0033f0 con 0x7f80dc005040 2022-05-11T19:43:13.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.284+0000 7f80fad5f700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80dc005040 0x7f80dc00b8e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f80ec001f90 tx=0x7f80ec007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b9987b14adc103 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:13.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0020f0 con 0x7f80dc005040 2022-05-11T19:43:13.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec0018a0 con 0x7f80dc005040 2022-05-11T19:43:13.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80f955c700 1 -- 172.21.15.134:0/517945406 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00cae0 con 0x7f80dc005040 2022-05-11T19:43:13.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80fc7c2700 1 -- 172.21.15.134:0/517945406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80dc005040 msgr2=0x7f80dc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80fc7c2700 1 --2- 172.21.15.134:0/517945406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80dc005040 0x7f80dc00b8e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f80ec001f90 tx=0x7f80ec007f10 comp rx=0 tx=0).stop 2022-05-11T19:43:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80fad5f700 1 -- 172.21.15.134:0/517945406 reap_dead start 2022-05-11T19:43:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80fc7c2700 1 -- 172.21.15.134:0/517945406 shutdown_connections 2022-05-11T19:43:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80fc7c2700 1 -- 172.21.15.134:0/517945406 >> 172.21.15.134:0/517945406 conn(0x7f80f40cd500 msgr2=0x7f80f40c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80fc7c2700 1 -- 172.21.15.134:0/517945406 shutdown_connections 2022-05-11T19:43:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.285+0000 7f80fc7c2700 1 -- 172.21.15.134:0/517945406 wait complete. 2022-05-11T19:43:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.286+0000 7f80fc7c2700 1 Processor -- start 2022-05-11T19:43:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.287+0000 7f80fc7c2700 1 -- start start 2022-05-11T19:43:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.287+0000 7f80fc7c2700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc005040 0x7f80f4145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.287+0000 7f80fc7c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4142a50 0x7f80f40b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.287+0000 7f80fc7c2700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f4142ec0 0x7f80f40b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.287+0000 7f80fc7c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f41575e0 con 0x7f80f4142a50 2022-05-11T19:43:13.303 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.287+0000 7f80fc7c2700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4143f70 con 0x7f80dc005040 2022-05-11T19:43:13.304 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.287+0000 7f80fc7c2700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4145aa0 con 0x7f80f4142ec0 2022-05-11T19:43:13.304 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fa55e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc005040 0x7f80f4145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.304 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fa55e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc005040 0x7f80f4145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.166:3300/0 says I am v2:172.21.15.134:54182/0 (socket says 172.21.15.134:54182) 2022-05-11T19:43:13.304 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fa55e700 1 -- 172.21.15.134:0/3440356179 learned_addr learned my addr 172.21.15.134:0/3440356179 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80f9d5d700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4142a50 0x7f80f40b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fad5f700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f4142ec0 0x7f80f40b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fa55e700 1 -- 172.21.15.134:0/3440356179 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f4142ec0 msgr2=0x7f80f40b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fa55e700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f4142ec0 0x7f80f40b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fa55e700 1 -- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4142a50 msgr2=0x7f80f40b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fa55e700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4142a50 0x7f80f40b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fa55e700 1 -- 172.21.15.134:0/3440356179 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f4143360 con 0x7f80dc005040 2022-05-11T19:43:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fad5f700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f4142ec0 0x7f80f40b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-05-11T19:43:13.306 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80fa55e700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc005040 0x7f80f4145560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f80e4011690 tx=0x7f80e4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.288+0000 7f80e27fc700 1 -- 172.21.15.134:0/3440356179 <== mon.1 v2:172.21.15.166:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4015670 con 0x7f80dc005040 2022-05-11T19:43:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.289+0000 7f80e27fc700 1 -- 172.21.15.134:0/3440356179 <== mon.1 v2:172.21.15.166:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e40157d0 con 0x7f80dc005040 2022-05-11T19:43:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.289+0000 7f80e27fc700 1 -- 172.21.15.134:0/3440356179 <== mon.1 v2:172.21.15.166:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4015b90 con 0x7f80dc005040 2022-05-11T19:43:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.289+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f4143640 con 0x7f80dc005040 2022-05-11T19:43:13.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.289+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f4143c00 con 0x7f80dc005040 2022-05-11T19:43:13.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.290+0000 7f80e27fc700 1 -- 172.21.15.134:0/3440356179 <== mon.1 v2:172.21.15.166:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7f80e401b030 con 0x7f80dc005040 2022-05-11T19:43:13.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.290+0000 7f80e27fc700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f80d4063cc0 0x7f80d4066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.291+0000 7f80e27fc700 1 -- 172.21.15.134:0/3440356179 <== mon.1 v2:172.21.15.166:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f80e4080650 con 0x7f80dc005040 2022-05-11T19:43:13.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.291+0000 7f80f9d5d700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f80d4063cc0 0x7f80d4066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.310 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.291+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f4068820 con 0x7f80dc005040 2022-05-11T19:43:13.310 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.291+0000 7f80f9d5d700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f80d4063cc0 0x7f80d4066170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80f40c5b20 tx=0x7f80f0001dd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:13.310 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.296+0000 7f80e27fc700 1 -- 172.21.15.134:0/3440356179 <== mon.1 v2:172.21.15.166:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7f80e4023080 con 0x7f80dc005040 2022-05-11T19:43:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.515+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80f415e280 con 0x7f80dc005040 2022-05-11T19:43:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.516+0000 7f80e27fc700 1 -- 172.21.15.134:0/3440356179 <== mon.1 v2:172.21.15.166:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f80e4019020 con 0x7f80dc005040 2022-05-11T19:43:13.518 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:43:13.519 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/752166882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6835","nonce":752166882},{"type":"v1","addr":"172.21.15.134:6837","nonce":752166882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.166:6835/1653784214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6833","nonce":1653784214},{"type":"v1","addr":"172.21.15.166:6835","nonce":1653784214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6836/2803965475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":2803965475},{"type":"v1","addr":"172.21.15.134:6836","nonce":2803965475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.166:6834/1644366537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6832","nonce":1644366537},{"type":"v1","addr":"172.21.15.166:6834","nonce":1644366537}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-05-11T19:43:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f80d4063cc0 msgr2=0x7f80d4066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f80d4063cc0 0x7f80d4066170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80f40c5b20 tx=0x7f80f0001dd0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.521 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc005040 msgr2=0x7f80f4145560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc005040 0x7f80f4145560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f80e4011690 tx=0x7f80e4008040 comp rx=0 tx=0).stop 2022-05-11T19:43:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 shutdown_connections 2022-05-11T19:43:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f80f4142ec0 0x7f80f40b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.522 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f80dc005040 0x7f80f4145560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.523 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f80d4063cc0 0x7f80d4066170 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.523 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 --2- 172.21.15.134:0/3440356179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4142a50 0x7f80f40b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.523 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 >> 172.21.15.134:0/3440356179 conn(0x7f80f40cd500 msgr2=0x7f80f4157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:13.523 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 shutdown_connections 2022-05-11T19:43:13.524 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.518+0000 7f80fc7c2700 1 -- 172.21.15.134:0/3440356179 wait complete. 2022-05-11T19:43:13.524 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 3 2022-05-11T19:43:13.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-11T19:43:13.646 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.644+0000 7ff7c8fe7700 1 Processor -- start 2022-05-11T19:43:13.647 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.644+0000 7ff7c8fe7700 1 -- start start 2022-05-11T19:43:13.653 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c8fe7700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7ff7c415a0d0 0x7ff7c40c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.654 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c8fe7700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7c40c4e20 0x7ff7c415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.654 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c8fe7700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c4069440 con 0x7ff7c415a9e0 2022-05-11T19:43:13.654 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c8fe7700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c4159be0 con 0x7ff7c40c4e20 2022-05-11T19:43:13.654 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c8fe7700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c40c9320 con 0x7ff7c415a0d0 2022-05-11T19:43:13.655 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c1d9b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7c40c4e20 0x7ff7c415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.655 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c2d9d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff7c415a9e0 0x7ff7c406be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47016/0 (socket says 172.21.15.134:47016) 2022-05-11T19:43:13.655 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c2d9d700 1 -- 172.21.15.134:0/2601622269 learned_addr learned my addr 172.21.15.134:0/2601622269 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:43:13.655 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c259c700 1 --2- 172.21.15.134:0/2601622269 >> v2:172.21.15.166:3300/0 conn(0x7ff7c415a0d0 0x7ff7c40c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.656 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c1d9b700 1 -- 172.21.15.134:0/2601622269 >> v2:172.21.15.166:3300/0 conn(0x7ff7c415a0d0 msgr2=0x7ff7c40c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:13.656 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c1d9b700 1 --2- 172.21.15.134:0/2601622269 >> v2:172.21.15.166:3300/0 conn(0x7ff7c415a0d0 0x7ff7c40c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.656 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c1d9b700 1 -- 172.21.15.134:0/2601622269 >> v1:172.21.15.134:6789/0 conn(0x7ff7c415a9e0 legacy=0x7ff7c406be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.656 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c159a700 1 -- 172.21.15.134:0/2601622269 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586008510 0 0) 0x7ff7c4069440 con 0x7ff7c415a9e0 2022-05-11T19:43:13.657 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c1d9b700 1 -- 172.21.15.134:0/2601622269 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4069690 con 0x7ff7c40c4e20 2022-05-11T19:43:13.657 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c1d9b700 1 --2- 172.21.15.134:0/2601622269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 0x7ff7c415a4a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ce260 tx=0x7ff7b8009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754d7b330e72764f server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:13.657 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.645+0000 7ff7c159a700 1 -- 172.21.15.134:0/2601622269 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8011630 con 0x7ff7c40c4e20 2022-05-11T19:43:13.657 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c159a700 1 -- 172.21.15.134:0/2601622269 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b8011790 con 0x7ff7c40c4e20 2022-05-11T19:43:13.658 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c159a700 1 -- 172.21.15.134:0/2601622269 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8011b50 con 0x7ff7c40c4e20 2022-05-11T19:43:13.658 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2601622269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 msgr2=0x7ff7c415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.658 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c8fe7700 1 --2- 172.21.15.134:0/2601622269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 0x7ff7c415a4a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ce260 tx=0x7ff7b8009060 comp rx=0 tx=0).stop 2022-05-11T19:43:13.658 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2601622269 shutdown_connections 2022-05-11T19:43:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c8fe7700 1 --2- 172.21.15.134:0/2601622269 >> v2:172.21.15.166:3300/0 conn(0x7ff7c415a0d0 0x7ff7c40c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c8fe7700 1 --2- 172.21.15.134:0/2601622269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 0x7ff7c415a4a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2601622269 >> 172.21.15.134:0/2601622269 conn(0x7ff7c4063620 msgr2=0x7ff7c4063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2601622269 shutdown_connections 2022-05-11T19:43:13.659 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.646+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2601622269 wait complete. 2022-05-11T19:43:13.660 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.647+0000 7ff7c8fe7700 1 Processor -- start 2022-05-11T19:43:13.660 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.647+0000 7ff7c8fe7700 1 -- start start 2022-05-11T19:43:13.660 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c8fe7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 0x7ff7c416d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.660 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c8fe7700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff7c415a0d0 0x7ff7c415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c8fe7700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff7c415a9e0 0x7ff7c415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c8fe7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40c7d50 con 0x7ff7c40c4e20 2022-05-11T19:43:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c8fe7700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40c71d0 con 0x7ff7c415a0d0 2022-05-11T19:43:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c8fe7700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40c74b0 con 0x7ff7c415a9e0 2022-05-11T19:43:13.661 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 0x7ff7c416d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 0x7ff7c416d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40172/0 (socket says 172.21.15.134:40172) 2022-05-11T19:43:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c259c700 1 -- 172.21.15.134:0/2332331212 learned_addr learned my addr 172.21.15.134:0/2332331212 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c1d9b700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff7c415a0d0 0x7ff7c415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.662 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c2d9d700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff7c415a9e0 0x7ff7c415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.663 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c259c700 1 -- 172.21.15.134:0/2332331212 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff7c415a9e0 msgr2=0x7ff7c415e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.663 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c259c700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff7c415a9e0 0x7ff7c415e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.663 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c259c700 1 -- 172.21.15.134:0/2332331212 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff7c415a0d0 msgr2=0x7ff7c415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.663 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c259c700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff7c415a0d0 0x7ff7c415e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.664 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c259c700 1 -- 172.21.15.134:0/2332331212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b80092a0 con 0x7ff7c40c4e20 2022-05-11T19:43:13.664 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c2d9d700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff7c415a9e0 0x7ff7c415e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-05-11T19:43:13.664 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.648+0000 7ff7c259c700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 0x7ff7c416d9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400d890 tx=0x7ff7b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:13.664 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.649+0000 7ff7b27fc700 1 -- 172.21.15.134:0/2332331212 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4014620 con 0x7ff7c40c4e20 2022-05-11T19:43:13.664 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.649+0000 7ff7b27fc700 1 -- 172.21.15.134:0/2332331212 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4014780 con 0x7ff7c40c4e20 2022-05-11T19:43:13.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.649+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c40c7790 con 0x7ff7c40c4e20 2022-05-11T19:43:13.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.649+0000 7ff7b27fc700 1 -- 172.21.15.134:0/2332331212 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4014b40 con 0x7ff7c40c4e20 2022-05-11T19:43:13.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.649+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c416df30 con 0x7ff7c40c4e20 2022-05-11T19:43:13.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.650+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c404c7e0 con 0x7ff7c40c4e20 2022-05-11T19:43:13.665 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.650+0000 7ff7b27fc700 1 -- 172.21.15.134:0/2332331212 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7ff7b4024070 con 0x7ff7c40c4e20 2022-05-11T19:43:13.666 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.650+0000 7ff7b27fc700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff7a0063cc0 0x7ff7a0066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.666 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.650+0000 7ff7b27fc700 1 -- 172.21.15.134:0/2332331212 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff7b4080c20 con 0x7ff7c40c4e20 2022-05-11T19:43:13.666 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.650+0000 7ff7c1d9b700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff7a0063cc0 0x7ff7a0066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.666 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.651+0000 7ff7c1d9b700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff7a0063cc0 0x7ff7a0066170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009fd0 tx=0x7ff7b8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:13.667 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.654+0000 7ff7b27fc700 1 -- 172.21.15.134:0/2332331212 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7ff7b404fb60 con 0x7ff7c40c4e20 2022-05-11T19:43:13.831 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.828+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7c416ad80 con 0x7ff7c40c4e20 2022-05-11T19:43:13.832 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.829+0000 7ff7b27fc700 1 -- 172.21.15.134:0/2332331212 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13791 (secure 0 0 0) 0x7ff7b4018070 con 0x7ff7c40c4e20 2022-05-11T19:43:13.832 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:43:13.832 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":20,"fsid":"ccb62be3-03e9-4327-8bbc-0e532a97b11c","created":"2022-05-11T19:42:52.825477+0000","modified":"2022-05-11T19:43:13.173392+0000","last_up_change":"2022-05-11T19:43:04.020564+0000","last_in_change":"2022-05-11T19:42:55.219204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-05-11T19:43:06.032854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-05-11T19:43:11.109880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"56e1cfec-aefb-4fe9-b5a7-b6dda26a7f5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":122590},{"type":"v1","addr":"172.21.15.134:6801","nonce":122590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":122590},{"type":"v1","addr":"172.21.15.134:6803","nonce":122590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":122590},{"type":"v1","addr":"172.21.15.134:6807","nonce":122590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":122590},{"type":"v1","addr":"172.21.15.134:6805","nonce":122590}]},"public_addr":"172.21.15.134:6801/122590","cluster_addr":"172.21.15.134:6803/122590","heartbeat_back_addr":"172.21.15.134:6807/122590","heartbeat_front_addr":"172.21.15.134:6805/122590","state":["exists","up"]},{"osd":1,"uuid":"d2a3acee-ede6-47f8-81c4-7e019143a485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":122589},{"type":"v1","addr":"172.21.15.134:6809","nonce":122589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":122589},{"type":"v1","addr":"172.21.15.134:6811","nonce":122589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":122589},{"type":"v1","addr":"172.21.15.134:6815","nonce":122589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":122589},{"type":"v1","addr":"172.21.15.134:6813","nonce":122589}]},"public_addr":"172.21.15.134:6809/122589","cluster_addr":"172.21.15.134:6811/122589","heartbeat_back_addr":"172.21.15.134:6815/122589","heartbeat_front_addr":"172.21.15.134:6813/122589","state":["exists","up"]},{"osd":2,"uuid":"ef94ace6-f5aa-4572-838b-d92a62fd6f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":122592},{"type":"v1","addr":"172.21.15.134:6819","nonce":122592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":122592},{"type":"v1","addr":"172.21.15.134:6823","nonce":122592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":122592},{"type":"v1","addr":"172.21.15.134:6831","nonce":122592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":122592},{"type":"v1","addr":"172.21.15.134:6827","nonce":122592}]},"public_addr":"172.21.15.134:6819/122592","cluster_addr":"172.21.15.134:6823/122592","heartbeat_back_addr":"172.21.15.134:6831/122592","heartbeat_front_addr":"172.21.15.134:6827/122592","state":["exists","up"]},{"osd":3,"uuid":"fa809b81-371a-4ab7-a648-0f1a5641d33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":122591},{"type":"v1","addr":"172.21.15.134:6818","nonce":122591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":122591},{"type":"v1","addr":"172.21.15.134:6822","nonce":122591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":122591},{"type":"v1","addr":"172.21.15.134:6830","nonce":122591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":122591},{"type":"v1","addr":"172.21.15.134:6826","nonce":122591}]},"public_addr":"172.21.15.134:6818/122591","cluster_addr":"172.21.15.134:6822/122591","heartbeat_back_addr":"172.21.15.134:6830/122591","heartbeat_front_addr":"172.21.15.134:6826/122591","state":["exists","up"]},{"osd":4,"uuid":"b95f28ff-6fab-44f1-a8d8-ba925d4c0ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6800","nonce":122910},{"type":"v1","addr":"172.21.15.166:6801","nonce":122910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":122910},{"type":"v1","addr":"172.21.15.166:6803","nonce":122910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":122910},{"type":"v1","addr":"172.21.15.166:6807","nonce":122910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":122910},{"type":"v1","addr":"172.21.15.166:6805","nonce":122910}]},"public_addr":"172.21.15.166:6801/122910","cluster_addr":"172.21.15.166:6803/122910","heartbeat_back_addr":"172.21.15.166:6807/122910","heartbeat_front_addr":"172.21.15.166:6805/122910","state":["exists","up"]},{"osd":5,"uuid":"dc4d2a03-2b7d-4e90-a1ea-cafef55b6fa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6816","nonce":122925},{"type":"v1","addr":"172.21.15.166:6817","nonce":122925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6818","nonce":122925},{"type":"v1","addr":"172.21.15.166:6819","nonce":122925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6825","nonce":122925},{"type":"v1","addr":"172.21.15.166:6827","nonce":122925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6821","nonce":122925},{"type":"v1","addr":"172.21.15.166:6823","nonce":122925}]},"public_addr":"172.21.15.166:6817/122925","cluster_addr":"172.21.15.166:6819/122925","heartbeat_back_addr":"172.21.15.166:6827/122925","heartbeat_front_addr":"172.21.15.166:6823/122925","state":["exists","up"]},{"osd":6,"uuid":"020f0004-538e-44cd-88be-e899baf94d29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":122911},{"type":"v1","addr":"172.21.15.166:6809","nonce":122911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":122911},{"type":"v1","addr":"172.21.15.166:6811","nonce":122911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":122911},{"type":"v1","addr":"172.21.15.166:6815","nonce":122911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":122911},{"type":"v1","addr":"172.21.15.166:6813","nonce":122911}]},"public_addr":"172.21.15.166:6809/122911","cluster_addr":"172.21.15.166:6811/122911","heartbeat_back_addr":"172.21.15.166:6815/122911","heartbeat_front_addr":"172.21.15.166:6813/122911","state":["exists","up"]},{"osd":7,"uuid":"6f9faa65-8da9-441c-b260-430f2b0621fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6820","nonce":122912},{"type":"v1","addr":"172.21.15.166:6822","nonce":122912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6824","nonce":122912},{"type":"v1","addr":"172.21.15.166:6826","nonce":122912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6830","nonce":122912},{"type":"v1","addr":"172.21.15.166:6831","nonce":122912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6828","nonce":122912},{"type":"v1","addr":"172.21.15.166:6829","nonce":122912}]},"public_addr":"172.21.15.166:6822/122912","cluster_addr":"172.21.15.166:6826/122912","heartbeat_back_addr":"172.21.15.166:6831/122912","heartbeat_front_addr":"172.21.15.166:6829/122912","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.126431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.489364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.420767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.383215+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.380408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.423371+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.453214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-05-11T19:43:00.461833+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-05-11T19:43:13.834 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff7a0063cc0 msgr2=0x7ff7a0066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.834 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff7a0063cc0 0x7ff7a0066170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009fd0 tx=0x7ff7b8017000 comp rx=0 tx=0).stop 2022-05-11T19:43:13.834 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 msgr2=0x7ff7c416d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.835 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 0x7ff7c416d9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400d890 tx=0x7ff7b4008040 comp rx=0 tx=0).stop 2022-05-11T19:43:13.835 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 shutdown_connections 2022-05-11T19:43:13.835 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7ff7c415a9e0 0x7ff7c415e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.835 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7ff7a0063cc0 0x7ff7a0066170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.835 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7c40c4e20 0x7ff7c416d9f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.836 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 --2- 172.21.15.134:0/2332331212 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7ff7c415a0d0 0x7ff7c415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.836 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 >> 172.21.15.134:0/2332331212 conn(0x7ff7c4063620 msgr2=0x7ff7c40cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:13.836 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 shutdown_connections 2022-05-11T19:43:13.837 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.831+0000 7ff7c8fe7700 1 -- 172.21.15.134:0/2332331212 wait complete. 2022-05-11T19:43:13.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-05-11T19:43:06.032854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-05-11T19:43:11.109880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-05-11T19:43:13.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-05-11T19:43:13.964 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.962+0000 7f8ff96f3700 1 Processor -- start 2022-05-11T19:43:13.965 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.962+0000 7f8ff96f3700 1 -- start start 2022-05-11T19:43:13.967 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.962+0000 7f8ff96f3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ff40c9d30 0x7f8ff40c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.968 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.962+0000 7f8ff96f3700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f8ff40c4190 0x7f8ff40ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.968 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.962+0000 7f8ff96f3700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff415a360 con 0x7f8ff40b0c70 2022-05-11T19:43:13.968 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.962+0000 7f8ff96f3700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff4159ec0 con 0x7f8ff40c9d30 2022-05-11T19:43:13.968 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.962+0000 7f8ff96f3700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff40c45f0 con 0x7f8ff40c4190 2022-05-11T19:43:13.968 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff27fc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ff40c9d30 0x7f8ff40c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.969 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff27fc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ff40c9d30 0x7f8ff40c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40182/0 (socket says 172.21.15.134:40182) 2022-05-11T19:43:13.969 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff27fc700 1 -- 172.21.15.134:0/2573115409 learned_addr learned my addr 172.21.15.134:0/2573115409 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:13.969 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff37fe700 1 --2- 172.21.15.134:0/2573115409 >> v2:172.21.15.166:3300/0 conn(0x7f8ff40c4190 0x7f8ff40ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.969 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff27fc700 1 -- 172.21.15.134:0/2573115409 >> v2:172.21.15.166:3300/0 conn(0x7f8ff40c4190 msgr2=0x7f8ff40ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff27fc700 1 --2- 172.21.15.134:0/2573115409 >> v2:172.21.15.166:3300/0 conn(0x7f8ff40c4190 0x7f8ff40ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff27fc700 1 -- 172.21.15.134:0/2573115409 >> v1:172.21.15.166:6789/0 conn(0x7f8ff40b0c70 legacy=0x7f8ff40c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff27fc700 1 -- 172.21.15.134:0/2573115409 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff40c48c0 con 0x7f8ff40c9d30 2022-05-11T19:43:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff27fc700 1 --2- 172.21.15.134:0/2573115409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 0x7f8ff40c3c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ff406fd00 tx=0x7f8fe40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2696d65657adac server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff1ffb700 1 -- 172.21.15.134:0/2573115409 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4011630 con 0x7f8ff40c9d30 2022-05-11T19:43:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff1ffb700 1 -- 172.21.15.134:0/2573115409 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe40117b0 con 0x7f8ff40c9d30 2022-05-11T19:43:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.963+0000 7f8ff1ffb700 1 -- 172.21.15.134:0/2573115409 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4011b70 con 0x7f8ff40c9d30 2022-05-11T19:43:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.964+0000 7f8ff96f3700 1 -- 172.21.15.134:0/2573115409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 msgr2=0x7f8ff40c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.964+0000 7f8ff96f3700 1 --2- 172.21.15.134:0/2573115409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 0x7f8ff40c3c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ff406fd00 tx=0x7f8fe40090f0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.971 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.964+0000 7f8ff96f3700 1 -- 172.21.15.134:0/2573115409 shutdown_connections 2022-05-11T19:43:13.972 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.964+0000 7f8ff96f3700 1 --2- 172.21.15.134:0/2573115409 >> v2:172.21.15.166:3300/0 conn(0x7f8ff40c4190 0x7f8ff40ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.972 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.964+0000 7f8ff96f3700 1 --2- 172.21.15.134:0/2573115409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 0x7f8ff40c3c50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.972 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.964+0000 7f8ff96f3700 1 -- 172.21.15.134:0/2573115409 >> 172.21.15.134:0/2573115409 conn(0x7f8ff40979c0 msgr2=0x7f8ff4063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:13.972 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.964+0000 7f8ff96f3700 1 -- 172.21.15.134:0/2573115409 shutdown_connections 2022-05-11T19:43:13.972 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.964+0000 7f8ff96f3700 1 -- 172.21.15.134:0/2573115409 wait complete. 2022-05-11T19:43:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.965+0000 7f8ff96f3700 1 Processor -- start 2022-05-11T19:43:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.965+0000 7f8ff96f3700 1 -- start start 2022-05-11T19:43:13.976 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff96f3700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8ff40b0c70 0x7f8ff416acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.976 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff96f3700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8ff40c4190 0x7f8ff4156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.976 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff96f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 0x7f8ff40c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.977 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff96f3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40ac190 con 0x7f8ff40c9d30 2022-05-11T19:43:13.977 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff96f3700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff4069620 con 0x7f8ff40b0c70 2022-05-11T19:43:13.977 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff96f3700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff416b1f0 con 0x7f8ff40c4190 2022-05-11T19:43:13.977 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 0x7f8ff40c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.977 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 0x7f8ff40c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40190/0 (socket says 172.21.15.134:40190) 2022-05-11T19:43:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff37fe700 1 -- 172.21.15.134:0/1997330382 learned_addr learned my addr 172.21.15.134:0/1997330382 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff27fc700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8ff40c4190 0x7f8ff4156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff37fe700 1 -- 172.21.15.134:0/1997330382 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8ff40c4190 msgr2=0x7f8ff4156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff37fe700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8ff40c4190 0x7f8ff4156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.978 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff2ffd700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8ff40b0c70 0x7f8ff416acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff37fe700 1 -- 172.21.15.134:0/1997330382 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8ff40b0c70 msgr2=0x7f8ff416acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff37fe700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8ff40b0c70 0x7f8ff416acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff37fe700 1 -- 172.21.15.134:0/1997330382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe4009370 con 0x7f8ff40c9d30 2022-05-11T19:43:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff27fc700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8ff40c4190 0x7f8ff4156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-05-11T19:43:13.979 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff37fe700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 0x7f8ff40c9110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009fa0 tx=0x7f8fec009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8fdaffd700 1 -- 172.21.15.134:0/1997330382 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec00ed20 con 0x7f8ff40c9d30 2022-05-11T19:43:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8fdaffd700 1 -- 172.21.15.134:0/1997330382 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec00ee80 con 0x7f8ff40c9d30 2022-05-11T19:43:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff4156580 con 0x7f8ff40c9d30 2022-05-11T19:43:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8fdaffd700 1 -- 172.21.15.134:0/1997330382 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec014670 con 0x7f8ff40c9d30 2022-05-11T19:43:13.980 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.966+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff4068cf0 con 0x7f8ff40c9d30 2022-05-11T19:43:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.967+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff40697b0 con 0x7f8ff40c9d30 2022-05-11T19:43:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.968+0000 7f8fdaffd700 1 -- 172.21.15.134:0/1997330382 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7f8fec012050 con 0x7f8ff40c9d30 2022-05-11T19:43:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.968+0000 7f8fdaffd700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8fd4063cc0 0x7f8fd4066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.968+0000 7f8ff2ffd700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8fd4063cc0 0x7f8fd4066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.968+0000 7f8fdaffd700 1 -- 172.21.15.134:0/1997330382 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8fec080be0 con 0x7f8ff40c9d30 2022-05-11T19:43:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.969+0000 7f8ff2ffd700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8fd4063cc0 0x7f8fd4066170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4156a70 tx=0x7f8fe8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:13.972+0000 7f8fdaffd700 1 -- 172.21.15.134:0/1997330382 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7f8fec04fac0 con 0x7f8ff40c9d30 2022-05-11T19:43:14.150 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.147+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ff40c4c00 con 0x7f8ff40c9d30 2022-05-11T19:43:14.150 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.148+0000 7f8fdaffd700 1 -- 172.21.15.134:0/1997330382 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fec0530e0 con 0x7f8ff40c9d30 2022-05-11T19:43:14.151 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2022-05-11T19:43:14.152 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.149+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8fd4063cc0 msgr2=0x7f8fd4066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.153 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.149+0000 7f8ff96f3700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8fd4063cc0 0x7f8fd4066170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4156a70 tx=0x7f8fe8009040 comp rx=0 tx=0).stop 2022-05-11T19:43:14.153 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.149+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 msgr2=0x7f8ff40c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.153 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.149+0000 7f8ff96f3700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 0x7f8ff40c9110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009fa0 tx=0x7f8fec009900 comp rx=0 tx=0).stop 2022-05-11T19:43:14.153 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.149+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 shutdown_connections 2022-05-11T19:43:14.154 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.149+0000 7f8ff96f3700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f8fd4063cc0 0x7f8fd4066170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.154 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.149+0000 7f8ff96f3700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff40c9d30 0x7f8ff40c9110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.154 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.149+0000 7f8ff96f3700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f8ff40b0c70 0x7f8ff416acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.154 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.149+0000 7f8ff96f3700 1 --2- 172.21.15.134:0/1997330382 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f8ff40c4190 0x7f8ff4156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.155 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.150+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 >> 172.21.15.134:0/1997330382 conn(0x7f8ff40979c0 msgr2=0x7f8ff4159140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:14.155 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.150+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 shutdown_connections 2022-05-11T19:43:14.155 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.150+0000 7f8ff96f3700 1 -- 172.21.15.134:0/1997330382 wait complete. 2022-05-11T19:43:14.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-05-11T19:43:14.282 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.279+0000 7f9a58c2c700 1 Processor -- start 2022-05-11T19:43:14.282 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.279+0000 7f9a58c2c700 1 -- start start 2022-05-11T19:43:14.285 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.280+0000 7f9a58c2c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9a540b0850 0x7f9a5415b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.285 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.280+0000 7f9a58c2c700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 0x7f9a541585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.285 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.280+0000 7f9a58c2c700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a540c3680 con 0x7f9a540b0c20 2022-05-11T19:43:14.286 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.280+0000 7f9a58c2c700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a54157a00 con 0x7f9a540b0850 2022-05-11T19:43:14.286 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.280+0000 7f9a58c2c700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a54158ae0 con 0x7f9a540cb3e0 2022-05-11T19:43:14.286 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.280+0000 7f9a5259c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9a540b0850 0x7f9a5415b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.287 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.280+0000 7f9a5259c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9a540b0850 0x7f9a5415b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40194/0 (socket says 172.21.15.134:40194) 2022-05-11T19:43:14.287 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.280+0000 7f9a5259c700 1 -- 172.21.15.134:0/3625426559 learned_addr learned my addr 172.21.15.134:0/3625426559 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:14.287 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.280+0000 7f9a52d9d700 1 --2- 172.21.15.134:0/3625426559 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 0x7f9a541585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.287 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a5259c700 1 -- 172.21.15.134:0/3625426559 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 msgr2=0x7f9a541585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:14.287 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a5259c700 1 --2- 172.21.15.134:0/3625426559 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 0x7f9a541585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.288 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a5259c700 1 -- 172.21.15.134:0/3625426559 >> v1:172.21.15.166:6789/0 conn(0x7f9a540b0c20 legacy=0x7f9a540cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.288 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a5259c700 1 -- 172.21.15.134:0/3625426559 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5415bfd0 con 0x7f9a540b0850 2022-05-11T19:43:14.288 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a5259c700 1 --2- 172.21.15.134:0/3625426559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 0x7f9a5415b0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a48006fd0 tx=0x7f9a480090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec31703792d3bc8 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:14.289 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a5159a700 1 -- 172.21.15.134:0/3625426559 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48004030 con 0x7f9a540b0850 2022-05-11T19:43:14.289 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a5159a700 1 -- 172.21.15.134:0/3625426559 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a48004190 con 0x7f9a540b0850 2022-05-11T19:43:14.289 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a5159a700 1 -- 172.21.15.134:0/3625426559 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48011630 con 0x7f9a540b0850 2022-05-11T19:43:14.289 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a58c2c700 1 -- 172.21.15.134:0/3625426559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 msgr2=0x7f9a5415b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.289 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a58c2c700 1 --2- 172.21.15.134:0/3625426559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 0x7f9a5415b0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a48006fd0 tx=0x7f9a480090f0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.290 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a58c2c700 1 -- 172.21.15.134:0/3625426559 shutdown_connections 2022-05-11T19:43:14.290 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a58c2c700 1 --2- 172.21.15.134:0/3625426559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 0x7f9a5415b0c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.290 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a58c2c700 1 --2- 172.21.15.134:0/3625426559 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 0x7f9a541585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.290 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a58c2c700 1 -- 172.21.15.134:0/3625426559 >> 172.21.15.134:0/3625426559 conn(0x7f9a54063620 msgr2=0x7f9a54063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:14.290 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a58c2c700 1 -- 172.21.15.134:0/3625426559 shutdown_connections 2022-05-11T19:43:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.281+0000 7f9a58c2c700 1 -- 172.21.15.134:0/3625426559 wait complete. 2022-05-11T19:43:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a58c2c700 1 Processor -- start 2022-05-11T19:43:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a58c2c700 1 -- start start 2022-05-11T19:43:14.294 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a58c2c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 0x7f9a540c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.294 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a58c2c700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9a540b0c20 0x7f9a540cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.295 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a58c2c700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 0x7f9a54167720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.295 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a58c2c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540b28c0 con 0x7f9a540b0850 2022-05-11T19:43:14.295 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a58c2c700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540b2ba0 con 0x7f9a540b0c20 2022-05-11T19:43:14.295 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a58c2c700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540b2e80 con 0x7f9a540cb3e0 2022-05-11T19:43:14.296 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a5259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 0x7f9a540c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.296 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a5259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 0x7f9a540c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40200/0 (socket says 172.21.15.134:40200) 2022-05-11T19:43:14.296 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.283+0000 7f9a5259c700 1 -- 172.21.15.134:0/2400758912 learned_addr learned my addr 172.21.15.134:0/2400758912 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:14.296 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a51d9b700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9a540b0c20 0x7f9a540cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a52d9d700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 0x7f9a54167720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a5259c700 1 -- 172.21.15.134:0/2400758912 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 msgr2=0x7f9a54167720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a5259c700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 0x7f9a54167720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a5259c700 1 -- 172.21.15.134:0/2400758912 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9a540b0c20 msgr2=0x7f9a540cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.297 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a5259c700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9a540b0c20 0x7f9a540cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.298 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a5259c700 1 -- 172.21.15.134:0/2400758912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a48009370 con 0x7f9a540b0850 2022-05-11T19:43:14.298 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a5259c700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 0x7f9a540c7f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a5406fb50 tx=0x7f9a48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:14.298 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a427fc700 1 -- 172.21.15.134:0/2400758912 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a480036f0 con 0x7f9a540b0850 2022-05-11T19:43:14.298 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a427fc700 1 -- 172.21.15.134:0/2400758912 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a48003850 con 0x7f9a540b0850 2022-05-11T19:43:14.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a427fc700 1 -- 172.21.15.134:0/2400758912 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48003c10 con 0x7f9a540b0850 2022-05-11T19:43:14.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a540b3160 con 0x7f9a540b0850 2022-05-11T19:43:14.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.284+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a540b2550 con 0x7f9a540b0850 2022-05-11T19:43:14.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.285+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a540b3600 con 0x7f9a540b0850 2022-05-11T19:43:14.299 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.286+0000 7f9a427fc700 1 -- 172.21.15.134:0/2400758912 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7f9a4802b030 con 0x7f9a540b0850 2022-05-11T19:43:14.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.286+0000 7f9a427fc700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f9a30063cc0 0x7f9a30066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.286+0000 7f9a427fc700 1 -- 172.21.15.134:0/2400758912 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9a480822a0 con 0x7f9a540b0850 2022-05-11T19:43:14.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.287+0000 7f9a51d9b700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f9a30063cc0 0x7f9a30066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.287+0000 7f9a51d9b700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f9a30063cc0 0x7f9a30066170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9a44001840 tx=0x7f9a44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:14.300 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.290+0000 7f9a427fc700 1 -- 172.21.15.134:0/2400758912 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7f9a48051170 con 0x7f9a540b0850 2022-05-11T19:43:14.468 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.466+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a5404c7e0 con 0x7f9a540b0850 2022-05-11T19:43:14.469 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.466+0000 7f9a427fc700 1 -- 172.21.15.134:0/2400758912 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a48029020 con 0x7f9a540b0850 2022-05-11T19:43:14.469 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 8 2022-05-11T19:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f9a30063cc0 msgr2=0x7f9a30066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f9a30063cc0 0x7f9a30066170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9a44001840 tx=0x7f9a44009040 comp rx=0 tx=0).stop 2022-05-11T19:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 msgr2=0x7f9a540c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.471 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 0x7f9a540c7f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a5406fb50 tx=0x7f9a48016000 comp rx=0 tx=0).stop 2022-05-11T19:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 shutdown_connections 2022-05-11T19:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f9a540cb3e0 0x7f9a54167720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f9a30063cc0 0x7f9a30066170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.472 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a540b0850 0x7f9a540c7f60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 --2- 172.21.15.134:0/2400758912 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9a540b0c20 0x7f9a540cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 >> 172.21.15.134:0/2400758912 conn(0x7f9a54063620 msgr2=0x7f9a540c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 shutdown_connections 2022-05-11T19:43:14.473 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.468+0000 7f9a58c2c700 1 -- 172.21.15.134:0/2400758912 wait complete. 2022-05-11T19:43:14.482 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-05-11T19:43:14.597 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.595+0000 7f7700701700 1 Processor -- start 2022-05-11T19:43:14.598 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.595+0000 7f7700701700 1 -- start start 2022-05-11T19:43:14.601 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f7700701700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f76f815b0a0 0x7f76f8158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.601 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f7700701700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 0x7f76f81585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.601 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f7700701700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f80c93f0 con 0x7f76f8157ca0 2022-05-11T19:43:14.601 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f7700701700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f80ca840 con 0x7f76f815b0a0 2022-05-11T19:43:14.602 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f7700701700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8158af0 con 0x7f76f80cb370 2022-05-11T19:43:14.602 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fdc9c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f76f815b0a0 0x7f76f8158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.602 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fe49d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f76f8157ca0 0x7f76f80cac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47054/0 (socket says 172.21.15.134:47054) 2022-05-11T19:43:14.603 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fe49d700 1 -- 172.21.15.134:0/1608876292 learned_addr learned my addr 172.21.15.134:0/1608876292 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:43:14.603 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fdc9c700 1 -- 172.21.15.134:0/1608876292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 msgr2=0x7f76f81585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:14.603 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fec9e700 1 --2- 172.21.15.134:0/1608876292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 0x7f76f81585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.603 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fd49b700 1 -- 172.21.15.134:0/1608876292 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265444372 0 0) 0x7f76f80c93f0 con 0x7f76f8157ca0 2022-05-11T19:43:14.604 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fdc9c700 1 --2- 172.21.15.134:0/1608876292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 0x7f76f81585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.604 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fdc9c700 1 -- 172.21.15.134:0/1608876292 >> v1:172.21.15.134:6789/0 conn(0x7f76f8157ca0 legacy=0x7f76f80cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.604 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fdc9c700 1 -- 172.21.15.134:0/1608876292 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f815b530 con 0x7f76f815b0a0 2022-05-11T19:43:14.604 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fec9e700 1 --2- 172.21.15.134:0/1608876292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 0x7f76f81585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-05-11T19:43:14.604 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fdc9c700 1 --2- 172.21.15.134:0/1608876292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f815b0a0 0x7f76f8158070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009790 tx=0x7f76e8009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c9f89e529ec585 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:14.605 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.596+0000 7f76fd49b700 1 -- 172.21.15.134:0/1608876292 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8011630 con 0x7f76f815b0a0 2022-05-11T19:43:14.605 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f76fd49b700 1 -- 172.21.15.134:0/1608876292 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e8011790 con 0x7f76f815b0a0 2022-05-11T19:43:14.605 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f76fd49b700 1 -- 172.21.15.134:0/1608876292 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8011b50 con 0x7f76f815b0a0 2022-05-11T19:43:14.605 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f7700701700 1 -- 172.21.15.134:0/1608876292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f815b0a0 msgr2=0x7f76f8158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.606 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f7700701700 1 --2- 172.21.15.134:0/1608876292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f815b0a0 0x7f76f8158070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009790 tx=0x7f76e8009060 comp rx=0 tx=0).stop 2022-05-11T19:43:14.606 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f7700701700 1 -- 172.21.15.134:0/1608876292 shutdown_connections 2022-05-11T19:43:14.606 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f7700701700 1 --2- 172.21.15.134:0/1608876292 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 0x7f76f81585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.607 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f7700701700 1 --2- 172.21.15.134:0/1608876292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f815b0a0 0x7f76f8158070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.607 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f7700701700 1 -- 172.21.15.134:0/1608876292 >> 172.21.15.134:0/1608876292 conn(0x7f76f8063620 msgr2=0x7f76f8063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:14.607 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f7700701700 1 -- 172.21.15.134:0/1608876292 shutdown_connections 2022-05-11T19:43:14.607 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.597+0000 7f7700701700 1 -- 172.21.15.134:0/1608876292 wait complete. 2022-05-11T19:43:14.607 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.598+0000 7f7700701700 1 Processor -- start 2022-05-11T19:43:14.608 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.598+0000 7f7700701700 1 -- start start 2022-05-11T19:43:14.610 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f7700701700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 0x7f76f80b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.611 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f7700701700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8157ca0 0x7f76f80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.611 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f7700701700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f76f815b0a0 0x7f76f8154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.611 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f7700701700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80c6cb0 con 0x7f76f8157ca0 2022-05-11T19:43:14.611 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f7700701700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80c5dc0 con 0x7f76f815b0a0 2022-05-11T19:43:14.612 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f7700701700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80c60a0 con 0x7f76f80cb370 2022-05-11T19:43:14.612 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fdc9c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8157ca0 0x7f76f80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.613 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fdc9c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8157ca0 0x7f76f80ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40216/0 (socket says 172.21.15.134:40216) 2022-05-11T19:43:14.613 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fdc9c700 1 -- 172.21.15.134:0/934726469 learned_addr learned my addr 172.21.15.134:0/934726469 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:14.614 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fe49d700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 0x7f76f80b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.614 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fec9e700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f76f815b0a0 0x7f76f8154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.614 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fdc9c700 1 -- 172.21.15.134:0/934726469 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 msgr2=0x7f76f80b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.615 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fdc9c700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 0x7f76f80b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.615 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fdc9c700 1 -- 172.21.15.134:0/934726469 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f76f815b0a0 msgr2=0x7f76f8154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.616 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fdc9c700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f76f815b0a0 0x7f76f8154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.616 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.599+0000 7f76fdc9c700 1 -- 172.21.15.134:0/934726469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80092a0 con 0x7f76f8157ca0 2022-05-11T19:43:14.616 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.600+0000 7f76fdc9c700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8157ca0 0x7f76f80ce450 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76e8013000 tx=0x7f76e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:14.617 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.600+0000 7f76e67fc700 1 -- 172.21.15.134:0/934726469 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e801f070 con 0x7f76f8157ca0 2022-05-11T19:43:14.617 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.600+0000 7f76e67fc700 1 -- 172.21.15.134:0/934726469 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e8000c90 con 0x7f76f8157ca0 2022-05-11T19:43:14.618 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.600+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f80c6380 con 0x7f76f8157ca0 2022-05-11T19:43:14.618 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.600+0000 7f76e67fc700 1 -- 172.21.15.134:0/934726469 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8011b50 con 0x7f76f8157ca0 2022-05-11T19:43:14.619 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.600+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f80c6940 con 0x7f76f8157ca0 2022-05-11T19:43:14.619 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.601+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f81563c0 con 0x7f76f8157ca0 2022-05-11T19:43:14.620 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.601+0000 7f76e67fc700 1 -- 172.21.15.134:0/934726469 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7f76e802c030 con 0x7f76f8157ca0 2022-05-11T19:43:14.620 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.601+0000 7f76e67fc700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f76d8063cc0 0x7f76d8066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.620 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.602+0000 7f76e67fc700 1 -- 172.21.15.134:0/934726469 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f76e8081940 con 0x7f76f8157ca0 2022-05-11T19:43:14.621 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.602+0000 7f76fe49d700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f76d8063cc0 0x7f76d8066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.621 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.602+0000 7f76fe49d700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f76d8063cc0 0x7f76d8066170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76f4007990 tx=0x7f76f4007bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:14.622 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.606+0000 7f76e67fc700 1 -- 172.21.15.134:0/934726469 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7f76f81563c0 con 0x7f76f8157ca0 2022-05-11T19:43:14.785 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.782+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76f81563c0 con 0x7f76f8157ca0 2022-05-11T19:43:14.785 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.782+0000 7f76e67fc700 1 -- 172.21.15.134:0/934726469 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f76f81563c0 con 0x7f76f8157ca0 2022-05-11T19:43:14.785 INFO:teuthology.orchestra.run.smithi134.stdout: 2022-05-11T19:43:14.786 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2022-05-11T19:43:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2022-05-11T19:43:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2022-05-11T19:43:14.786 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2022-05-11T19:43:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2022-05-11T19:43:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2022-05-11T19:43:14.787 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 2, 2022-05-11T19:43:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": "rbd" 2022-05-11T19:43:14.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2022-05-11T19:43:14.788 INFO:teuthology.orchestra.run.smithi134.stdout:] 2022-05-11T19:43:14.789 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f76d8063cc0 msgr2=0x7f76d8066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.790 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f76d8063cc0 0x7f76d8066170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76f4007990 tx=0x7f76f4007bb0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.790 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8157ca0 msgr2=0x7f76f80ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.790 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8157ca0 0x7f76f80ce450 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76e8013000 tx=0x7f76e8017000 comp rx=0 tx=0).stop 2022-05-11T19:43:14.790 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 shutdown_connections 2022-05-11T19:43:14.791 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f76f815b0a0 0x7f76f8154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.791 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f76f80cb370 0x7f76f80b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.791 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f76d8063cc0 0x7f76d8066170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.792 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 --2- 172.21.15.134:0/934726469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76f8157ca0 0x7f76f80ce450 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.792 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 >> 172.21.15.134:0/934726469 conn(0x7f76f8063620 msgr2=0x7f76f80cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:14.792 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 shutdown_connections 2022-05-11T19:43:14.793 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.784+0000 7f7700701700 1 -- 172.21.15.134:0/934726469 wait complete. 2022-05-11T19:43:14.799 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-05-11T19:43:14.800 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-05-11T19:43:14.918 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.915+0000 7f58c4b7e700 1 Processor -- start 2022-05-11T19:43:14.919 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.915+0000 7f58c4b7e700 1 -- start start 2022-05-11T19:43:14.928 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.916+0000 7f58c4b7e700 1 --2- >> v2:172.21.15.166:3300/0 conn(0x7f58c00c9960 0x7f58c0067a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.929 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.916+0000 7f58c4b7e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f58c00c7ae0 0x7f58c0067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.929 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.916+0000 7f58c4b7e700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c006ec00 con 0x7f58c015cb50 2022-05-11T19:43:14.929 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.916+0000 7f58c4b7e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c006fa60 con 0x7f58c00c7ae0 2022-05-11T19:43:14.929 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.916+0000 7f58c4b7e700 1 -- --> v2:172.21.15.166:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c006ee50 con 0x7f58c00c9960 2022-05-11T19:43:14.930 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.916+0000 7f58bed9d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f58c00c7ae0 0x7f58c0067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.930 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.916+0000 7f58bed9d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f58c00c7ae0 0x7f58c0067fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40226/0 (socket says 172.21.15.134:40226) 2022-05-11T19:43:14.930 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.916+0000 7f58bed9d700 1 -- 172.21.15.134:0/1922226859 learned_addr learned my addr 172.21.15.134:0/1922226859 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:14.930 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.916+0000 7f58b7fff700 1 --2- 172.21.15.134:0/1922226859 >> v2:172.21.15.166:3300/0 conn(0x7f58c00c9960 0x7f58c0067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.931 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58bed9d700 1 -- 172.21.15.134:0/1922226859 >> v2:172.21.15.166:3300/0 conn(0x7f58c00c9960 msgr2=0x7f58c0067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:14.931 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58bed9d700 1 --2- 172.21.15.134:0/1922226859 >> v2:172.21.15.166:3300/0 conn(0x7f58c00c9960 0x7f58c0067a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.931 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58bed9d700 1 -- 172.21.15.134:0/1922226859 >> v1:172.21.15.166:6789/0 conn(0x7f58c015cb50 legacy=0x7f58c00c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.931 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58bed9d700 1 -- 172.21.15.134:0/1922226859 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c006f130 con 0x7f58c00c7ae0 2022-05-11T19:43:14.932 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58bed9d700 1 --2- 172.21.15.134:0/1922226859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c00c7ae0 0x7f58c0067fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f58c00701a0 tx=0x7f58b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5524915352f11a92 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:14.932 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58bdd9b700 1 -- 172.21.15.134:0/1922226859 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800e070 con 0x7f58c00c7ae0 2022-05-11T19:43:14.932 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58bdd9b700 1 -- 172.21.15.134:0/1922226859 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b800ba20 con 0x7f58c00c7ae0 2022-05-11T19:43:14.932 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58bdd9b700 1 -- 172.21.15.134:0/1922226859 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80092e0 con 0x7f58c00c7ae0 2022-05-11T19:43:14.933 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1922226859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c00c7ae0 msgr2=0x7f58c0067fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.933 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58c4b7e700 1 --2- 172.21.15.134:0/1922226859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c00c7ae0 0x7f58c0067fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f58c00701a0 tx=0x7f58b8009840 comp rx=0 tx=0).stop 2022-05-11T19:43:14.933 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1922226859 shutdown_connections 2022-05-11T19:43:14.933 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58c4b7e700 1 --2- 172.21.15.134:0/1922226859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c00c7ae0 0x7f58c0067fb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.934 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58c4b7e700 1 --2- 172.21.15.134:0/1922226859 >> v2:172.21.15.166:3300/0 conn(0x7f58c00c9960 0x7f58c0067a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.934 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.917+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1922226859 >> 172.21.15.134:0/1922226859 conn(0x7f58c0069610 msgr2=0x7f58c00cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:14.934 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.918+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1922226859 shutdown_connections 2022-05-11T19:43:14.934 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.918+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1922226859 wait complete. 2022-05-11T19:43:14.935 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58c4b7e700 1 Processor -- start 2022-05-11T19:43:14.935 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58c4b7e700 1 -- start start 2022-05-11T19:43:14.935 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58c4b7e700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f58c00c7ae0 0x7f58c00b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.935 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58c4b7e700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f58c00c9960 0x7f58c00cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.935 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58c4b7e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c015cb50 0x7f58c016cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.936 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58c4b7e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c0158e00 con 0x7f58c015cb50 2022-05-11T19:43:14.936 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58c4b7e700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c01593c0 con 0x7f58c00c9960 2022-05-11T19:43:14.936 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58c4b7e700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c016da50 con 0x7f58c00c7ae0 2022-05-11T19:43:14.936 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58bed9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c015cb50 0x7f58c016cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.937 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58bed9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c015cb50 0x7f58c016cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40232/0 (socket says 172.21.15.134:40232) 2022-05-11T19:43:14.937 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.919+0000 7f58bed9d700 1 -- 172.21.15.134:0/1273478792 learned_addr learned my addr 172.21.15.134:0/1273478792 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:14.937 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58b7fff700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f58c00c9960 0x7f58c00cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.937 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58be59c700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f58c00c7ae0 0x7f58c00b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.937 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58bed9d700 1 -- 172.21.15.134:0/1273478792 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f58c00c7ae0 msgr2=0x7f58c00b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.938 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58bed9d700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f58c00c7ae0 0x7f58c00b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.938 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58bed9d700 1 -- 172.21.15.134:0/1273478792 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f58c00c9960 msgr2=0x7f58c00cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:14.938 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58bed9d700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f58c00c9960 0x7f58c00cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:14.938 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58bed9d700 1 -- 172.21.15.134:0/1273478792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8009ae0 con 0x7f58c015cb50 2022-05-11T19:43:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58bed9d700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c015cb50 0x7f58c016cfd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58b800b6c0 tx=0x7f58b8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58b67fc700 1 -- 172.21.15.134:0/1273478792 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8003ca0 con 0x7f58c015cb50 2022-05-11T19:43:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58b67fc700 1 -- 172.21.15.134:0/1273478792 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8003e00 con 0x7f58c015cb50 2022-05-11T19:43:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58b67fc700 1 -- 172.21.15.134:0/1273478792 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8007820 con 0x7f58c015cb50 2022-05-11T19:43:14.940 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c016dd30 con 0x7f58c015cb50 2022-05-11T19:43:14.940 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.920+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c00af680 con 0x7f58c015cb50 2022-05-11T19:43:14.940 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.921+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c0159550 con 0x7f58c015cb50 2022-05-11T19:43:14.940 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.921+0000 7f58b67fc700 1 -- 172.21.15.134:0/1273478792 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7f58b8007c50 con 0x7f58c015cb50 2022-05-11T19:43:14.940 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.921+0000 7f58b67fc700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f58a4063cc0 0x7f58a4066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.922+0000 7f58b67fc700 1 -- 172.21.15.134:0/1273478792 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f58b80821f0 con 0x7f58c015cb50 2022-05-11T19:43:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.922+0000 7f58be59c700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f58a4063cc0 0x7f58a4066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.922+0000 7f58be59c700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f58a4063cc0 0x7f58a4066170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58b00017a0 tx=0x7f58b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:14.926+0000 7f58b67fc700 1 -- 172.21.15.134:0/1273478792 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7f58b8051130 con 0x7f58c015cb50 2022-05-11T19:43:15.103 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.101+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f58c004c7e0 con 0x7f58c015cb50 2022-05-11T19:43:15.304 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.301+0000 7f58b67fc700 1 -- 172.21.15.134:0/1273478792 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f58b802a0b0 con 0x7f58c015cb50 2022-05-11T19:43:15.306 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.303+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f58a4063cc0 msgr2=0x7f58a4066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:15.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.303+0000 7f58c4b7e700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f58a4063cc0 0x7f58a4066170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58b00017a0 tx=0x7f58b0009040 comp rx=0 tx=0).stop 2022-05-11T19:43:15.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.303+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c015cb50 msgr2=0x7f58c016cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:15.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.303+0000 7f58c4b7e700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c015cb50 0x7f58c016cfd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58b800b6c0 tx=0x7f58b8018000 comp rx=0 tx=0).stop 2022-05-11T19:43:15.307 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.303+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 shutdown_connections 2022-05-11T19:43:15.308 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.303+0000 7f58c4b7e700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7f58a4063cc0 0x7f58a4066170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.308 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.303+0000 7f58c4b7e700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58c015cb50 0x7f58c016cfd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.308 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.303+0000 7f58c4b7e700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f58c00c7ae0 0x7f58c00b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.308 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.304+0000 7f58c4b7e700 1 --2- 172.21.15.134:0/1273478792 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f58c00c9960 0x7f58c00cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.304+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 >> 172.21.15.134:0/1273478792 conn(0x7f58c0069610 msgr2=0x7f58c00c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:15.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.304+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 shutdown_connections 2022-05-11T19:43:15.309 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.304+0000 7f58c4b7e700 1 -- 172.21.15.134:0/1273478792 wait complete. 2022-05-11T19:43:15.310 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2022-05-11T19:43:15.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2022-05-11T19:43:15.444 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.441+0000 7fb900953700 1 Processor -- start 2022-05-11T19:43:15.444 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.441+0000 7fb900953700 1 -- start start 2022-05-11T19:43:15.453 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb900953700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc159420 0x7fb8fc0c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:15.454 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb900953700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb8fc0c4e40 0x7fb8fc1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:15.454 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb900953700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc0c9770 con 0x7fb8fc0693f0 2022-05-11T19:43:15.454 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb900953700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc0ca5d0 con 0x7fb8fc0c4e40 2022-05-11T19:43:15.455 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb900953700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc0ca010 con 0x7fb8fc159420 2022-05-11T19:43:15.455 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb8f9d9b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb8fc0c4e40 0x7fb8fc1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:15.455 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb8f9d9b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb8fc0c4e40 0x7fb8fc1597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40236/0 (socket says 172.21.15.134:40236) 2022-05-11T19:43:15.455 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb8f9d9b700 1 -- 172.21.15.134:0/3681814362 learned_addr learned my addr 172.21.15.134:0/3681814362 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb8fa59c700 1 --2- 172.21.15.134:0/3681814362 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc159420 0x7fb8fc0c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb8f9d9b700 1 -- 172.21.15.134:0/3681814362 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc159420 msgr2=0x7fb8fc0c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-05-11T19:43:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb8f9d9b700 1 --2- 172.21.15.134:0/3681814362 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc159420 0x7fb8fc0c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb8f9d9b700 1 -- 172.21.15.134:0/3681814362 >> v1:172.21.15.166:6789/0 conn(0x7fb8fc0693f0 legacy=0x7fb8fc06be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:15.456 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb8f9d9b700 1 -- 172.21.15.134:0/3681814362 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc0c9a50 con 0x7fb8fc0c4e40 2022-05-11T19:43:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.442+0000 7fb8f9d9b700 1 --2- 172.21.15.134:0/3681814362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0c4e40 0x7fb8fc1597f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0006fd0 tx=0x7fb8f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f0e455847c8d22 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb8f959a700 1 -- 172.21.15.134:0/3681814362 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0004030 con 0x7fb8fc0c4e40 2022-05-11T19:43:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb8f959a700 1 -- 172.21.15.134:0/3681814362 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0004190 con 0x7fb8fc0c4e40 2022-05-11T19:43:15.457 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb8f959a700 1 -- 172.21.15.134:0/3681814362 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0011630 con 0x7fb8fc0c4e40 2022-05-11T19:43:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb900953700 1 -- 172.21.15.134:0/3681814362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0c4e40 msgr2=0x7fb8fc1597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb900953700 1 --2- 172.21.15.134:0/3681814362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0c4e40 0x7fb8fc1597f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0006fd0 tx=0x7fb8f00090f0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb900953700 1 -- 172.21.15.134:0/3681814362 shutdown_connections 2022-05-11T19:43:15.458 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb900953700 1 --2- 172.21.15.134:0/3681814362 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc159420 0x7fb8fc0c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb900953700 1 --2- 172.21.15.134:0/3681814362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0c4e40 0x7fb8fc1597f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb900953700 1 -- 172.21.15.134:0/3681814362 >> 172.21.15.134:0/3681814362 conn(0x7fb8fc063620 msgr2=0x7fb8fc063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb900953700 1 -- 172.21.15.134:0/3681814362 shutdown_connections 2022-05-11T19:43:15.459 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.443+0000 7fb900953700 1 -- 172.21.15.134:0/3681814362 wait complete. 2022-05-11T19:43:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.444+0000 7fb900953700 1 Processor -- start 2022-05-11T19:43:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.444+0000 7fb900953700 1 -- start start 2022-05-11T19:43:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb900953700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0693f0 0x7fb8fc1404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:15.460 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb900953700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc0c4e40 0x7fb8fc0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:15.461 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb900953700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8fc159420 0x7fb8fc0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:15.461 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb900953700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc15bb80 con 0x7fb8fc0693f0 2022-05-11T19:43:15.461 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb900953700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc159d60 con 0x7fb8fc159420 2022-05-11T19:43:15.461 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb900953700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc0c6200 con 0x7fb8fc0c4e40 2022-05-11T19:43:15.461 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb8fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0693f0 0x7fb8fc1404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:15.462 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb8fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0693f0 0x7fb8fc1404c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40240/0 (socket says 172.21.15.134:40240) 2022-05-11T19:43:15.462 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb8fa59c700 1 -- 172.21.15.134:0/2039362487 learned_addr learned my addr 172.21.15.134:0/2039362487 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:15.462 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb8f9d9b700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc0c4e40 0x7fb8fc0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:15.462 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.445+0000 7fb8fad9d700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8fc159420 0x7fb8fc0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:15.463 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb8fa59c700 1 -- 172.21.15.134:0/2039362487 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc0c4e40 msgr2=0x7fb8fc0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:15.463 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb8fa59c700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc0c4e40 0x7fb8fc0ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.463 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb8fa59c700 1 -- 172.21.15.134:0/2039362487 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8fc159420 msgr2=0x7fb8fc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:15.463 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb8fa59c700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8fc159420 0x7fb8fc0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:15.464 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb8fa59c700 1 -- 172.21.15.134:0/2039362487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0009370 con 0x7fb8fc0693f0 2022-05-11T19:43:15.464 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb8fa59c700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0693f0 0x7fb8fc1404c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00d890 tx=0x7fb8ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:15.464 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb8ea7fc700 1 -- 172.21.15.134:0/2039362487 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0125f0 con 0x7fb8fc0693f0 2022-05-11T19:43:15.464 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb8ea7fc700 1 -- 172.21.15.134:0/2039362487 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec012750 con 0x7fb8fc0693f0 2022-05-11T19:43:15.464 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb8ea7fc700 1 -- 172.21.15.134:0/2039362487 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec012af0 con 0x7fb8fc0693f0 2022-05-11T19:43:15.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8fc159fb0 con 0x7fb8fc0693f0 2022-05-11T19:43:15.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.446+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8fc15a570 con 0x7fb8fc0693f0 2022-05-11T19:43:15.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.447+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8fc04c7e0 con 0x7fb8fc0693f0 2022-05-11T19:43:15.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.447+0000 7fb8ea7fc700 1 -- 172.21.15.134:0/2039362487 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 81920+0+0 (secure 0 0 0) 0x7fb8ec01e460 con 0x7fb8fc0693f0 2022-05-11T19:43:15.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.448+0000 7fb8ea7fc700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fb8d8063d40 0x7fb8d80661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:15.466 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.448+0000 7fb8ea7fc700 1 -- 172.21.15.134:0/2039362487 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fb8ec080c40 con 0x7fb8fc0693f0 2022-05-11T19:43:15.466 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.448+0000 7fb8f9d9b700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fb8d8063d40 0x7fb8d80661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:15.466 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.448+0000 7fb8f9d9b700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fb8d8063d40 0x7fb8d80661f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0006fd0 tx=0x7fb8f0016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:15.467 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.452+0000 7fb8ea7fc700 1 -- 172.21.15.134:0/2039362487 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+164877 (secure 0 0 0) 0x7fb8ec04f8c0 con 0x7fb8fc0693f0 2022-05-11T19:43:15.630 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:15.628+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb8fc0c9d30 con 0x7fb8fc0693f0 2022-05-11T19:43:16.313 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.311+0000 7fb8ea7fc700 1 -- 172.21.15.134:0/2039362487 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb8ec052ee0 con 0x7fb8fc0693f0 2022-05-11T19:43:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.315+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fb8d8063d40 msgr2=0x7fb8d80661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.315+0000 7fb900953700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fb8d8063d40 0x7fb8d80661f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0006fd0 tx=0x7fb8f0016000 comp rx=0 tx=0).stop 2022-05-11T19:43:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.315+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0693f0 msgr2=0x7fb8fc1404c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.315+0000 7fb900953700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0693f0 0x7fb8fc1404c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00d890 tx=0x7fb8ec008040 comp rx=0 tx=0).stop 2022-05-11T19:43:16.325 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.322+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 shutdown_connections 2022-05-11T19:43:16.325 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.322+0000 7fb900953700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7fb8fc159420 0x7fb8fc0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:16.325 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.322+0000 7fb900953700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:6832/122340,v1:172.21.15.134:6833/122340] conn(0x7fb8d8063d40 0x7fb8d80661f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:16.326 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.322+0000 7fb900953700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8fc0693f0 0x7fb8fc1404c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:16.326 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.322+0000 7fb900953700 1 --2- 172.21.15.134:0/2039362487 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7fb8fc0c4e40 0x7fb8fc0ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:16.326 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.322+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 >> 172.21.15.134:0/2039362487 conn(0x7fb8fc063620 msgr2=0x7fb8fc153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:16.326 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.322+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 shutdown_connections 2022-05-11T19:43:16.327 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.323+0000 7fb900953700 1 -- 172.21.15.134:0/2039362487 wait complete. 2022-05-11T19:43:16.327 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2022-05-11T19:43:16.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-05-11T19:43:16.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-05-11T19:43:16.442 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-05-11T19:43:16.457 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.455+0000 7f957a785700 1 Processor -- start 2022-05-11T19:43:16.458 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.455+0000 7f957a785700 1 -- start start 2022-05-11T19:43:16.461 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.456+0000 7f957a785700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f957415cb50 0x7f95740c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:16.461 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.456+0000 7f957a785700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957406ec00 con 0x7f9574068180 2022-05-11T19:43:16.461 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.456+0000 7f957a785700 1 -- --> v1:172.21.15.166:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957406fa60 con 0x7f95740c7ae0 2022-05-11T19:43:16.462 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.456+0000 7f957a785700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957406ee50 con 0x7f957415cb50 2022-05-11T19:43:16.462 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.456+0000 7f9578d22700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f9574068180 0x7f957406ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47098/0 (socket says 172.21.15.134:47098) 2022-05-11T19:43:16.462 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.456+0000 7f9578d22700 1 -- 172.21.15.134:0/2813848537 learned_addr learned my addr 172.21.15.134:0/2813848537 (peer_addr_for_me v1:172.21.15.134:0/0) 2022-05-11T19:43:16.462 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9573fff700 1 --2- 172.21.15.134:0/2813848537 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f957415cb50 0x7f95740c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:16.463 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9572ffd700 1 -- 172.21.15.134:0/2813848537 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584351853 0 0) 0x7f957406ec00 con 0x7f9574068180 2022-05-11T19:43:16.463 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9572ffd700 1 -- 172.21.15.134:0/2813848537 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95600033f0 con 0x7f9574068180 2022-05-11T19:43:16.463 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9572ffd700 1 -- 172.21.15.134:0/2813848537 <== mon.1 v1:172.21.15.166:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364803957 0 0) 0x7f957406fa60 con 0x7f95740c7ae0 2022-05-11T19:43:16.463 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9572ffd700 1 -- 172.21.15.134:0/2813848537 --> v1:172.21.15.166:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f957406ec00 con 0x7f95740c7ae0 2022-05-11T19:43:16.463 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9573fff700 1 -- 172.21.15.134:0/2813848537 >> v1:172.21.15.166:6789/0 conn(0x7f95740c7ae0 legacy=0x7f9574067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:16.464 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9573fff700 1 -- 172.21.15.134:0/2813848537 >> v1:172.21.15.134:6789/0 conn(0x7f9574068180 legacy=0x7f957406ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:16.464 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9573fff700 1 -- 172.21.15.134:0/2813848537 --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957406f130 con 0x7f957415cb50 2022-05-11T19:43:16.464 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9573fff700 1 --2- 172.21.15.134:0/2813848537 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f957415cb50 0x7f95740c9250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9564009790 tx=0x7f9564009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733a0481ff159204 server_cookie=0 in_seq=0 out_seq=0 2022-05-11T19:43:16.464 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9572ffd700 1 -- 172.21.15.134:0/2813848537 <== mon.2 v2:172.21.15.166:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011630 con 0x7f957415cb50 2022-05-11T19:43:16.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9572ffd700 1 -- 172.21.15.134:0/2813848537 <== mon.2 v2:172.21.15.166:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564011790 con 0x7f957415cb50 2022-05-11T19:43:16.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.457+0000 7f9572ffd700 1 -- 172.21.15.134:0/2813848537 <== mon.2 v2:172.21.15.166:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011b10 con 0x7f957415cb50 2022-05-11T19:43:16.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.458+0000 7f957a785700 1 -- 172.21.15.134:0/2813848537 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f957415cb50 msgr2=0x7f95740c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:16.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.458+0000 7f957a785700 1 --2- 172.21.15.134:0/2813848537 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f957415cb50 0x7f95740c9250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9564009790 tx=0x7f9564009060 comp rx=0 tx=0).stop 2022-05-11T19:43:16.465 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.458+0000 7f957a785700 1 -- 172.21.15.134:0/2813848537 shutdown_connections 2022-05-11T19:43:16.466 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.458+0000 7f957a785700 1 --2- 172.21.15.134:0/2813848537 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f957415cb50 0x7f95740c9250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:16.466 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.458+0000 7f957a785700 1 -- 172.21.15.134:0/2813848537 >> 172.21.15.134:0/2813848537 conn(0x7f9574069610 msgr2=0x7f95740cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-05-11T19:43:16.466 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.458+0000 7f957a785700 1 -- 172.21.15.134:0/2813848537 shutdown_connections 2022-05-11T19:43:16.466 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.458+0000 7f957a785700 1 -- 172.21.15.134:0/2813848537 wait complete. 2022-05-11T19:43:16.469 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.459+0000 7f957a785700 1 Processor -- start 2022-05-11T19:43:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.460+0000 7f957a785700 1 -- start start 2022-05-11T19:43:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f957a785700 1 --2- >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9574068180 0x7f95740c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f957a785700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f95740c7ae0 0x7f957406af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:16.471 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f957a785700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957415cb50 0x7f9574149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-05-11T19:43:16.471 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f957a785700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95740b0220 con 0x7f957415cb50 2022-05-11T19:43:16.471 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f957a785700 1 -- --> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95740b1040 con 0x7f9574068180 2022-05-11T19:43:16.471 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f957a785700 1 -- --> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95740b0430 con 0x7f95740c7ae0 2022-05-11T19:43:16.471 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f9578d22700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957415cb50 0x7f9574149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:16.472 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f95737fe700 1 --2- >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f95740c7ae0 0x7f957406af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:16.472 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f9578d22700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f957415cb50 0x7f9574149b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40258/0 (socket says 172.21.15.134:40258) 2022-05-11T19:43:16.472 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f9578d22700 1 -- 172.21.15.134:0/2402326874 learned_addr learned my addr 172.21.15.134:0/2402326874 (peer_addr_for_me v2:172.21.15.134:0/0) 2022-05-11T19:43:16.472 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f9573fff700 1 --2- 172.21.15.134:0/2402326874 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9574068180 0x7f95740c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-05-11T19:43:16.473 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f9578d22700 1 -- 172.21.15.134:0/2402326874 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f95740c7ae0 msgr2=0x7f957406af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:16.473 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f9578d22700 1 --2- 172.21.15.134:0/2402326874 >> [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] conn(0x7f95740c7ae0 0x7f957406af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-05-11T19:43:16.473 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f9578d22700 1 -- 172.21.15.134:0/2402326874 >> [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] conn(0x7f9574068180 msgr2=0x7f95740c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-05-11T19:43:16.473 INFO:teuthology.orchestra.run.smithi134.stderr:2022-05-11T19:43:16.461+0000 7f9578d22700 1 --2- 172.