2022-12-01T09:33:56.577 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf 2022-12-01T09:33:56.579 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} --archive /home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090977 --owner scheduled_khiremat@teuthology --name khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi -- /home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090977/orig.config.yaml 2022-12-01T09:33:56.632 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-12-01T09:33:56.712 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090977 branch: wip-khiremat-47893-test-mgr-finisher-thread-5 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} email: null first_in_suite: false job_id: '7090977' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-khiremat-47893-test-mgr-finisher-thread-5 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-khiremat-47893-test-mgr-finisher-thread-5 sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 owner: scheduled_khiremat@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 sleep_before_teardown: 0 suite: fs:volumes suite_branch: wip-khiremat-47893-test-mgr-finisher-thread-5 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f6922ca21f63dad2b198f92826f75d268f12fc97/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGAcoQsU1nlc8k8Ij6OemRKm281Bqr8pdp41+SnG+zhXSh8aEDyBQnSw4CoBCOh8gDKlaMgSBMzS8ABzQUfx9WX7dm9I61BfbVVdWK+Uk726nBwjOTFoI5lIw0qDAhftotNjvOLprzvY1cJBDDn5P+SF/Zb6G9AqApOnf2cvHkOYjjqYZSEQugoi9hQB9hEcSe27nEBx3oEOQurCF1DPaujvqwqaTeZ2QS4aefmDaV9dOUVqq9Pb8jdhbIRZrZGh4wkXdWHHnTQbecWbCWkpOGSZk/yH2s/42J5VxO2YVWVxuV1Z1dNJL2TvZS/3Wy4RlBIpAwiZ+FgRWasDXo03e2ae+dICQVXFxv2q2OCxWe7Y5xmJa51XD7h/30wURK2l4r0XnEyavZW3WZEOR+fblG65b66vzoSU6yCAyhrfbGyt6ADOZNjDxYVvBN6us3JldpSawc9fy+oQOatvPBlbQA+Bp1ACeeNWmODLGU39i9quY1so7So3dRZ8JZzBK/C30= smithi182.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsklMXDq1Mbiza+Ol4CHg0FKD1vvRA8GF6UCLbSfOBocluroGVblLAk5EZmgv2B22uKKDPLot7LceJUVaDypbZw0xdurBdJs7CA3EIk9LSQtS0ZKLEiIN49s1uuuPOxflI89fzSPp/E80KK193Q9/mb5SqKup/l7ekL+1HAJuYULkX9tXuOeET646c15nV2MbhbOODVCzosx2FH+XKksxvGYpWgJb5Uj8qPx9H6G8SoZRh28qHW1vHPX9JG//V5/jtoeUHe+r/4NHZ+jqve1hvqgxO9Zygk8HlQTxrKn9+TBMo9Uicjo/czQrvobV9DjZJUZVB7yi75CTCMTiUDS+sLEAolErEOXUfXg8U1BgGD8ERacaRQvsoyNBwJCzmnYbbDclHaVXV4AOz2L466KYd/5za2SzmMkQMjOvD78IZD0yPHyQLQs8YEQ+alCQXLqU4IfVCPokyDCfh/lRsvQByZKBgfabsc1yo37RGZ2iYuH3UqpouHM+cwL0gtyJO8N0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes - tasks.cephfs.test_subvolume.TestSubvolume teuthology_branch: main teuthology_sha1: 4da97cf64e542f347ec47b7bdbe5eca99759f9b7 timestamp: 2022-11-24_05:02:42 tube: smithi user: khiremat verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23126 2022-12-01T09:33:56.713 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f6922ca21f63dad2b198f92826f75d268f12fc97/qa; will attempt to use it 2022-12-01T09:33:56.714 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f6922ca21f63dad2b198f92826f75d268f12fc97/qa/tasks 2022-12-01T09:33:56.714 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-12-01T09:33:56.716 INFO:teuthology.task.internal:Checking packages... 2022-12-01T09:33:56.742 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'f6922ca21f63dad2b198f92826f75d268f12fc97' 2022-12-01T09:33:56.742 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-12-01T09:33:56.743 INFO:teuthology.packaging:ref: None 2022-12-01T09:33:56.743 INFO:teuthology.packaging:tag: None 2022-12-01T09:33:56.744 INFO:teuthology.packaging:branch: wip-khiremat-47893-test-mgr-finisher-thread-5 2022-12-01T09:33:56.744 INFO:teuthology.packaging:sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:33:56.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-khiremat-47893-test-mgr-finisher-thread-5 2022-12-01T09:33:56.951 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-676.gf6922ca2 2022-12-01T09:33:56.951 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-12-01T09:33:56.958 INFO:teuthology.task.internal:no buildpackages task found 2022-12-01T09:33:56.959 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-12-01T09:33:56.973 INFO:teuthology.task.internal:Saving configuration 2022-12-01T09:33:56.992 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-12-01T09:33:56.999 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-12-01T09:33:57.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090977', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-12-01 09:28:56.674611', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhxzjUn/SnP+M3Axh2iD3T+WWEqhyhwgpWchHJzBbI9efR1xy5lisZV/HjApNeXd4X9lwnaaNp5k0u06RxZbGc='} 2022-12-01T09:33:57.051 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi182.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090977', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-12-01 09:28:56.672373', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHeY4fcXtIaR2q57Gtp3G/Y2h9XMfkEwE+ox2meMDphtT877dgGJFh7bSK0+e6fP+qeYIG/uUW0tggAKAHXnEKg='} 2022-12-01T09:33:57.051 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-12-01T09:33:57.058 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-12-01T09:33:57.059 INFO:teuthology.task.internal:roles: ubuntu@smithi182.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-12-01T09:33:57.060 INFO:teuthology.run_tasks:Running task console_log... 2022-12-01T09:33:57.141 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faa442298c8>, signals=[15]) 2022-12-01T09:33:57.142 INFO:teuthology.run_tasks:Running task internal.connect... 2022-12-01T09:33:57.149 INFO:teuthology.task.internal:Opening connections... 2022-12-01T09:33:57.149 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2022-12-01T09:33:57.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-12-01T09:33:57.231 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi182.front.sepia.ceph.com 2022-12-01T09:33:57.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-12-01T09:33:57.310 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-12-01T09:33:57.318 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2022-12-01T09:33:57.339 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2022-12-01T09:33:57.340 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2022-12-01T09:33:57.398 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2022-12-01T09:33:57.399 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2022-12-01T09:33:57.399 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2022-12-01T09:33:57.399 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2022-12-01T09:33:57.400 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2022-12-01T09:33:57.400 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2022-12-01T09:33:57.400 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-01T09:33:57.401 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2022-12-01T09:33:57.401 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-01T09:33:57.401 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2022-12-01T09:33:57.402 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-01T09:33:57.402 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-01T09:33:57.403 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:33:57.403 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-01T09:33:57.403 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-01T09:33:57.403 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-01T09:33:57.404 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-01T09:33:57.404 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2022-12-01T09:33:57.427 DEBUG:teuthology.orchestra.run.smithi182:> uname -m 2022-12-01T09:33:57.448 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2022-12-01T09:33:57.449 DEBUG:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2022-12-01T09:33:57.509 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="Red Hat Enterprise Linux" 2022-12-01T09:33:57.510 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="8.6 (Ootpa)" 2022-12-01T09:33:57.510 INFO:teuthology.orchestra.run.smithi182.stdout:ID="rhel" 2022-12-01T09:33:57.510 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE="fedora" 2022-12-01T09:33:57.511 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="8.6" 2022-12-01T09:33:57.511 INFO:teuthology.orchestra.run.smithi182.stdout:PLATFORM_ID="platform:el8" 2022-12-01T09:33:57.511 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-01T09:33:57.511 INFO:teuthology.orchestra.run.smithi182.stdout:ANSI_COLOR="0;31" 2022-12-01T09:33:57.512 INFO:teuthology.orchestra.run.smithi182.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-01T09:33:57.512 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.redhat.com/" 2022-12-01T09:33:57.512 INFO:teuthology.orchestra.run.smithi182.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-01T09:33:57.512 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-01T09:33:57.513 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:33:57.513 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-01T09:33:57.513 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-01T09:33:57.513 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-01T09:33:57.513 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-01T09:33:57.514 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2022-12-01T09:33:57.535 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-12-01T09:33:57.545 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-12-01T09:33:57.551 INFO:teuthology.task.internal:Checking for old test directory... 2022-12-01T09:33:57.552 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2022-12-01T09:33:57.555 DEBUG:teuthology.orchestra.run.smithi182:> test '!' -e /home/ubuntu/cephtest 2022-12-01T09:33:57.574 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-12-01T09:33:57.581 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-12-01T09:33:57.582 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2022-12-01T09:33:57.615 DEBUG:teuthology.orchestra.run.smithi182:> test -z $(ls -A /var/lib/ceph) 2022-12-01T09:33:57.652 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-12-01T09:33:57.709 INFO:teuthology.run_tasks:Running task kernel... 2022-12-01T09:33:57.723 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2022-12-01T09:33:57.724 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2022-12-01T09:33:57.724 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2022-12-01T09:33:57.724 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2022-12-01T09:33:57.726 DEBUG:teuthology.orchestra.run.smithi182:> test -f /run/.containerenv -o -f /.dockerenv 2022-12-01T09:33:57.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-12-01T09:33:57.745 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2022-12-01T09:33:57.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-12-01T09:33:57.746 DEBUG:teuthology.orchestra.run.smithi182:> uname -r 2022-12-01T09:33:57.804 INFO:teuthology.orchestra.run.smithi079.stdout:4.18.0-372.9.1.el8.x86_64 2022-12-01T09:33:57.805 INFO:teuthology.task.kernel:Running kernel on smithi079: 4.18.0-372.9.1.el8.x86_64 2022-12-01T09:33:57.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2022-12-01T09:33:57.806 INFO:teuthology.orchestra.run.smithi182.stdout:4.18.0-372.9.1.el8.x86_64 2022-12-01T09:33:57.807 INFO:teuthology.task.kernel:Running kernel on smithi182: 4.18.0-372.9.1.el8.x86_64 2022-12-01T09:33:57.807 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum install -y kernel 2022-12-01T09:33:58.803 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2022-12-01T09:33:58.803 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2022-12-01T09:33:58.822 INFO:teuthology.orchestra.run.smithi182.stdout:Updating Subscription Management repositories. 2022-12-01T09:33:58.822 INFO:teuthology.orchestra.run.smithi182.stdout:Unable to read consumer identity 2022-12-01T09:33:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:33:58.889 INFO:teuthology.orchestra.run.smithi079.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-12-01T09:33:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:33:59.289 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:33:59.290 INFO:teuthology.orchestra.run.smithi182.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-12-01T09:33:59.290 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:34:01.584 INFO:teuthology.orchestra.run.smithi079.stdout:Copr repo for python3-asyncssh owned by ceph 2.3 kB/s | 3.5 kB 00:01 2022-12-01T09:34:01.971 INFO:teuthology.orchestra.run.smithi182.stdout:Copr repo for python3-asyncssh owned by ceph 2.3 kB/s | 3.5 kB 00:01 2022-12-01T09:34:04.867 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 13 MB 00:03 2022-12-01T09:34:07.775 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 474 kB/s | 24 kB 00:00 2022-12-01T09:34:08.436 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2022-12-01T09:34:08.486 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2022-12-01T09:34:08.487 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2022-12-01T09:34:08.487 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2022-12-01T09:34:08.604 DEBUG:teuthology.orchestra.run.smithi079:> echo no | sudo yum reinstall kernel || true 2022-12-01T09:34:08.934 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2022-12-01T09:34:08.935 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2022-12-01T09:34:08.994 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:34:08.994 INFO:teuthology.orchestra.run.smithi079.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-12-01T09:34:08.994 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:34:09.233 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:02 ago on Thu 01 Dec 2022 09:34:07 AM UTC. 2022-12-01T09:34:09.278 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-12-01T09:34:09.328 INFO:teuthology.orchestra.run.smithi079.stderr:Error: No packages marked for reinstall. 2022-12-01T09:34:09.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum reinstall -y kernel || true 2022-12-01T09:34:09.595 INFO:teuthology.orchestra.run.smithi182.stdout:Extra Packages for Enterprise Linux 1.7 MB/s | 13 MB 00:07 2022-12-01T09:34:09.703 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2022-12-01T09:34:09.703 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2022-12-01T09:34:09.748 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:34:09.749 INFO:teuthology.orchestra.run.smithi079.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-12-01T09:34:09.749 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:34:09.984 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:02 ago on Thu 01 Dec 2022 09:34:07 AM UTC. 2022-12-01T09:34:10.022 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-12-01T09:34:10.053 INFO:teuthology.orchestra.run.smithi079.stderr:Error: No packages marked for reinstall. 2022-12-01T09:34:10.098 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel --last | head -n 1 2022-12-01T09:34:10.177 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2022-12-01T09:34:10.179 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2022-12-01T09:34:10.179 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-12-01T09:34:10.180 DEBUG:teuthology.parallel:result is None 2022-12-01T09:34:12.645 INFO:teuthology.orchestra.run.smithi182.stdout:lab-extras 439 kB/s | 24 kB 00:00 2022-12-01T09:34:13.323 INFO:teuthology.orchestra.run.smithi182.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2022-12-01T09:34:13.365 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2022-12-01T09:34:13.366 INFO:teuthology.orchestra.run.smithi182.stdout:Nothing to do. 2022-12-01T09:34:13.367 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2022-12-01T09:34:13.483 DEBUG:teuthology.orchestra.run.smithi182:> echo no | sudo yum reinstall kernel || true 2022-12-01T09:34:13.814 INFO:teuthology.orchestra.run.smithi182.stdout:Updating Subscription Management repositories. 2022-12-01T09:34:13.814 INFO:teuthology.orchestra.run.smithi182.stdout:Unable to read consumer identity 2022-12-01T09:34:13.867 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:34:13.867 INFO:teuthology.orchestra.run.smithi182.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-12-01T09:34:13.868 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:34:14.109 INFO:teuthology.orchestra.run.smithi182.stdout:Last metadata expiration check: 0:00:02 ago on Thu 01 Dec 2022 09:34:12 AM UTC. 2022-12-01T09:34:14.150 INFO:teuthology.orchestra.run.smithi182.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-12-01T09:34:14.190 INFO:teuthology.orchestra.run.smithi182.stderr:Error: No packages marked for reinstall. 2022-12-01T09:34:14.238 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum reinstall -y kernel || true 2022-12-01T09:34:14.568 INFO:teuthology.orchestra.run.smithi182.stdout:Updating Subscription Management repositories. 2022-12-01T09:34:14.568 INFO:teuthology.orchestra.run.smithi182.stdout:Unable to read consumer identity 2022-12-01T09:34:14.616 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:34:14.617 INFO:teuthology.orchestra.run.smithi182.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-12-01T09:34:14.617 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:34:14.856 INFO:teuthology.orchestra.run.smithi182.stdout:Last metadata expiration check: 0:00:02 ago on Thu 01 Dec 2022 09:34:12 AM UTC. 2022-12-01T09:34:14.895 INFO:teuthology.orchestra.run.smithi182.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-12-01T09:34:14.924 INFO:teuthology.orchestra.run.smithi182.stderr:Error: No packages marked for reinstall. 2022-12-01T09:34:14.971 DEBUG:teuthology.orchestra.run.smithi182:> rpm -q kernel --last | head -n 1 2022-12-01T09:34:15.051 INFO:teuthology.orchestra.run.smithi182.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2022-12-01T09:34:15.053 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2022-12-01T09:34:15.053 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-12-01T09:34:15.053 DEBUG:teuthology.parallel:result is None 2022-12-01T09:34:15.054 INFO:teuthology.run_tasks:Running task internal.base... 2022-12-01T09:34:15.061 INFO:teuthology.task.internal:Creating test directory... 2022-12-01T09:34:15.061 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-12-01T09:34:15.064 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-12-01T09:34:15.085 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-12-01T09:34:15.092 INFO:teuthology.run_tasks:Running task internal.archive... 2022-12-01T09:34:15.101 INFO:teuthology.task.internal:Creating archive directory... 2022-12-01T09:34:15.102 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-12-01T09:34:15.127 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-12-01T09:34:15.163 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-12-01T09:34:15.170 INFO:teuthology.task.internal:Enabling coredump saving... 2022-12-01T09:34:15.171 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-12-01T09:34:15.193 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-12-01T09:34:15.222 INFO:teuthology.orchestra.run.smithi182.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-12-01T09:34:15.237 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-12-01T09:34:15.241 INFO:teuthology.orchestra.run.smithi182.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-12-01T09:34:15.256 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-12-01T09:34:15.258 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-12-01T09:34:15.265 INFO:teuthology.task.internal:Configuring sudo... 2022-12-01T09:34:15.266 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-12-01T09:34:15.269 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-12-01T09:34:15.310 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-12-01T09:34:15.319 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-12-01T09:34:15.319 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-12-01T09:34:15.338 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-12-01T09:34:15.366 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-12-01T09:34:15.439 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-12-01T09:34:15.499 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-12-01T09:34:15.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-12-01T09:34:15.585 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:34:15.586 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-12-01T09:34:15.651 DEBUG:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-12-01T09:34:15.695 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-12-01T09:34:15.767 DEBUG:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-12-01T09:34:15.811 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-12-01T09:34:15.853 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:34:15.854 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-12-01T09:34:15.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2022-12-01T09:34:15.923 DEBUG:teuthology.orchestra.run.smithi182:> sudo service rsyslog restart 2022-12-01T09:34:15.982 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-12-01T09:34:16.018 INFO:teuthology.orchestra.run.smithi182.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-12-01T09:34:16.219 INFO:teuthology.run_tasks:Running task internal.timer... 2022-12-01T09:34:16.227 INFO:teuthology.task.internal:Starting timer... 2022-12-01T09:34:16.228 INFO:teuthology.run_tasks:Running task pcp... 2022-12-01T09:34:16.242 INFO:teuthology.run_tasks:Running task selinux... 2022-12-01T09:34:16.251 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2022-12-01T09:34:16.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2022-12-01T09:34:16.315 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2022-12-01T09:34:16.315 DEBUG:teuthology.orchestra.run.smithi182:> sudo service auditd rotate 2022-12-01T09:34:16.380 INFO:teuthology.orchestra.run.smithi182.stdout:Rotating logs: 2022-12-01T09:34:16.382 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-12-01T09:34:16.383 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2022-12-01T09:34:16.415 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2022-12-01T09:34:16.415 DEBUG:teuthology.orchestra.run.smithi182:> /usr/sbin/getenforce 2022-12-01T09:34:16.433 INFO:teuthology.orchestra.run.smithi182.stdout:Permissive 2022-12-01T09:34:16.434 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi182.front.sepia.ceph.com': 'permissive'} 2022-12-01T09:34:16.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-12-01T09:34:16.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-12-01T09:34:16.482 DEBUG:teuthology.orchestra.run.smithi182:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-12-01T09:34:16.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-12-01T09:34:16.510 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-12-01T09:34:16.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2022-12-01T09:34:16.549 DEBUG:teuthology.orchestra.run.smithi182:> sudo /usr/sbin/setenforce permissive 2022-12-01T09:34:16.578 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-12-01T09:34:16.588 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2022-12-01T09:34:16.595 INFO:teuthology.repo_utils:Fetching main from origin 2022-12-01T09:34:16.729 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2022-12-01T09:34:16.749 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-12-01T09:34:16.750 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi182.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2022-12-01T09:42:15.455 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi182.front.sepia.ceph.com')] 2022-12-01T09:42:15.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2022-12-01T09:42:15.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-12-01T09:42:15.543 DEBUG:teuthology.orchestra.run.smithi079:> true 2022-12-01T09:42:15.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2022-12-01T09:42:15.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-12-01T09:42:15.689 DEBUG:teuthology.orchestra.run.smithi182:> true 2022-12-01T09:42:15.757 INFO:teuthology.run_tasks:Running task clock... 2022-12-01T09:42:15.772 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-12-01T09:42:15.772 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-12-01T09:42:15.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-12-01T09:42:15.777 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-12-01T09:42:15.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-12-01T09:42:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-12-01T09:42:15.820 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-12-01T09:42:15.832 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-12-01T09:42:15.847 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-12-01T09:42:15.884 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2022-12-01T09:42:15.895 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2022-12-01T09:42:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-12-01T09:42:15.919 INFO:teuthology.orchestra.run.smithi182.stderr:sudo: ntpd: command not found 2022-12-01T09:42:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-12-01T09:42:15.931 INFO:teuthology.orchestra.run.smithi182.stdout:506 Cannot talk to daemon 2022-12-01T09:42:15.946 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-12-01T09:42:15.960 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-12-01T09:42:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:bash: ntpq: command not found 2022-12-01T09:42:15.994 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-12-01T09:42:15.994 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2022-12-01T09:42:15.995 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:42:15.995 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:42:15.995 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:42:15.996 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:42:16.038 INFO:teuthology.orchestra.run.smithi182.stderr:bash: ntpq: command not found 2022-12-01T09:42:16.041 INFO:teuthology.orchestra.run.smithi182.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-12-01T09:42:16.042 INFO:teuthology.orchestra.run.smithi182.stdout:=============================================================================== 2022-12-01T09:42:16.042 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:42:16.042 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:42:16.042 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:42:16.042 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:42:16.044 INFO:teuthology.run_tasks:Running task install... 2022-12-01T09:42:16.053 DEBUG:teuthology.task.install:project ceph 2022-12-01T09:42:16.053 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}} 2022-12-01T09:42:16.054 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'} 2022-12-01T09:42:16.054 INFO:teuthology.task.install:Using flavor: default 2022-12-01T09:42:16.061 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-12-01T09:42:16.061 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-12-01T09:42:16.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo lsb_release -is 2022-12-01T09:42:16.103 INFO:teuthology.orchestra.run.smithi079.stdout:RedHatEnterprise 2022-12-01T09:42:16.104 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-12-01T09:42:16.104 DEBUG:teuthology.orchestra.run.smithi182:> sudo lsb_release -is 2022-12-01T09:42:16.105 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97', 'tag': None, 'wait_for_package': False} 2022-12-01T09:42:16.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo lsb_release -is 2022-12-01T09:42:16.147 INFO:teuthology.orchestra.run.smithi182.stdout:RedHatEnterprise 2022-12-01T09:42:16.148 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-12-01T09:42:16.149 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97', 'tag': None, 'wait_for_package': False} 2022-12-01T09:42:16.149 DEBUG:teuthology.orchestra.run.smithi182:> sudo lsb_release -is 2022-12-01T09:42:16.184 INFO:teuthology.orchestra.run.smithi079.stdout:RedHatEnterprise 2022-12-01T09:42:16.185 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-12-01T09:42:16.186 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:42:16.234 INFO:teuthology.orchestra.run.smithi182.stdout:RedHatEnterprise 2022-12-01T09:42:16.235 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-12-01T09:42:16.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:42:16.371 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/ 2022-12-01T09:42:16.371 INFO:teuthology.task.install.rpm:Package version is 18.0.0-676.gf6922ca2 2022-12-01T09:42:16.418 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/ 2022-12-01T09:42:16.418 INFO:teuthology.task.install.rpm:Package version is 18.0.0-676.gf6922ca2 2022-12-01T09:42:16.507 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-12-01T09:42:16.507 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:42:16.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-12-01T09:42:16.536 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-12-01T09:42:16.537 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f6922ca21f63dad2b198f92826f75d268f12fc97/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-12-01T09:42:16.547 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-12-01T09:42:16.548 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:42:16.548 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-12-01T09:42:16.575 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-12-01T09:42:16.575 DEBUG:teuthology.orchestra.run.smithi182:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f6922ca21f63dad2b198f92826f75d268f12fc97/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-12-01T09:42:16.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-12-01T09:42:16.641 DEBUG:teuthology.orchestra.run.smithi182:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-12-01T09:42:16.680 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-12-01T09:42:16.718 DEBUG:teuthology.orchestra.run.smithi182:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-12-01T09:42:16.746 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2022-12-01T09:42:16.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2022-12-01T09:42:16.785 INFO:teuthology.orchestra.run.smithi182.stdout:check_obsoletes = 1 2022-12-01T09:42:16.787 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum clean all 2022-12-01T09:42:17.116 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2022-12-01T09:42:17.157 INFO:teuthology.orchestra.run.smithi182.stdout:Updating Subscription Management repositories. 2022-12-01T09:42:17.348 INFO:teuthology.orchestra.run.smithi079.stdout:54 files removed 2022-12-01T09:42:17.370 INFO:teuthology.orchestra.run.smithi182.stdout:54 files removed 2022-12-01T09:42:17.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-12-01T09:42:17.417 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-12-01T09:42:17.725 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2022-12-01T09:42:17.746 INFO:teuthology.orchestra.run.smithi182.stdout:Updating Subscription Management repositories. 2022-12-01T09:42:18.479 INFO:teuthology.orchestra.run.smithi182.stdout:ceph packages for x86_64 206 kB/s | 81 kB 00:00 2022-12-01T09:42:18.513 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 201 kB/s | 81 kB 00:00 2022-12-01T09:42:18.964 INFO:teuthology.orchestra.run.smithi182.stdout:ceph noarch packages 21 kB/s | 9.4 kB 00:00 2022-12-01T09:42:18.971 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 22 kB/s | 9.4 kB 00:00 2022-12-01T09:42:19.272 INFO:teuthology.orchestra.run.smithi182.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2022-12-01T09:42:19.297 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2022-12-01T09:42:20.715 INFO:teuthology.orchestra.run.smithi182.stdout:Copr repo for python3-asyncssh owned by ceph 2.4 kB/s | 3.5 kB 00:01 2022-12-01T09:42:20.732 INFO:teuthology.orchestra.run.smithi079.stdout:Copr repo for python3-asyncssh owned by ceph 2.4 kB/s | 3.5 kB 00:01 2022-12-01T09:42:22.324 INFO:teuthology.orchestra.run.smithi182.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 13 MB 00:01 2022-12-01T09:42:22.406 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 13 MB 00:01 2022-12-01T09:42:25.249 INFO:teuthology.orchestra.run.smithi182.stdout:lab-extras 458 kB/s | 24 kB 00:00 2022-12-01T09:42:25.431 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 535 kB/s | 24 kB 00:00 2022-12-01T09:42:26.259 INFO:teuthology.orchestra.run.smithi182.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 56 MB/s | 53 MB 00:00 2022-12-01T09:42:26.333 INFO:teuthology.orchestra.run.smithi079.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2022-12-01T09:42:34.318 INFO:teuthology.orchestra.run.smithi182.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 61 MB/s | 48 MB 00:00 2022-12-01T09:42:34.808 INFO:teuthology.orchestra.run.smithi079.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 52 MB/s | 48 MB 00:00 2022-12-01T09:42:45.411 INFO:teuthology.orchestra.run.smithi182.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-12-01T09:42:45.412 INFO:teuthology.orchestra.run.smithi182.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-12-01T09:42:45.427 INFO:teuthology.orchestra.run.smithi182.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-12-01T09:42:45.428 INFO:teuthology.orchestra.run.smithi182.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-12-01T09:42:45.429 INFO:teuthology.orchestra.run.smithi182.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-12-01T09:42:45.430 INFO:teuthology.orchestra.run.smithi182.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-12-01T09:42:45.433 INFO:teuthology.orchestra.run.smithi182.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-12-01T09:42:45.436 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-12-01T09:42:45.437 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-12-01T09:42:45.572 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2022-12-01T09:42:45.584 INFO:teuthology.orchestra.run.smithi182.stdout:=========================================================================================================================== 2022-12-01T09:42:45.584 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2022-12-01T09:42:45.585 INFO:teuthology.orchestra.run.smithi182.stdout:=========================================================================================================================== 2022-12-01T09:42:45.585 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2022-12-01T09:42:45.585 INFO:teuthology.orchestra.run.smithi182.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2022-12-01T09:42:45.585 INFO:teuthology.orchestra.run.smithi182.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-12-01T09:42:45.586 INFO:teuthology.orchestra.run.smithi182.stdout: ceph x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 6.4 k 2022-12-01T09:42:45.586 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-base x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 5.2 M 2022-12-01T09:42:45.586 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-fuse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 845 k 2022-12-01T09:42:45.586 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 165 k 2022-12-01T09:42:45.587 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 1.5 M 2022-12-01T09:42:45.587 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-cephadm noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 118 k 2022-12-01T09:42:45.587 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-dashboard noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 1.7 M 2022-12-01T09:42:45.588 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 7.4 M 2022-12-01T09:42:45.588 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-rook noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 47 k 2022-12-01T09:42:45.588 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-radosgw x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 18 M 2022-12-01T09:42:45.588 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-test x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 55 M 2022-12-01T09:42:45.589 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-volume noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 263 k 2022-12-01T09:42:45.589 INFO:teuthology.orchestra.run.smithi182.stdout: cephadm noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 81 k 2022-12-01T09:42:45.589 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-mirror x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 257 k 2022-12-01T09:42:45.589 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-top noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 15 k 2022-12-01T09:42:45.589 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-12-01T09:42:45.590 INFO:teuthology.orchestra.run.smithi182.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-12-01T09:42:45.590 INFO:teuthology.orchestra.run.smithi182.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-12-01T09:42:45.590 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs-devel x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 30 k 2022-12-01T09:42:45.590 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 768 k 2022-12-01T09:42:45.591 INFO:teuthology.orchestra.run.smithi182.stdout: librados-devel x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 139 k 2022-12-01T09:42:45.591 INFO:teuthology.orchestra.run.smithi182.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-12-01T09:42:45.593 INFO:teuthology.orchestra.run.smithi182.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-12-01T09:42:45.593 INFO:teuthology.orchestra.run.smithi182.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-12-01T09:42:45.593 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2022-12-01T09:42:45.593 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2022-12-01T09:42:45.594 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2022-12-01T09:42:45.594 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cephfs x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 190 k 2022-12-01T09:42:45.594 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rados x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 370 k 2022-12-01T09:42:45.594 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rbd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 364 k 2022-12-01T09:42:45.595 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rgw x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 107 k 2022-12-01T09:42:45.595 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-fuse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 94 k 2022-12-01T09:42:45.595 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-mirror x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.5 M 2022-12-01T09:42:45.595 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-nbd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 177 k 2022-12-01T09:42:45.596 INFO:teuthology.orchestra.run.smithi182.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-12-01T09:42:45.596 INFO:teuthology.orchestra.run.smithi182.stdout:Upgrading: 2022-12-01T09:42:45.596 INFO:teuthology.orchestra.run.smithi182.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2022-12-01T09:42:45.597 INFO:teuthology.orchestra.run.smithi182.stdout: librados2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.6 M 2022-12-01T09:42:45.597 INFO:teuthology.orchestra.run.smithi182.stdout: librbd1 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.6 M 2022-12-01T09:42:45.597 INFO:teuthology.orchestra.run.smithi182.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-12-01T09:42:45.597 INFO:teuthology.orchestra.run.smithi182.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-12-01T09:42:45.597 INFO:teuthology.orchestra.run.smithi182.stdout:Installing dependencies: 2022-12-01T09:42:45.598 INFO:teuthology.orchestra.run.smithi182.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-12-01T09:42:45.598 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-common x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 24 M 2022-12-01T09:42:45.598 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-grafana-dashboards noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 23 k 2022-12-01T09:42:45.598 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mds x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 2.3 M 2022-12-01T09:42:45.599 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-modules-core noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 234 k 2022-12-01T09:42:45.599 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mon x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.9 M 2022-12-01T09:42:45.599 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-osd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 17 M 2022-12-01T09:42:45.599 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-prometheus-alerts noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 14 k 2022-12-01T09:42:45.599 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-selinux x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 24 k 2022-12-01T09:42:45.600 INFO:teuthology.orchestra.run.smithi182.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-12-01T09:42:45.600 INFO:teuthology.orchestra.run.smithi182.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-12-01T09:42:45.600 INFO:teuthology.orchestra.run.smithi182.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-12-01T09:42:45.600 INFO:teuthology.orchestra.run.smithi182.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-12-01T09:42:45.601 INFO:teuthology.orchestra.run.smithi182.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-12-01T09:42:45.601 INFO:teuthology.orchestra.run.smithi182.stdout: libcephsqlite x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 137 k 2022-12-01T09:42:45.601 INFO:teuthology.orchestra.run.smithi182.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-12-01T09:42:45.601 INFO:teuthology.orchestra.run.smithi182.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-12-01T09:42:45.601 INFO:teuthology.orchestra.run.smithi182.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-12-01T09:42:45.602 INFO:teuthology.orchestra.run.smithi182.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2022-12-01T09:42:45.602 INFO:teuthology.orchestra.run.smithi182.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-12-01T09:42:45.602 INFO:teuthology.orchestra.run.smithi182.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-12-01T09:42:45.602 INFO:teuthology.orchestra.run.smithi182.stdout: libradosstriper1 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 474 k 2022-12-01T09:42:45.603 INFO:teuthology.orchestra.run.smithi182.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-12-01T09:42:45.603 INFO:teuthology.orchestra.run.smithi182.stdout: librgw2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 6.5 M 2022-12-01T09:42:45.603 INFO:teuthology.orchestra.run.smithi182.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-12-01T09:42:45.604 INFO:teuthology.orchestra.run.smithi182.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-12-01T09:42:45.604 INFO:teuthology.orchestra.run.smithi182.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-12-01T09:42:45.605 INFO:teuthology.orchestra.run.smithi182.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-12-01T09:42:45.605 INFO:teuthology.orchestra.run.smithi182.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-12-01T09:42:45.606 INFO:teuthology.orchestra.run.smithi182.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-12-01T09:42:45.606 INFO:teuthology.orchestra.run.smithi182.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-12-01T09:42:45.606 INFO:teuthology.orchestra.run.smithi182.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-12-01T09:42:45.607 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-12-01T09:42:45.607 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-12-01T09:42:45.608 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-12-01T09:42:45.608 INFO:teuthology.orchestra.run.smithi182.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-12-01T09:42:45.608 INFO:teuthology.orchestra.run.smithi182.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-12-01T09:42:45.609 INFO:teuthology.orchestra.run.smithi182.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-12-01T09:42:45.609 INFO:teuthology.orchestra.run.smithi182.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-12-01T09:42:45.610 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-12-01T09:42:45.610 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-argparse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 45 k 2022-12-01T09:42:45.610 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-common x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 109 k 2022-12-01T09:42:45.611 INFO:teuthology.orchestra.run.smithi182.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-12-01T09:42:45.611 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-12-01T09:42:45.611 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-12-01T09:42:45.611 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-12-01T09:42:45.612 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-12-01T09:42:45.612 INFO:teuthology.orchestra.run.smithi182.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-12-01T09:42:45.612 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-12-01T09:42:45.612 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-12-01T09:42:45.613 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-12-01T09:42:45.613 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-12-01T09:42:45.613 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-12-01T09:42:45.613 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-12-01T09:42:45.614 INFO:teuthology.orchestra.run.smithi182.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-12-01T09:42:45.614 INFO:teuthology.orchestra.run.smithi182.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-12-01T09:42:45.614 INFO:teuthology.orchestra.run.smithi182.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-12-01T09:42:45.614 INFO:teuthology.orchestra.run.smithi182.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-12-01T09:42:45.614 INFO:teuthology.orchestra.run.smithi182.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-12-01T09:42:45.615 INFO:teuthology.orchestra.run.smithi182.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-12-01T09:42:45.615 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-12-01T09:42:45.615 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-12-01T09:42:45.615 INFO:teuthology.orchestra.run.smithi182.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-12-01T09:42:45.616 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-12-01T09:42:45.616 INFO:teuthology.orchestra.run.smithi182.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-12-01T09:42:45.616 INFO:teuthology.orchestra.run.smithi182.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-12-01T09:42:45.616 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-12-01T09:42:45.617 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-12-01T09:42:45.617 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-12-01T09:42:45.617 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-12-01T09:42:45.617 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-12-01T09:42:45.617 INFO:teuthology.orchestra.run.smithi182.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-12-01T09:42:45.618 INFO:teuthology.orchestra.run.smithi182.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-12-01T09:42:45.618 INFO:teuthology.orchestra.run.smithi182.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-12-01T09:42:45.618 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-12-01T09:42:45.618 INFO:teuthology.orchestra.run.smithi182.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-12-01T09:42:45.619 INFO:teuthology.orchestra.run.smithi182.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-12-01T09:42:45.619 INFO:teuthology.orchestra.run.smithi182.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-12-01T09:42:45.619 INFO:teuthology.orchestra.run.smithi182.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-12-01T09:42:45.619 INFO:teuthology.orchestra.run.smithi182.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-12-01T09:42:45.619 INFO:teuthology.orchestra.run.smithi182.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-12-01T09:42:45.620 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-12-01T09:42:45.620 INFO:teuthology.orchestra.run.smithi182.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-12-01T09:42:45.620 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-12-01T09:42:45.620 INFO:teuthology.orchestra.run.smithi182.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-12-01T09:42:45.621 INFO:teuthology.orchestra.run.smithi182.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-12-01T09:42:45.621 INFO:teuthology.orchestra.run.smithi182.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-12-01T09:42:45.621 INFO:teuthology.orchestra.run.smithi182.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-12-01T09:42:45.621 INFO:teuthology.orchestra.run.smithi182.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2022-12-01T09:42:45.621 INFO:teuthology.orchestra.run.smithi182.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-12-01T09:42:45.622 INFO:teuthology.orchestra.run.smithi182.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-12-01T09:42:45.622 INFO:teuthology.orchestra.run.smithi182.stdout:Enabling module streams: 2022-12-01T09:42:45.622 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql 10 2022-12-01T09:42:45.622 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:42:45.623 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2022-12-01T09:42:45.623 INFO:teuthology.orchestra.run.smithi182.stdout:=========================================================================================================================== 2022-12-01T09:42:45.623 INFO:teuthology.orchestra.run.smithi182.stdout:Install 128 Packages 2022-12-01T09:42:45.623 INFO:teuthology.orchestra.run.smithi182.stdout:Upgrade 5 Packages 2022-12-01T09:42:45.624 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:42:45.624 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 219 M 2022-12-01T09:42:45.625 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading Packages: 2022-12-01T09:42:45.784 INFO:teuthology.orchestra.run.smithi182.stdout:(1/133): ceph-18.0.0-676.gf6922ca2.el8.x86_64.r 35 kB/s | 6.4 kB 00:00 2022-12-01T09:42:45.894 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-12-01T09:42:45.895 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-12-01T09:42:45.909 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-12-01T09:42:45.910 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-12-01T09:42:45.911 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-12-01T09:42:45.913 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-12-01T09:42:45.915 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-12-01T09:42:45.918 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-12-01T09:42:45.919 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-12-01T09:42:46.051 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2022-12-01T09:42:46.063 INFO:teuthology.orchestra.run.smithi079.stdout:=========================================================================================================================== 2022-12-01T09:42:46.063 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2022-12-01T09:42:46.063 INFO:teuthology.orchestra.run.smithi079.stdout:=========================================================================================================================== 2022-12-01T09:42:46.064 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2022-12-01T09:42:46.064 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2022-12-01T09:42:46.064 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-12-01T09:42:46.064 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 6.4 k 2022-12-01T09:42:46.065 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 5.2 M 2022-12-01T09:42:46.065 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 845 k 2022-12-01T09:42:46.065 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 165 k 2022-12-01T09:42:46.065 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 1.5 M 2022-12-01T09:42:46.066 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 118 k 2022-12-01T09:42:46.066 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 1.7 M 2022-12-01T09:42:46.066 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 7.4 M 2022-12-01T09:42:46.066 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 47 k 2022-12-01T09:42:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 18 M 2022-12-01T09:42:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 55 M 2022-12-01T09:42:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 263 k 2022-12-01T09:42:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 81 k 2022-12-01T09:42:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 257 k 2022-12-01T09:42:46.068 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 15 k 2022-12-01T09:42:46.068 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-12-01T09:42:46.068 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-12-01T09:42:46.068 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-12-01T09:42:46.069 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 30 k 2022-12-01T09:42:46.069 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 768 k 2022-12-01T09:42:46.069 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 139 k 2022-12-01T09:42:46.069 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-12-01T09:42:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-12-01T09:42:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-12-01T09:42:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2022-12-01T09:42:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2022-12-01T09:42:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2022-12-01T09:42:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 190 k 2022-12-01T09:42:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 370 k 2022-12-01T09:42:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 364 k 2022-12-01T09:42:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 107 k 2022-12-01T09:42:46.072 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 94 k 2022-12-01T09:42:46.072 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.5 M 2022-12-01T09:42:46.072 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 177 k 2022-12-01T09:42:46.072 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-12-01T09:42:46.073 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2022-12-01T09:42:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2022-12-01T09:42:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.6 M 2022-12-01T09:42:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.6 M 2022-12-01T09:42:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-12-01T09:42:46.074 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-12-01T09:42:46.074 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2022-12-01T09:42:46.074 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-12-01T09:42:46.074 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 24 M 2022-12-01T09:42:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 23 k 2022-12-01T09:42:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 2.3 M 2022-12-01T09:42:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 234 k 2022-12-01T09:42:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.9 M 2022-12-01T09:42:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 17 M 2022-12-01T09:42:46.076 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 14 k 2022-12-01T09:42:46.076 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 24 k 2022-12-01T09:42:46.076 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-12-01T09:42:46.076 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-12-01T09:42:46.077 INFO:teuthology.orchestra.run.smithi079.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-12-01T09:42:46.077 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-12-01T09:42:46.077 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-12-01T09:42:46.077 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 137 k 2022-12-01T09:42:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-12-01T09:42:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-12-01T09:42:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-12-01T09:42:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2022-12-01T09:42:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-12-01T09:42:46.079 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-12-01T09:42:46.079 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 474 k 2022-12-01T09:42:46.079 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-12-01T09:42:46.079 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 6.5 M 2022-12-01T09:42:46.080 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-12-01T09:42:46.080 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-12-01T09:42:46.080 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-12-01T09:42:46.080 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-12-01T09:42:46.081 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-12-01T09:42:46.081 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-12-01T09:42:46.081 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-12-01T09:42:46.081 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-12-01T09:42:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-12-01T09:42:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-12-01T09:42:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-12-01T09:42:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-12-01T09:42:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-12-01T09:42:46.083 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-12-01T09:42:46.083 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-12-01T09:42:46.083 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-12-01T09:42:46.083 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 45 k 2022-12-01T09:42:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 109 k 2022-12-01T09:42:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-12-01T09:42:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-12-01T09:42:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-12-01T09:42:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-12-01T09:42:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-12-01T09:42:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-12-01T09:42:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-12-01T09:42:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-12-01T09:42:46.086 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-12-01T09:42:46.086 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-12-01T09:42:46.086 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-12-01T09:42:46.086 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-12-01T09:42:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-12-01T09:42:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-12-01T09:42:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-12-01T09:42:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-12-01T09:42:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-12-01T09:42:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-12-01T09:42:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-12-01T09:42:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-12-01T09:42:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-12-01T09:42:46.089 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-12-01T09:42:46.089 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-12-01T09:42:46.089 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-12-01T09:42:46.089 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-12-01T09:42:46.090 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-12-01T09:42:46.090 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-12-01T09:42:46.090 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-12-01T09:42:46.090 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-12-01T09:42:46.091 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-12-01T09:42:46.091 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-12-01T09:42:46.091 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-12-01T09:42:46.091 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-12-01T09:42:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-12-01T09:42:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-12-01T09:42:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-12-01T09:42:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-12-01T09:42:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-12-01T09:42:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-12-01T09:42:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-12-01T09:42:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-12-01T09:42:46.094 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-12-01T09:42:46.094 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-12-01T09:42:46.094 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-12-01T09:42:46.094 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-12-01T09:42:46.095 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-12-01T09:42:46.095 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2022-12-01T09:42:46.095 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-12-01T09:42:46.095 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-12-01T09:42:46.096 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling module streams: 2022-12-01T09:42:46.096 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql 10 2022-12-01T09:42:46.096 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:42:46.096 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2022-12-01T09:42:46.096 INFO:teuthology.orchestra.run.smithi079.stdout:=========================================================================================================================== 2022-12-01T09:42:46.097 INFO:teuthology.orchestra.run.smithi079.stdout:Install 128 Packages 2022-12-01T09:42:46.097 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 5 Packages 2022-12-01T09:42:46.097 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:42:46.098 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 219 M 2022-12-01T09:42:46.098 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2022-12-01T09:42:46.324 INFO:teuthology.orchestra.run.smithi079.stdout:(1/133): ceph-18.0.0-676.gf6922ca2.el8.x86_64.r 26 kB/s | 6.4 kB 00:00 2022-12-01T09:42:46.326 INFO:teuthology.orchestra.run.smithi182.stdout:(2/133): ceph-fuse-18.0.0-676.gf6922ca2.el8.x86 1.5 MB/s | 845 kB 00:00 2022-12-01T09:42:46.420 INFO:teuthology.orchestra.run.smithi182.stdout:(3/133): ceph-immutable-object-cache-18.0.0-676 1.8 MB/s | 165 kB 00:00 2022-12-01T09:42:46.850 INFO:teuthology.orchestra.run.smithi079.stdout:(2/133): ceph-fuse-18.0.0-676.gf6922ca2.el8.x86 1.6 MB/s | 845 kB 00:00 2022-12-01T09:42:46.958 INFO:teuthology.orchestra.run.smithi079.stdout:(3/133): ceph-immutable-object-cache-18.0.0-676 1.5 MB/s | 165 kB 00:00 2022-12-01T09:42:47.144 INFO:teuthology.orchestra.run.smithi182.stdout:(4/133): ceph-mds-18.0.0-676.gf6922ca2.el8.x86_ 3.1 MB/s | 2.3 MB 00:00 2022-12-01T09:42:47.227 INFO:teuthology.orchestra.run.smithi182.stdout:(5/133): ceph-base-18.0.0-676.gf6922ca2.el8.x86 3.2 MB/s | 5.2 MB 00:01 2022-12-01T09:42:47.611 INFO:teuthology.orchestra.run.smithi182.stdout:(6/133): ceph-mgr-18.0.0-676.gf6922ca2.el8.x86_ 3.3 MB/s | 1.5 MB 00:00 2022-12-01T09:42:47.841 INFO:teuthology.orchestra.run.smithi079.stdout:(4/133): ceph-mds-18.0.0-676.gf6922ca2.el8.x86_ 2.6 MB/s | 2.3 MB 00:00 2022-12-01T09:42:47.878 INFO:teuthology.orchestra.run.smithi182.stdout:(7/133): ceph-mon-18.0.0-676.gf6922ca2.el8.x86_ 5.9 MB/s | 3.9 MB 00:00 2022-12-01T09:42:48.067 INFO:teuthology.orchestra.run.smithi079.stdout:(5/133): ceph-base-18.0.0-676.gf6922ca2.el8.x86 2.6 MB/s | 5.2 MB 00:01 2022-12-01T09:42:48.500 INFO:teuthology.orchestra.run.smithi079.stdout:(6/133): ceph-mgr-18.0.0-676.gf6922ca2.el8.x86_ 2.3 MB/s | 1.5 MB 00:00 2022-12-01T09:42:49.445 INFO:teuthology.orchestra.run.smithi182.stdout:(8/133): ceph-osd-18.0.0-676.gf6922ca2.el8.x86_ 9.2 MB/s | 17 MB 00:01 2022-12-01T09:42:49.520 INFO:teuthology.orchestra.run.smithi182.stdout:(9/133): ceph-selinux-18.0.0-676.gf6922ca2.el8. 323 kB/s | 24 kB 00:00 2022-12-01T09:42:49.859 INFO:teuthology.orchestra.run.smithi079.stdout:(7/133): ceph-mon-18.0.0-676.gf6922ca2.el8.x86_ 2.2 MB/s | 3.9 MB 00:01 2022-12-01T09:42:50.829 INFO:teuthology.orchestra.run.smithi182.stdout:(10/133): ceph-common-18.0.0-676.gf6922ca2.el8. 4.7 MB/s | 24 MB 00:05 2022-12-01T09:42:50.996 INFO:teuthology.orchestra.run.smithi182.stdout:(11/133): cephfs-mirror-18.0.0-676.gf6922ca2.el 1.5 MB/s | 257 kB 00:00 2022-12-01T09:42:51.079 INFO:teuthology.orchestra.run.smithi182.stdout:(12/133): libcephfs-devel-18.0.0-676.gf6922ca2. 366 kB/s | 30 kB 00:00 2022-12-01T09:42:51.287 INFO:teuthology.orchestra.run.smithi182.stdout:(13/133): libcephfs2-18.0.0-676.gf6922ca2.el8.x 3.6 MB/s | 768 kB 00:00 2022-12-01T09:42:51.396 INFO:teuthology.orchestra.run.smithi182.stdout:(14/133): libcephsqlite-18.0.0-676.gf6922ca2.el 1.2 MB/s | 137 kB 00:00 2022-12-01T09:42:51.597 INFO:teuthology.orchestra.run.smithi182.stdout:(15/133): ceph-radosgw-18.0.0-676.gf6922ca2.el8 4.9 MB/s | 18 MB 00:03 2022-12-01T09:42:51.647 INFO:teuthology.orchestra.run.smithi182.stdout:(16/133): librados-devel-18.0.0-676.gf6922ca2.e 554 kB/s | 139 kB 00:00 2022-12-01T09:42:51.731 INFO:teuthology.orchestra.run.smithi182.stdout:(17/133): libradosstriper1-18.0.0-676.gf6922ca2 3.5 MB/s | 474 kB 00:00 2022-12-01T09:42:51.839 INFO:teuthology.orchestra.run.smithi182.stdout:(18/133): python3-ceph-argparse-18.0.0-676.gf69 413 kB/s | 45 kB 00:00 2022-12-01T09:42:51.940 INFO:teuthology.orchestra.run.smithi182.stdout:(19/133): python3-ceph-common-18.0.0-676.gf6922 1.1 MB/s | 109 kB 00:00 2022-12-01T09:42:52.040 INFO:teuthology.orchestra.run.smithi182.stdout:(20/133): python3-cephfs-18.0.0-676.gf6922ca2.e 1.9 MB/s | 190 kB 00:00 2022-12-01T09:42:52.174 INFO:teuthology.orchestra.run.smithi182.stdout:(21/133): python3-rados-18.0.0-676.gf6922ca2.el 2.7 MB/s | 370 kB 00:00 2022-12-01T09:42:52.307 INFO:teuthology.orchestra.run.smithi182.stdout:(22/133): python3-rbd-18.0.0-676.gf6922ca2.el8. 2.7 MB/s | 364 kB 00:00 2022-12-01T09:42:52.407 INFO:teuthology.orchestra.run.smithi182.stdout:(23/133): python3-rgw-18.0.0-676.gf6922ca2.el8. 1.0 MB/s | 107 kB 00:00 2022-12-01T09:42:52.491 INFO:teuthology.orchestra.run.smithi182.stdout:(24/133): rbd-fuse-18.0.0-676.gf6922ca2.el8.x86 1.1 MB/s | 94 kB 00:00 2022-12-01T09:42:53.041 INFO:teuthology.orchestra.run.smithi182.stdout:(25/133): librgw2-18.0.0-676.gf6922ca2.el8.x86_ 4.6 MB/s | 6.5 MB 00:01 2022-12-01T09:42:53.108 INFO:teuthology.orchestra.run.smithi182.stdout:(26/133): rbd-mirror-18.0.0-676.gf6922ca2.el8.x 5.6 MB/s | 3.5 MB 00:00 2022-12-01T09:42:53.134 INFO:teuthology.orchestra.run.smithi182.stdout:(27/133): rbd-nbd-18.0.0-676.gf6922ca2.el8.x86_ 1.9 MB/s | 177 kB 00:00 2022-12-01T09:42:53.201 INFO:teuthology.orchestra.run.smithi182.stdout:(28/133): ceph-grafana-dashboards-18.0.0-676.gf 248 kB/s | 23 kB 00:00 2022-12-01T09:42:53.226 INFO:teuthology.orchestra.run.smithi182.stdout:(29/133): ceph-mgr-cephadm-18.0.0-676.gf6922ca2 1.3 MB/s | 118 kB 00:00 2022-12-01T09:42:53.501 INFO:teuthology.orchestra.run.smithi182.stdout:(30/133): ceph-mgr-dashboard-18.0.0-676.gf6922c 5.5 MB/s | 1.7 MB 00:00 2022-12-01T09:42:53.585 INFO:teuthology.orchestra.run.smithi182.stdout:(31/133): ceph-mgr-modules-core-18.0.0-676.gf69 2.7 MB/s | 234 kB 00:00 2022-12-01T09:42:54.044 INFO:teuthology.orchestra.run.smithi182.stdout:(32/133): ceph-test-18.0.0-676.gf6922ca2.el8.x8 12 MB/s | 55 MB 00:04 2022-12-01T09:42:54.069 INFO:teuthology.orchestra.run.smithi182.stdout:(33/133): ceph-mgr-rook-18.0.0-676.gf6922ca2.el 97 kB/s | 47 kB 00:00 2022-12-01T09:42:54.094 INFO:teuthology.orchestra.run.smithi182.stdout:(34/133): ceph-prometheus-alerts-18.0.0-676.gf6 290 kB/s | 14 kB 00:00 2022-12-01T09:42:54.144 INFO:teuthology.orchestra.run.smithi182.stdout:(35/133): cephadm-18.0.0-676.gf6922ca2.el8.noar 1.6 MB/s | 81 kB 00:00 2022-12-01T09:42:54.170 INFO:teuthology.orchestra.run.smithi182.stdout:(36/133): ceph-volume-18.0.0-676.gf6922ca2.el8. 2.6 MB/s | 263 kB 00:00 2022-12-01T09:42:54.200 INFO:teuthology.orchestra.run.smithi079.stdout:(8/133): ceph-common-18.0.0-676.gf6922ca2.el8.x 3.0 MB/s | 24 MB 00:08 2022-12-01T09:42:54.237 INFO:teuthology.orchestra.run.smithi182.stdout:(37/133): cephfs-top-18.0.0-676.gf6922ca2.el8.n 168 kB/s | 15 kB 00:00 2022-12-01T09:42:54.250 INFO:teuthology.orchestra.run.smithi079.stdout:(9/133): ceph-selinux-18.0.0-676.gf6922ca2.el8. 490 kB/s | 24 kB 00:00 2022-12-01T09:42:54.462 INFO:teuthology.orchestra.run.smithi182.stdout:(38/133): liboath-2.6.2-3.el8.x86_64.rpm 261 kB/s | 59 kB 00:00 2022-12-01T09:42:54.546 INFO:teuthology.orchestra.run.smithi182.stdout:(39/133): ceph-mgr-diskprediction-local-18.0.0- 5.6 MB/s | 7.4 MB 00:01 2022-12-01T09:42:54.613 INFO:teuthology.orchestra.run.smithi182.stdout:(40/133): libunwind-1.3.1-3.el8.x86_64.rpm 500 kB/s | 75 kB 00:00 2022-12-01T09:42:54.679 INFO:teuthology.orchestra.run.smithi182.stdout:(41/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 655 kB/s | 44 kB 00:00 2022-12-01T09:42:54.709 INFO:teuthology.orchestra.run.smithi079.stdout:(10/133): ceph-osd-18.0.0-676.gf6922ca2.el8.x86 2.7 MB/s | 17 MB 00:06 2022-12-01T09:42:54.733 INFO:teuthology.orchestra.run.smithi182.stdout:(42/133): gperftools-libs-2.7-9.el8.x86_64.rpm 544 kB/s | 306 kB 00:00 2022-12-01T09:42:54.805 INFO:teuthology.orchestra.run.smithi182.stdout:(43/133): python3-cachetools-3.1.1-4.el8.noarch 462 kB/s | 33 kB 00:00 2022-12-01T09:42:54.876 INFO:teuthology.orchestra.run.smithi079.stdout:(11/133): cephfs-mirror-18.0.0-676.gf6922ca2.el 1.5 MB/s | 257 kB 00:00 2022-12-01T09:42:54.880 INFO:teuthology.orchestra.run.smithi182.stdout:(44/133): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2022-12-01T09:42:54.906 INFO:teuthology.orchestra.run.smithi182.stdout:(45/133): python3-beautifulsoup4-4.6.3-2.el8.1. 820 kB/s | 185 kB 00:00 2022-12-01T09:42:54.951 INFO:teuthology.orchestra.run.smithi079.stdout:(12/133): libcephfs-devel-18.0.0-676.gf6922ca2. 407 kB/s | 30 kB 00:00 2022-12-01T09:42:55.047 INFO:teuthology.orchestra.run.smithi182.stdout:(46/133): python3-cheroot-8.5.2-1.el8.noarch.rp 1.0 MB/s | 173 kB 00:00 2022-12-01T09:42:55.164 INFO:teuthology.orchestra.run.smithi182.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 697 kB/s | 81 kB 00:00 2022-12-01T09:42:55.176 INFO:teuthology.orchestra.run.smithi079.stdout:(13/133): libcephfs2-18.0.0-676.gf6922ca2.el8.x 3.3 MB/s | 768 kB 00:00 2022-12-01T09:42:55.198 INFO:teuthology.orchestra.run.smithi182.stdout:(48/133): python3-asyncssh-2.7.0-2.el8.noarch.r 730 kB/s | 476 kB 00:00 2022-12-01T09:42:55.260 INFO:teuthology.orchestra.run.smithi079.stdout:(14/133): libcephsqlite-18.0.0-676.gf6922ca2.el 1.6 MB/s | 137 kB 00:00 2022-12-01T09:42:55.265 INFO:teuthology.orchestra.run.smithi182.stdout:(49/133): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2022-12-01T09:42:55.290 INFO:teuthology.orchestra.run.smithi182.stdout:(50/133): python3-cherrypy-18.4.0-1.el8.noarch. 1.0 MB/s | 384 kB 00:00 2022-12-01T09:42:55.307 INFO:teuthology.orchestra.run.smithi182.stdout:(51/133): python3-jaraco-functools-2.0-4.el8.no 161 kB/s | 18 kB 00:00 2022-12-01T09:42:55.318 INFO:teuthology.orchestra.run.smithi079.stdout:(15/133): librados-devel-18.0.0-676.gf6922ca2.e 2.3 MB/s | 139 kB 00:00 2022-12-01T09:42:55.357 INFO:teuthology.orchestra.run.smithi182.stdout:(52/133): python3-logutils-0.3.5-11.el8.noarch. 729 kB/s | 49 kB 00:00 2022-12-01T09:42:55.383 INFO:teuthology.orchestra.run.smithi182.stdout:(53/133): python3-more-itertools-7.2.0-3.el8.no 781 kB/s | 59 kB 00:00 2022-12-01T09:42:55.433 INFO:teuthology.orchestra.run.smithi182.stdout:(54/133): python3-natsort-7.1.1-2.el8.noarch.rp 802 kB/s | 60 kB 00:00 2022-12-01T09:42:55.460 INFO:teuthology.orchestra.run.smithi079.stdout:(16/133): libradosstriper1-18.0.0-676.gf6922ca2 3.3 MB/s | 474 kB 00:00 2022-12-01T09:42:55.492 INFO:teuthology.orchestra.run.smithi182.stdout:(55/133): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2022-12-01T09:42:55.559 INFO:teuthology.orchestra.run.smithi182.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 505 kB/s | 34 kB 00:00 2022-12-01T09:42:55.659 INFO:teuthology.orchestra.run.smithi182.stdout:(57/133): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2022-12-01T09:42:55.717 INFO:teuthology.orchestra.run.smithi182.stdout:(58/133): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2022-12-01T09:42:55.768 INFO:teuthology.orchestra.run.smithi182.stdout:(59/133): python3-routes-2.4.1-12.el8.noarch.rp 941 kB/s | 196 kB 00:00 2022-12-01T09:42:55.793 INFO:teuthology.orchestra.run.smithi182.stdout:(60/133): python3-simplegeneric-0.8.1-17.el8.no 249 kB/s | 19 kB 00:00 2022-12-01T09:42:55.827 INFO:teuthology.orchestra.run.smithi182.stdout:(61/133): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2022-12-01T09:42:55.852 INFO:teuthology.orchestra.run.smithi182.stdout:(62/133): python3-tempora-1.14.1-5.el8.noarch.r 499 kB/s | 29 kB 00:00 2022-12-01T09:42:55.886 INFO:teuthology.orchestra.run.smithi182.stdout:(63/133): python3-trustme-0.6.0-4.el8.noarch.rp 469 kB/s | 27 kB 00:00 2022-12-01T09:42:55.961 INFO:teuthology.orchestra.run.smithi182.stdout:(64/133): python3-kubernetes-11.0.0-6.el8.noarc 1.7 MB/s | 1.2 MB 00:00 2022-12-01T09:42:56.020 INFO:teuthology.orchestra.run.smithi182.stdout:(65/133): python3-waitress-1.2.1-2.el8.1.noarch 1.4 MB/s | 241 kB 00:00 2022-12-01T09:42:56.045 INFO:teuthology.orchestra.run.smithi182.stdout:(66/133): python3-websocket-client-0.56.0-5.el8 731 kB/s | 61 kB 00:00 2022-12-01T09:42:56.112 INFO:teuthology.orchestra.run.smithi182.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 344 kB/s | 23 kB 00:00 2022-12-01T09:42:56.141 INFO:teuthology.orchestra.run.smithi182.stdout:(68/133): python3-webtest-2.0.33-1.el8.noarch.r 729 kB/s | 85 kB 00:00 2022-12-01T09:42:56.163 INFO:teuthology.orchestra.run.smithi182.stdout:(69/133): python3-webob-1.8.5-1.el8.1.noarch.rp 908 kB/s | 251 kB 00:00 2022-12-01T09:42:56.188 INFO:teuthology.orchestra.run.smithi182.stdout:(70/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2022-12-01T09:42:56.252 INFO:teuthology.orchestra.run.smithi079.stdout:(17/133): ceph-radosgw-18.0.0-676.gf6922ca2.el8 2.9 MB/s | 18 MB 00:06 2022-12-01T09:42:56.268 INFO:teuthology.orchestra.run.smithi182.stdout:(71/133): pcre2-devel-10.32-2.el8.x86_64.rpm 5.6 MB/s | 605 kB 00:00 2022-12-01T09:42:56.297 INFO:teuthology.orchestra.run.smithi182.stdout:(72/133): fuse-2.9.7-15.el8.x86_64.rpm 773 kB/s | 83 kB 00:00 2022-12-01T09:42:56.319 INFO:teuthology.orchestra.run.smithi079.stdout:(18/133): python3-ceph-argparse-18.0.0-676.gf69 674 kB/s | 45 kB 00:00 2022-12-01T09:42:56.339 INFO:teuthology.orchestra.run.smithi182.stdout:(73/133): libsepol-devel-2.9-3.el8.x86_64.rpm 1.2 MB/s | 87 kB 00:00 2022-12-01T09:42:56.364 INFO:teuthology.orchestra.run.smithi182.stdout:(74/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2022-12-01T09:42:56.378 INFO:teuthology.orchestra.run.smithi079.stdout:(19/133): python3-ceph-common-18.0.0-676.gf6922 1.8 MB/s | 109 kB 00:00 2022-12-01T09:42:56.406 INFO:teuthology.orchestra.run.smithi182.stdout:(75/133): libselinux-devel-2.9-5.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2022-12-01T09:42:56.431 INFO:teuthology.orchestra.run.smithi182.stdout:(76/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 272 kB/s | 18 kB 00:00 2022-12-01T09:42:56.470 INFO:teuthology.orchestra.run.smithi079.stdout:(20/133): python3-cephfs-18.0.0-676.gf6922ca2.e 2.0 MB/s | 190 kB 00:00 2022-12-01T09:42:56.473 INFO:teuthology.orchestra.run.smithi182.stdout:(77/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 702 kB/s | 47 kB 00:00 2022-12-01T09:42:56.507 INFO:teuthology.orchestra.run.smithi182.stdout:(78/133): python3-cryptography-3.2.1-5.el8.x86_ 7.3 MB/s | 559 kB 00:00 2022-12-01T09:42:56.541 INFO:teuthology.orchestra.run.smithi182.stdout:(79/133): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2022-12-01T09:42:56.557 INFO:teuthology.orchestra.run.smithi182.stdout:(80/133): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2022-12-01T09:42:56.599 INFO:teuthology.orchestra.run.smithi182.stdout:(81/133): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 171 kB 00:00 2022-12-01T09:42:56.608 INFO:teuthology.orchestra.run.smithi079.stdout:(21/133): python3-rados-18.0.0-676.gf6922ca2.el 2.6 MB/s | 370 kB 00:00 2022-12-01T09:42:56.625 INFO:teuthology.orchestra.run.smithi182.stdout:(82/133): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.5 MB/s | 560 kB 00:00 2022-12-01T09:42:56.658 INFO:teuthology.orchestra.run.smithi182.stdout:(83/133): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2022-12-01T09:42:56.675 INFO:teuthology.orchestra.run.smithi182.stdout:(84/133): python3-jwt-1.6.1-2.el8.noarch.rpm 565 kB/s | 43 kB 00:00 2022-12-01T09:42:56.712 INFO:teuthology.orchestra.run.smithi079.stdout:(22/133): python3-rbd-18.0.0-676.gf6922ca2.el8. 3.4 MB/s | 364 kB 00:00 2022-12-01T09:42:56.717 INFO:teuthology.orchestra.run.smithi182.stdout:(85/133): elfutils-libelf-devel-0.186-1.el8.x86 1.0 MB/s | 60 kB 00:00 2022-12-01T09:42:56.742 INFO:teuthology.orchestra.run.smithi182.stdout:(86/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2022-12-01T09:42:56.787 INFO:teuthology.orchestra.run.smithi079.stdout:(23/133): librgw2-18.0.0-676.gf6922ca2.el8.x86_ 4.9 MB/s | 6.5 MB 00:01 2022-12-01T09:42:56.793 INFO:teuthology.orchestra.run.smithi182.stdout:(87/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 248 kB/s | 19 kB 00:00 2022-12-01T09:42:56.812 INFO:teuthology.orchestra.run.smithi079.stdout:(24/133): python3-rgw-18.0.0-676.gf6922ca2.el8. 1.0 MB/s | 107 kB 00:00 2022-12-01T09:42:56.818 INFO:teuthology.orchestra.run.smithi182.stdout:(88/133): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.3 MB/s | 98 kB 00:00 2022-12-01T09:42:56.846 INFO:teuthology.orchestra.run.smithi079.stdout:(25/133): rbd-fuse-18.0.0-676.gf6922ca2.el8.x86 1.6 MB/s | 94 kB 00:00 2022-12-01T09:42:56.860 INFO:teuthology.orchestra.run.smithi182.stdout:(89/133): thrift-0.13.0-2.el8.x86_64.rpm 2.3 MB/s | 1.7 MB 00:00 2022-12-01T09:42:56.885 INFO:teuthology.orchestra.run.smithi182.stdout:(90/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2022-12-01T09:42:56.911 INFO:teuthology.orchestra.run.smithi182.stdout:(91/133): python3-requests-oauthlib-1.0.0-1.el8 468 kB/s | 43 kB 00:00 2022-12-01T09:42:56.944 INFO:teuthology.orchestra.run.smithi182.stdout:(92/133): libcom_err-devel-1.45.6-4.el8.x86_64. 678 kB/s | 39 kB 00:00 2022-12-01T09:42:56.946 INFO:teuthology.orchestra.run.smithi079.stdout:(26/133): rbd-nbd-18.0.0-676.gf6922ca2.el8.x86_ 1.7 MB/s | 177 kB 00:00 2022-12-01T09:42:56.970 INFO:teuthology.orchestra.run.smithi182.stdout:(93/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 668 kB/s | 72 kB 00:00 2022-12-01T09:42:56.995 INFO:teuthology.orchestra.run.smithi182.stdout:(94/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 954 kB/s | 48 kB 00:00 2022-12-01T09:42:57.013 INFO:teuthology.orchestra.run.smithi079.stdout:(27/133): ceph-grafana-dashboards-18.0.0-676.gf 343 kB/s | 23 kB 00:00 2022-12-01T09:42:57.089 INFO:teuthology.orchestra.run.smithi079.stdout:(28/133): ceph-mgr-cephadm-18.0.0-676.gf6922ca2 1.5 MB/s | 118 kB 00:00 2022-12-01T09:42:57.298 INFO:teuthology.orchestra.run.smithi182.stdout:(95/133): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.0 MB/s | 2.3 MB 00:00 2022-12-01T09:42:57.362 INFO:teuthology.orchestra.run.smithi182.stdout:(96/133): libgfortran-8.5.0-10.1.el8_6.x86_64.r 1.6 MB/s | 644 kB 00:00 2022-12-01T09:42:57.396 INFO:teuthology.orchestra.run.smithi182.stdout:(97/133): NetworkManager-initscripts-updown-1.3 343 kB/s | 138 kB 00:00 2022-12-01T09:42:57.438 INFO:teuthology.orchestra.run.smithi182.stdout:(98/133): bison-3.0.4-10.el8.x86_64.rpm 9.2 MB/s | 688 kB 00:00 2022-12-01T09:42:57.463 INFO:teuthology.orchestra.run.smithi182.stdout:(99/133): postgresql-contrib-10.21-2.module+el8 4.8 MB/s | 808 kB 00:00 2022-12-01T09:42:57.514 INFO:teuthology.orchestra.run.smithi182.stdout:(100/133): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2022-12-01T09:42:57.564 INFO:teuthology.orchestra.run.smithi182.stdout:(101/133): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2022-12-01T09:42:57.581 INFO:teuthology.orchestra.run.smithi079.stdout:(29/133): ceph-mgr-dashboard-18.0.0-676.gf6922c 3.4 MB/s | 1.7 MB 00:00 2022-12-01T09:42:57.631 INFO:teuthology.orchestra.run.smithi182.stdout:(102/133): python3-numpy-1.14.3-10.el8.x86_64.r 19 MB/s | 3.7 MB 00:00 2022-12-01T09:42:57.656 INFO:teuthology.orchestra.run.smithi182.stdout:(103/133): python3-markupsafe-0.23-19.el8.x86_6 423 kB/s | 39 kB 00:00 2022-12-01T09:42:57.731 INFO:teuthology.orchestra.run.smithi182.stdout:(104/133): postgresql-server-10.21-2.module+el8 19 MB/s | 5.1 MB 00:00 2022-12-01T09:42:57.747 INFO:teuthology.orchestra.run.smithi079.stdout:(30/133): rbd-mirror-18.0.0-676.gf6922ca2.el8.x 3.7 MB/s | 3.5 MB 00:00 2022-12-01T09:42:57.756 INFO:teuthology.orchestra.run.smithi182.stdout:(105/133): python3-prettytable-0.7.2-14.el8.noa 350 kB/s | 44 kB 00:00 2022-12-01T09:42:57.790 INFO:teuthology.orchestra.run.smithi182.stdout:(106/133): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2022-12-01T09:42:57.848 INFO:teuthology.orchestra.run.smithi079.stdout:(31/133): ceph-mgr-modules-core-18.0.0-676.gf69 2.3 MB/s | 234 kB 00:00 2022-12-01T09:42:57.854 INFO:teuthology.orchestra.run.smithi182.stdout:(107/133): python3-jinja2-2.10.1-3.el8.noarch.r 4.3 MB/s | 538 kB 00:00 2022-12-01T09:42:57.883 INFO:teuthology.orchestra.run.smithi182.stdout:(108/133): python3-numpy-f2py-1.14.3-10.el8.x86 2.4 MB/s | 225 kB 00:00 2022-12-01T09:42:57.915 INFO:teuthology.orchestra.run.smithi079.stdout:(32/133): ceph-mgr-rook-18.0.0-676.gf6922ca2.el 707 kB/s | 47 kB 00:00 2022-12-01T09:42:57.916 INFO:teuthology.orchestra.run.smithi182.stdout:(109/133): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2022-12-01T09:42:57.942 INFO:teuthology.orchestra.run.smithi182.stdout:(110/133): python3-mako-1.0.6-13.el8.noarch.rpm 2.7 MB/s | 157 kB 00:00 2022-12-01T09:42:57.965 INFO:teuthology.orchestra.run.smithi079.stdout:(33/133): ceph-prometheus-alerts-18.0.0-676.gf6 288 kB/s | 14 kB 00:00 2022-12-01T09:42:57.983 INFO:teuthology.orchestra.run.smithi182.stdout:(111/133): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2022-12-01T09:42:58.026 INFO:teuthology.orchestra.run.smithi182.stdout:(112/133): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2022-12-01T09:42:58.065 INFO:teuthology.orchestra.run.smithi079.stdout:(34/133): ceph-volume-18.0.0-676.gf6922ca2.el8. 2.6 MB/s | 263 kB 00:00 2022-12-01T09:42:58.084 INFO:teuthology.orchestra.run.smithi182.stdout:(113/133): openblas-threads-0.3.15-3.el8.x86_64 21 MB/s | 4.9 MB 00:00 2022-12-01T09:42:58.124 INFO:teuthology.orchestra.run.smithi079.stdout:(35/133): cephadm-18.0.0-676.gf6922ca2.el8.noar 1.4 MB/s | 81 kB 00:00 2022-12-01T09:42:58.159 INFO:teuthology.orchestra.run.smithi182.stdout:(114/133): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2022-12-01T09:42:58.184 INFO:teuthology.orchestra.run.smithi182.stdout:(115/133): flex-2.6.1-9.el8.x86_64.rpm 2.0 MB/s | 320 kB 00:00 2022-12-01T09:42:58.207 INFO:teuthology.orchestra.run.smithi079.stdout:(36/133): cephfs-top-18.0.0-676.gf6922ca2.el8.n 186 kB/s | 15 kB 00:00 2022-12-01T09:42:58.226 INFO:teuthology.orchestra.run.smithi182.stdout:(116/133): jq-1.6-3.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2022-12-01T09:42:58.277 INFO:teuthology.orchestra.run.smithi182.stdout:(117/133): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2022-12-01T09:42:58.366 INFO:teuthology.orchestra.run.smithi182.stdout:(118/133): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2022-12-01T09:42:58.402 INFO:teuthology.orchestra.run.smithi182.stdout:(119/133): python3-pytz-2017.2-9.el8.noarch.rpm 433 kB/s | 54 kB 00:00 2022-12-01T09:42:58.428 INFO:teuthology.orchestra.run.smithi182.stdout:(120/133): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.0 MB/s | 126 kB 00:00 2022-12-01T09:42:58.461 INFO:teuthology.orchestra.run.smithi182.stdout:(121/133): python3-jsonpointer-1.10-11.el8.noar 341 kB/s | 20 kB 00:00 2022-12-01T09:42:58.487 INFO:teuthology.orchestra.run.smithi182.stdout:(122/133): libpq-13.5-1.el8.x86_64.rpm 3.4 MB/s | 198 kB 00:00 2022-12-01T09:42:58.529 INFO:teuthology.orchestra.run.smithi182.stdout:(123/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2022-12-01T09:42:58.555 INFO:teuthology.orchestra.run.smithi182.stdout:(124/133): oniguruma-6.8.2-2.el8.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2022-12-01T09:42:58.588 INFO:teuthology.orchestra.run.smithi182.stdout:(125/133): python3-jsonpatch-1.21-2.el8.noarch. 453 kB/s | 27 kB 00:00 2022-12-01T09:42:58.616 INFO:teuthology.orchestra.run.smithi079.stdout:(37/133): gperftools-libs-2.7-9.el8.x86_64.rpm 750 kB/s | 306 kB 00:00 2022-12-01T09:42:58.638 INFO:teuthology.orchestra.run.smithi182.stdout:(126/133): uuid-1.6.2-43.el8.x86_64.rpm 776 kB/s | 64 kB 00:00 2022-12-01T09:42:58.675 INFO:teuthology.orchestra.run.smithi079.stdout:(38/133): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2022-12-01T09:42:58.680 INFO:teuthology.orchestra.run.smithi182.stdout:(127/133): python3-pyasn1-modules-0.3.7-6.el8.n 1.2 MB/s | 110 kB 00:00 2022-12-01T09:42:58.822 INFO:teuthology.orchestra.run.smithi182.stdout:(128/133): python3-scipy-1.0.0-21.module+el8.5. 22 MB/s | 14 MB 00:00 2022-12-01T09:42:58.833 INFO:teuthology.orchestra.run.smithi079.stdout:(39/133): libunwind-1.3.1-3.el8.x86_64.rpm 473 kB/s | 75 kB 00:00 2022-12-01T09:42:58.903 INFO:teuthology.orchestra.run.smithi182.stdout:(129/133): openssl-1.1.1k-7.el8_6.x86_64.rpm 8.7 MB/s | 709 kB 00:00 2022-12-01T09:42:58.964 INFO:teuthology.orchestra.run.smithi182.stdout:(130/133): openssl-libs-1.1.1k-7.el8_6.x86_64.r 24 MB/s | 1.5 MB 00:00 2022-12-01T09:42:59.014 INFO:teuthology.orchestra.run.smithi182.stdout:(131/133): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2022-12-01T09:42:59.209 INFO:teuthology.orchestra.run.smithi079.stdout:(40/133): ceph-mgr-diskprediction-local-18.0.0- 4.5 MB/s | 7.4 MB 00:01 2022-12-01T09:42:59.264 INFO:teuthology.orchestra.run.smithi182.stdout:(132/133): librados2-18.0.0-676.gf6922ca2.el8.x 5.8 MB/s | 3.6 MB 00:00 2022-12-01T09:42:59.284 INFO:teuthology.orchestra.run.smithi079.stdout:(41/133): python3-asyncssh-2.7.0-2.el8.noarch.r 1.0 MB/s | 476 kB 00:00 2022-12-01T09:42:59.456 INFO:teuthology.orchestra.run.smithi182.stdout:(133/133): librbd1-18.0.0-676.gf6922ca2.el8.x86 4.6 MB/s | 3.6 MB 00:00 2022-12-01T09:42:59.459 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2022-12-01T09:42:59.459 INFO:teuthology.orchestra.run.smithi182.stdout:Total 16 MB/s | 219 MB 00:13 2022-12-01T09:42:59.476 INFO:teuthology.orchestra.run.smithi079.stdout:(42/133): python3-beautifulsoup4-4.6.3-2.el8.1. 967 kB/s | 185 kB 00:00 2022-12-01T09:42:59.501 INFO:teuthology.orchestra.run.smithi079.stdout:(43/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 149 kB/s | 44 kB 00:00 2022-12-01T09:42:59.551 INFO:teuthology.orchestra.run.smithi079.stdout:(44/133): python3-cachetools-3.1.1-4.el8.noarch 439 kB/s | 33 kB 00:00 2022-12-01T09:42:59.585 INFO:teuthology.orchestra.run.smithi079.stdout:(45/133): python3-certifi-2018.10.15-7.el8.noar 195 kB/s | 16 kB 00:00 2022-12-01T09:42:59.818 INFO:teuthology.orchestra.run.smithi079.stdout:(46/133): python3-cheroot-8.5.2-1.el8.noarch.rp 647 kB/s | 173 kB 00:00 2022-12-01T09:42:59.952 INFO:teuthology.orchestra.run.smithi079.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 609 kB/s | 81 kB 00:00 2022-12-01T09:43:00.027 INFO:teuthology.orchestra.run.smithi079.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2022-12-01T09:43:00.053 INFO:teuthology.orchestra.run.smithi079.stdout:(49/133): python3-cherrypy-18.4.0-1.el8.noarch. 823 kB/s | 384 kB 00:00 2022-12-01T09:43:00.111 INFO:teuthology.orchestra.run.smithi079.stdout:(50/133): python3-jaraco-functools-2.0-4.el8.no 210 kB/s | 18 kB 00:00 2022-12-01T09:43:00.195 INFO:teuthology.orchestra.run.smithi079.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 586 kB/s | 49 kB 00:00 2022-12-01T09:43:00.270 INFO:teuthology.orchestra.run.smithi079.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 786 kB/s | 59 kB 00:00 2022-12-01T09:43:00.322 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2022-12-01T09:43:00.354 INFO:teuthology.orchestra.run.smithi079.stdout:(53/133): python3-natsort-7.1.1-2.el8.noarch.rp 723 kB/s | 60 kB 00:00 2022-12-01T09:43:00.482 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction check succeeded. 2022-12-01T09:43:00.482 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2022-12-01T09:43:00.612 INFO:teuthology.orchestra.run.smithi079.stdout:(54/133): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2022-12-01T09:43:00.721 INFO:teuthology.orchestra.run.smithi079.stdout:(55/133): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2022-12-01T09:43:00.805 INFO:teuthology.orchestra.run.smithi079.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 404 kB/s | 34 kB 00:00 2022-12-01T09:43:01.047 INFO:teuthology.orchestra.run.smithi079.stdout:(57/133): python3-routes-2.4.1-12.el8.noarch.rp 814 kB/s | 196 kB 00:00 2022-12-01T09:43:01.080 INFO:teuthology.orchestra.run.smithi079.stdout:(58/133): python3-kubernetes-11.0.0-6.el8.noarc 1.1 MB/s | 1.2 MB 00:01 2022-12-01T09:43:01.131 INFO:teuthology.orchestra.run.smithi079.stdout:(59/133): python3-rsa-4.8-1.el8.noarch.rpm 737 kB/s | 61 kB 00:00 2022-12-01T09:43:01.156 INFO:teuthology.orchestra.run.smithi079.stdout:(60/133): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2022-12-01T09:43:01.206 INFO:teuthology.orchestra.run.smithi079.stdout:(61/133): python3-singledispatch-3.4.0.3-18.el8 319 kB/s | 24 kB 00:00 2022-12-01T09:43:01.232 INFO:teuthology.orchestra.run.smithi079.stdout:(62/133): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2022-12-01T09:43:01.290 INFO:teuthology.orchestra.run.smithi079.stdout:(63/133): python3-trustme-0.6.0-4.el8.noarch.rp 329 kB/s | 27 kB 00:00 2022-12-01T09:43:01.425 INFO:teuthology.orchestra.run.smithi079.stdout:(64/133): python3-waitress-1.2.1-2.el8.1.noarch 1.2 MB/s | 241 kB 00:00 2022-12-01T09:43:01.466 INFO:teuthology.orchestra.run.smithi079.stdout:(65/133): python3-webob-1.8.5-1.el8.1.noarch.rp 1.4 MB/s | 251 kB 00:00 2022-12-01T09:43:01.508 INFO:teuthology.orchestra.run.smithi079.stdout:(66/133): python3-websocket-client-0.56.0-5.el8 734 kB/s | 61 kB 00:00 2022-12-01T09:43:01.541 INFO:teuthology.orchestra.run.smithi079.stdout:(67/133): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2022-12-01T09:43:01.591 INFO:teuthology.orchestra.run.smithi079.stdout:(68/133): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2022-12-01T09:43:01.647 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded. 2022-12-01T09:43:01.648 INFO:teuthology.orchestra.run.smithi079.stdout:(69/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 70 kB 00:00 2022-12-01T09:43:01.651 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2022-12-01T09:43:01.709 INFO:teuthology.orchestra.run.smithi079.stdout:(70/133): pcre2-devel-10.32-2.el8.x86_64.rpm 9.7 MB/s | 605 kB 00:00 2022-12-01T09:43:01.742 INFO:teuthology.orchestra.run.smithi079.stdout:(71/133): fuse-2.9.7-15.el8.x86_64.rpm 2.5 MB/s | 83 kB 00:00 2022-12-01T09:43:01.785 INFO:teuthology.orchestra.run.smithi079.stdout:(72/133): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2022-12-01T09:43:01.826 INFO:teuthology.orchestra.run.smithi079.stdout:(73/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2022-12-01T09:43:01.868 INFO:teuthology.orchestra.run.smithi079.stdout:(74/133): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2022-12-01T09:43:01.902 INFO:teuthology.orchestra.run.smithi079.stdout:(75/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 538 kB/s | 18 kB 00:00 2022-12-01T09:43:01.968 INFO:teuthology.orchestra.run.smithi079.stdout:(76/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 714 kB/s | 47 kB 00:00 2022-12-01T09:43:02.019 INFO:teuthology.orchestra.run.smithi079.stdout:(77/133): python3-cryptography-3.2.1-5.el8.x86_ 11 MB/s | 559 kB 00:00 2022-12-01T09:43:02.061 INFO:teuthology.orchestra.run.smithi079.stdout:(78/133): python3-oauthlib-2.1.0-1.el8.noarch.r 3.7 MB/s | 155 kB 00:00 2022-12-01T09:43:02.103 INFO:teuthology.orchestra.run.smithi079.stdout:(79/133): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2022-12-01T09:43:02.145 INFO:teuthology.orchestra.run.smithi079.stdout:(80/133): krb5-devel-1.18.2-14.el8.x86_64.rpm 13 MB/s | 560 kB 00:00 2022-12-01T09:43:02.187 INFO:teuthology.orchestra.run.smithi079.stdout:(81/133): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 171 kB 00:00 2022-12-01T09:43:02.221 INFO:teuthology.orchestra.run.smithi079.stdout:(82/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2022-12-01T09:43:02.296 INFO:teuthology.orchestra.run.smithi079.stdout:(83/133): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 767 kB/s | 58 kB 00:00 2022-12-01T09:43:02.338 INFO:teuthology.orchestra.run.smithi079.stdout:(84/133): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2022-12-01T09:43:02.380 INFO:teuthology.orchestra.run.smithi079.stdout:(85/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2022-12-01T09:43:02.414 INFO:teuthology.orchestra.run.smithi079.stdout:(86/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 564 kB/s | 19 kB 00:00 2022-12-01T09:43:02.448 INFO:teuthology.orchestra.run.smithi079.stdout:(87/133): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.9 MB/s | 98 kB 00:00 2022-12-01T09:43:02.489 INFO:teuthology.orchestra.run.smithi079.stdout:(88/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2022-12-01T09:43:02.523 INFO:teuthology.orchestra.run.smithi079.stdout:(89/133): python3-requests-oauthlib-1.0.0-1.el8 1.3 MB/s | 43 kB 00:00 2022-12-01T09:43:02.565 INFO:teuthology.orchestra.run.smithi079.stdout:(90/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2022-12-01T09:43:02.623 INFO:teuthology.orchestra.run.smithi079.stdout:(91/133): libcom_err-devel-1.45.6-4.el8.x86_64. 664 kB/s | 39 kB 00:00 2022-12-01T09:43:02.670 INFO:teuthology.orchestra.run.smithi079.stdout:(92/133): thrift-0.13.0-2.el8.x86_64.rpm 1.5 MB/s | 1.7 MB 00:01 2022-12-01T09:43:02.708 INFO:teuthology.orchestra.run.smithi079.stdout:(93/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2022-12-01T09:43:02.758 INFO:teuthology.orchestra.run.smithi079.stdout:(94/133): openssl-devel-1.1.1k-7.el8_6.x86_64.r 17 MB/s | 2.3 MB 00:00 2022-12-01T09:43:02.792 INFO:teuthology.orchestra.run.smithi079.stdout:(95/133): libgfortran-8.5.0-10.1.el8_6.x86_64.r 7.5 MB/s | 644 kB 00:00 2022-12-01T09:43:02.825 INFO:teuthology.orchestra.run.smithi079.stdout:(96/133): NetworkManager-initscripts-updown-1.3 2.0 MB/s | 138 kB 00:00 2022-12-01T09:43:02.859 INFO:teuthology.orchestra.run.smithi079.stdout:(97/133): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2022-12-01T09:43:02.920 INFO:teuthology.orchestra.run.smithi079.stdout:(98/133): bison-3.0.4-10.el8.x86_64.rpm 7.2 MB/s | 688 kB 00:00 2022-12-01T09:43:02.976 INFO:teuthology.orchestra.run.smithi079.stdout:(99/133): postgresql-10.21-2.module+el8.6.0+153 13 MB/s | 1.5 MB 00:00 2022-12-01T09:43:03.051 INFO:teuthology.orchestra.run.smithi079.stdout:(100/133): python3-numpy-1.14.3-10.el8.x86_64.r 29 MB/s | 3.7 MB 00:00 2022-12-01T09:43:03.093 INFO:teuthology.orchestra.run.smithi079.stdout:(101/133): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2022-12-01T09:43:03.169 INFO:teuthology.orchestra.run.smithi079.stdout:(102/133): postgresql-server-10.21-2.module+el8 26 MB/s | 5.1 MB 00:00 2022-12-01T09:43:03.194 INFO:teuthology.orchestra.run.smithi079.stdout:(103/133): python3-markupsafe-0.23-19.el8.x86_6 388 kB/s | 39 kB 00:00 2022-12-01T09:43:03.253 INFO:teuthology.orchestra.run.smithi079.stdout:(104/133): python3-prettytable-0.7.2-14.el8.noa 527 kB/s | 44 kB 00:00 2022-12-01T09:43:03.278 INFO:teuthology.orchestra.run.smithi079.stdout:(105/133): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2022-12-01T09:43:03.320 INFO:teuthology.orchestra.run.smithi079.stdout:(106/133): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2022-12-01T09:43:03.362 INFO:teuthology.orchestra.run.smithi079.stdout:(107/133): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2022-12-01T09:43:03.387 INFO:teuthology.orchestra.run.smithi079.stdout:(108/133): python3-numpy-f2py-1.14.3-10.el8.x86 3.3 MB/s | 225 kB 00:00 2022-12-01T09:43:03.429 INFO:teuthology.orchestra.run.smithi079.stdout:(109/133): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2022-12-01T09:43:03.543 INFO:teuthology.orchestra.run.smithi079.stdout:(110/133): openblas-threads-0.3.15-3.el8.x86_64 27 MB/s | 4.9 MB 00:00 2022-12-01T09:43:03.580 INFO:teuthology.orchestra.run.smithi079.stdout:(111/133): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.8 MB/s | 103 kB 00:00 2022-12-01T09:43:03.655 INFO:teuthology.orchestra.run.smithi079.stdout:(112/133): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2022-12-01T09:43:03.680 INFO:teuthology.orchestra.run.smithi079.stdout:(113/133): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2022-12-01T09:43:03.722 INFO:teuthology.orchestra.run.smithi079.stdout:(114/133): flex-2.6.1-9.el8.x86_64.rpm 4.7 MB/s | 320 kB 00:00 2022-12-01T09:43:03.764 INFO:teuthology.orchestra.run.smithi079.stdout:(115/133): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2022-12-01T09:43:03.863 INFO:teuthology.orchestra.run.smithi079.stdout:(116/133): openblas-0.3.15-3.el8.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2022-12-01T09:43:03.914 INFO:teuthology.orchestra.run.smithi079.stdout:(117/133): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2022-12-01T09:43:03.957 INFO:teuthology.orchestra.run.smithi079.stdout:(118/133): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2022-12-01T09:43:03.998 INFO:teuthology.orchestra.run.smithi079.stdout:(119/133): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2022-12-01T09:43:04.041 INFO:teuthology.orchestra.run.smithi079.stdout:(120/133): python3-jsonpointer-1.10-11.el8.noar 479 kB/s | 20 kB 00:00 2022-12-01T09:43:04.207 INFO:teuthology.orchestra.run.smithi079.stdout:(121/133): python3-scipy-1.0.0-21.module+el8.5. 31 MB/s | 14 MB 00:00 2022-12-01T09:43:04.233 INFO:teuthology.orchestra.run.smithi079.stdout:(122/133): libpq-13.5-1.el8.x86_64.rpm 1.0 MB/s | 198 kB 00:00 2022-12-01T09:43:04.274 INFO:teuthology.orchestra.run.smithi079.stdout:(123/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2022-12-01T09:43:04.300 INFO:teuthology.orchestra.run.smithi079.stdout:(124/133): oniguruma-6.8.2-2.el8.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2022-12-01T09:43:04.333 INFO:teuthology.orchestra.run.smithi079.stdout:(125/133): python3-jsonpatch-1.21-2.el8.noarch. 453 kB/s | 27 kB 00:00 2022-12-01T09:43:04.384 INFO:teuthology.orchestra.run.smithi079.stdout:(126/133): uuid-1.6.2-43.el8.x86_64.rpm 775 kB/s | 64 kB 00:00 2022-12-01T09:43:04.409 INFO:teuthology.orchestra.run.smithi079.stdout:(127/133): python3-pyasn1-modules-0.3.7-6.el8.n 1.4 MB/s | 110 kB 00:00 2022-12-01T09:43:05.718 INFO:teuthology.orchestra.run.smithi079.stdout:(128/133): ceph-test-18.0.0-676.gf6922ca2.el8.x 4.8 MB/s | 55 MB 00:11 2022-12-01T09:43:05.942 INFO:teuthology.orchestra.run.smithi079.stdout:(129/133): librados2-18.0.0-676.gf6922ca2.el8.x 2.3 MB/s | 3.6 MB 00:01 2022-12-01T09:43:06.002 INFO:teuthology.orchestra.run.smithi079.stdout:(130/133): librbd1-18.0.0-676.gf6922ca2.el8.x86 2.3 MB/s | 3.6 MB 00:01 2022-12-01T09:43:06.035 INFO:teuthology.orchestra.run.smithi079.stdout:(131/133): openssl-1.1.1k-7.el8_6.x86_64.rpm 2.2 MB/s | 709 kB 00:00 2022-12-01T09:43:06.107 INFO:teuthology.orchestra.run.smithi079.stdout:(132/133): openssl-libs-1.1.1k-7.el8_6.x86_64.r 8.9 MB/s | 1.5 MB 00:00 2022-12-01T09:43:06.144 INFO:teuthology.orchestra.run.smithi079.stdout:(133/133): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.5 MB/s | 798 kB 00:00 2022-12-01T09:43:06.146 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2022-12-01T09:43:06.147 INFO:teuthology.orchestra.run.smithi079.stdout:Total 11 MB/s | 219 MB 00:20 2022-12-01T09:43:06.876 INFO:teuthology.orchestra.run.smithi182.stdout: Preparing : 1/1 2022-12-01T09:43:07.022 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2022-12-01T09:43:07.166 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-12-01T09:43:07.180 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2022-12-01T09:43:07.180 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2022-12-01T09:43:07.371 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-12-01T09:43:07.540 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/138 2022-12-01T09:43:07.704 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/138 2022-12-01T09:43:07.889 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/138 2022-12-01T09:43:08.042 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 5/138 2022-12-01T09:43:08.123 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 5/138 2022-12-01T09:43:08.344 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2022-12-01T09:43:08.348 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2022-12-01T09:43:08.383 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-12-01T09:43:08.775 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-12-01T09:43:08.992 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 7/138 2022-12-01T09:43:09.385 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 7/138 2022-12-01T09:43:09.575 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 8/138 2022-12-01T09:43:09.701 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 8/138 2022-12-01T09:43:09.892 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 9/138 2022-12-01T09:43:09.972 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 9/138 2022-12-01T09:43:10.139 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 10/138 2022-12-01T09:43:10.410 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libpq-13.5-1.el8.x86_64 11/138 2022-12-01T09:43:10.578 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2022-12-01T09:43:10.952 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/138 2022-12-01T09:43:11.170 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/138 2022-12-01T09:43:11.341 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 15/138 2022-12-01T09:43:11.445 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 15/138 2022-12-01T09:43:11.627 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 16/138 2022-12-01T09:43:11.700 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 16/138 2022-12-01T09:43:11.877 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 17/138 2022-12-01T09:43:12.099 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 18/138 2022-12-01T09:43:12.298 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/138 2022-12-01T09:43:12.455 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 20/138 2022-12-01T09:43:12.557 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 21/138 2022-12-01T09:43:12.693 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 21/138 2022-12-01T09:43:12.850 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 22/138 2022-12-01T09:43:13.470 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 22/138 2022-12-01T09:43:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2022-12-01T09:43:13.882 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 23/138 2022-12-01T09:43:14.093 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-12-01T09:43:14.307 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-12-01T09:43:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/138 2022-12-01T09:43:14.482 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 23/138 2022-12-01T09:43:14.621 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/138 2022-12-01T09:43:14.641 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : openblas-0.3.15-3.el8.x86_64 24/138 2022-12-01T09:43:14.798 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/138 2022-12-01T09:43:14.984 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 5/138 2022-12-01T09:43:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 5/138 2022-12-01T09:43:15.267 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-12-01T09:43:15.319 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 24/138 2022-12-01T09:43:15.620 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/138 2022-12-01T09:43:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-12-01T09:43:15.885 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/138 2022-12-01T09:43:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 7/138 2022-12-01T09:43:16.055 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x 27/138 2022-12-01T09:43:16.192 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8 28/138 2022-12-01T09:43:16.294 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 7/138 2022-12-01T09:43:16.443 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 29/138 2022-12-01T09:43:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 8/138 2022-12-01T09:43:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 8/138 2022-12-01T09:43:16.649 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/138 2022-12-01T09:43:16.866 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 9/138 2022-12-01T09:43:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 9/138 2022-12-01T09:43:17.164 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 10/138 2022-12-01T09:43:17.402 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpq-13.5-1.el8.x86_64 11/138 2022-12-01T09:43:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2022-12-01T09:43:17.984 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/138 2022-12-01T09:43:18.220 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/138 2022-12-01T09:43:18.361 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/138 2022-12-01T09:43:18.366 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 15/138 2022-12-01T09:43:18.485 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 15/138 2022-12-01T09:43:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 16/138 2022-12-01T09:43:18.709 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/138 2022-12-01T09:43:18.768 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 16/138 2022-12-01T09:43:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 17/138 2022-12-01T09:43:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 18/138 2022-12-01T09:43:19.397 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/138 2022-12-01T09:43:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 20/138 2022-12-01T09:43:19.695 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/138 2022-12-01T09:43:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 21/138 2022-12-01T09:43:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 21/138 2022-12-01T09:43:20.033 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 22/138 2022-12-01T09:43:20.045 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/138 2022-12-01T09:43:20.282 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/138 2022-12-01T09:43:20.517 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/138 2022-12-01T09:43:20.630 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 22/138 2022-12-01T09:43:20.700 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/138 2022-12-01T09:43:20.841 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 23/138 2022-12-01T09:43:20.887 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 37/138 2022-12-01T09:43:21.109 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 38/138 2022-12-01T09:43:21.298 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/138 2022-12-01T09:43:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 23/138 2022-12-01T09:43:21.523 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/138 2022-12-01T09:43:21.601 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/138 2022-12-01T09:43:21.657 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.15-3.el8.x86_64 24/138 2022-12-01T09:43:21.789 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 41/138 2022-12-01T09:43:21.866 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 41/138 2022-12-01T09:43:22.063 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : jq-1.6-3.el8.x86_64 42/138 2022-12-01T09:43:22.222 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 43/138 2022-12-01T09:43:22.317 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 24/138 2022-12-01T09:43:22.449 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 44/138 2022-12-01T09:43:22.654 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/138 2022-12-01T09:43:22.706 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : automake-1.16.1-7.el8.noarch 45/138 2022-12-01T09:43:22.860 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 46/138 2022-12-01T09:43:22.930 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/138 2022-12-01T09:43:23.011 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 47/138 2022-12-01T09:43:23.071 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x 27/138 2022-12-01T09:43:23.167 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/138 2022-12-01T09:43:23.234 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8 28/138 2022-12-01T09:43:23.354 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 49/138 2022-12-01T09:43:23.518 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 29/138 2022-12-01T09:43:23.585 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 50/138 2022-12-01T09:43:23.690 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/138 2022-12-01T09:43:23.817 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/138 2022-12-01T09:43:24.246 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/138 2022-12-01T09:43:24.562 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/138 2022-12-01T09:43:24.750 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/138 2022-12-01T09:43:24.983 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/138 2022-12-01T09:43:25.260 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/138 2022-12-01T09:43:25.410 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/138 2022-12-01T09:43:25.570 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/138 2022-12-01T09:43:25.780 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/138 2022-12-01T09:43:25.816 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/138 2022-12-01T09:43:25.948 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/138 2022-12-01T09:43:26.183 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/138 2022-12-01T09:43:26.316 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 61/138 2022-12-01T09:43:26.617 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 62/138 2022-12-01T09:43:26.808 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/138 2022-12-01T09:43:26.809 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/138 2022-12-01T09:43:27.051 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 64/138 2022-12-01T09:43:27.143 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/138 2022-12-01T09:43:27.301 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/138 2022-12-01T09:43:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/138 2022-12-01T09:43:27.556 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/138 2022-12-01T09:43:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/138 2022-12-01T09:43:27.773 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : fuse-2.9.7-15.el8.x86_64 67/138 2022-12-01T09:43:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/138 2022-12-01T09:43:27.938 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 68/138 2022-12-01T09:43:28.106 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-12-01T09:43:28.130 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 37/138 2022-12-01T09:43:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 38/138 2022-12-01T09:43:28.430 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 70/138 2022-12-01T09:43:28.631 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/138 2022-12-01T09:43:28.646 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 71/138 2022-12-01T09:43:28.827 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 72/138 2022-12-01T09:43:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/138 2022-12-01T09:43:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/138 2022-12-01T09:43:28.966 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 73/138 2022-12-01T09:43:29.106 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 41/138 2022-12-01T09:43:29.147 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 74/138 2022-12-01T09:43:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 41/138 2022-12-01T09:43:29.387 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : jq-1.6-3.el8.x86_64 42/138 2022-12-01T09:43:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 43/138 2022-12-01T09:43:29.778 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 75/138 2022-12-01T09:43:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 44/138 2022-12-01T09:43:29.958 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 76/138 2022-12-01T09:43:30.005 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.1-7.el8.noarch 45/138 2022-12-01T09:43:30.125 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 77/138 2022-12-01T09:43:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 46/138 2022-12-01T09:43:30.303 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 78/138 2022-12-01T09:43:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 47/138 2022-12-01T09:43:30.508 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 79/138 2022-12-01T09:43:30.509 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/138 2022-12-01T09:43:30.683 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/138 2022-12-01T09:43:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 49/138 2022-12-01T09:43:30.885 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 81/138 2022-12-01T09:43:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 50/138 2022-12-01T09:43:31.124 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-portend-2.6-1.el8.noarch 82/138 2022-12-01T09:43:31.169 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/138 2022-12-01T09:43:31.337 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/138 2022-12-01T09:43:31.512 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 84/138 2022-12-01T09:43:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/138 2022-12-01T09:43:31.711 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 85/138 2022-12-01T09:43:31.864 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/138 2022-12-01T09:43:32.065 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/138 2022-12-01T09:43:32.282 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/138 2022-12-01T09:43:32.550 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/138 2022-12-01T09:43:32.800 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 86/138 2022-12-01T09:43:32.952 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/138 2022-12-01T09:43:33.057 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 87/138 2022-12-01T09:43:33.179 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/138 2022-12-01T09:43:33.281 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 88/138 2022-12-01T09:43:33.380 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/138 2022-12-01T09:43:33.569 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 89/138 2022-12-01T09:43:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/138 2022-12-01T09:43:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 61/138 2022-12-01T09:43:33.880 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 90/138 2022-12-01T09:43:34.054 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 91/138 2022-12-01T09:43:34.142 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 62/138 2022-12-01T09:43:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/138 2022-12-01T09:43:34.631 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 64/138 2022-12-01T09:43:34.820 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 92/138 2022-12-01T09:43:34.891 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/138 2022-12-01T09:43:35.004 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 93/138 2022-12-01T09:43:35.077 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 93/138 2022-12-01T09:43:35.180 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/138 2022-12-01T09:43:35.246 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 94/138 2022-12-01T09:43:35.372 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.7-15.el8.x86_64 67/138 2022-12-01T09:43:35.588 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 68/138 2022-12-01T09:43:35.800 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-12-01T09:43:36.089 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 70/138 2022-12-01T09:43:36.294 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 71/138 2022-12-01T09:43:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 72/138 2022-12-01T09:43:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 73/138 2022-12-01T09:43:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 74/138 2022-12-01T09:43:37.083 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 75/138 2022-12-01T09:43:37.640 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 76/138 2022-12-01T09:43:37.848 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 77/138 2022-12-01T09:43:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 78/138 2022-12-01T09:43:38.248 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 79/138 2022-12-01T09:43:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/138 2022-12-01T09:43:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 81/138 2022-12-01T09:43:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-2.6-1.el8.noarch 82/138 2022-12-01T09:43:39.027 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 95/138 2022-12-01T09:43:39.152 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/138 2022-12-01T09:43:39.221 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 95/138 2022-12-01T09:43:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 84/138 2022-12-01T09:43:39.561 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 85/138 2022-12-01T09:43:39.778 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 95/138 2022-12-01T09:43:40.558 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 96/138 2022-12-01T09:43:40.621 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 86/138 2022-12-01T09:43:40.658 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 96/138 2022-12-01T09:43:40.787 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 97/138 2022-12-01T09:43:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 87/138 2022-12-01T09:43:41.134 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 88/138 2022-12-01T09:43:41.453 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 89/138 2022-12-01T09:43:41.745 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 90/138 2022-12-01T09:43:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 91/138 2022-12-01T09:43:42.741 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 92/138 2022-12-01T09:43:42.895 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 93/138 2022-12-01T09:43:42.966 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 93/138 2022-12-01T09:43:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 94/138 2022-12-01T09:43:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 95/138 2022-12-01T09:43:47.168 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 95/138 2022-12-01T09:43:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 95/138 2022-12-01T09:43:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 96/138 2022-12-01T09:43:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 96/138 2022-12-01T09:43:48.976 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 97/138 2022-12-01T09:43:59.761 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 97/138 2022-12-01T09:43:59.761 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /sys 2022-12-01T09:43:59.762 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /proc 2022-12-01T09:43:59.762 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /dev 2022-12-01T09:43:59.762 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /run 2022-12-01T09:43:59.762 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /mnt 2022-12-01T09:43:59.763 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /var/tmp 2022-12-01T09:43:59.763 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /home 2022-12-01T09:43:59.763 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /tmp 2022-12-01T09:43:59.763 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /dev 2022-12-01T09:43:59.764 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:00.100 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 98/138 2022-12-01T09:44:01.584 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 98/138 2022-12-01T09:44:01.808 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 99/138 2022-12-01T09:44:02.025 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 99/138 2022-12-01T09:44:02.191 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 100/138 2022-12-01T09:44:02.572 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 100/138 2022-12-01T09:44:02.783 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 101/138 2022-12-01T09:44:02.801 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 101/138 2022-12-01T09:44:04.628 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 102/138 2022-12-01T09:44:04.768 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 102/138 2022-12-01T09:44:04.930 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el 103/138 2022-12-01T09:44:05.094 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.e 104/138 2022-12-01T09:44:05.257 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 105/138 2022-12-01T09:44:05.457 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 105/138 2022-12-01T09:44:05.640 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 106/138 2022-12-01T09:44:06.600 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 106/138 2022-12-01T09:44:06.757 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 107/138 2022-12-01T09:44:06.845 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 107/138 2022-12-01T09:44:07.224 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8 108/138 2022-12-01T09:44:07.381 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 109/138 2022-12-01T09:44:07.416 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 109/138 2022-12-01T09:44:07.599 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 110/138 2022-12-01T09:44:07.610 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 110/138 2022-12-01T09:44:07.892 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 97/138 2022-12-01T09:44:07.893 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2022-12-01T09:44:07.893 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2022-12-01T09:44:07.893 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2022-12-01T09:44:07.894 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /run 2022-12-01T09:44:07.894 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2022-12-01T09:44:07.895 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2022-12-01T09:44:07.895 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2022-12-01T09:44:07.895 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2022-12-01T09:44:07.896 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2022-12-01T09:44:07.896 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 98/138 2022-12-01T09:44:09.308 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 111/138 2022-12-01T09:44:09.525 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 112/138 2022-12-01T09:44:09.559 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 112/138 2022-12-01T09:44:09.699 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-676.gf6922c 113/138 2022-12-01T09:44:09.741 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-676.gf6922c 113/138 2022-12-01T09:44:09.770 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 98/138 2022-12-01T09:44:09.882 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 114/138 2022-12-01T09:44:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 99/138 2022-12-01T09:44:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 99/138 2022-12-01T09:44:10.231 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 114/138 2022-12-01T09:44:10.374 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 115/138 2022-12-01T09:44:10.397 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 100/138 2022-12-01T09:44:10.778 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 100/138 2022-12-01T09:44:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 101/138 2022-12-01T09:44:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 101/138 2022-12-01T09:44:12.694 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 102/138 2022-12-01T09:44:12.866 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 102/138 2022-12-01T09:44:12.994 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el 103/138 2022-12-01T09:44:13.198 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.e 104/138 2022-12-01T09:44:13.354 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 105/138 2022-12-01T09:44:13.572 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 105/138 2022-12-01T09:44:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 106/138 2022-12-01T09:44:14.839 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 106/138 2022-12-01T09:44:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 107/138 2022-12-01T09:44:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 107/138 2022-12-01T09:44:15.463 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 115/138 2022-12-01T09:44:15.489 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8 108/138 2022-12-01T09:44:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 109/138 2022-12-01T09:44:15.745 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 109/138 2022-12-01T09:44:15.820 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 116/138 2022-12-01T09:44:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 110/138 2022-12-01T09:44:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 110/138 2022-12-01T09:44:16.603 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 117/138 2022-12-01T09:44:16.891 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/138 2022-12-01T09:44:17.115 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 119/138 2022-12-01T09:44:17.297 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/138 2022-12-01T09:44:17.484 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/138 2022-12-01T09:44:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 111/138 2022-12-01T09:44:17.743 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 121/138 2022-12-01T09:44:17.834 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 112/138 2022-12-01T09:44:17.869 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 112/138 2022-12-01T09:44:17.918 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_6 122/138 2022-12-01T09:44:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-676.gf6922c 113/138 2022-12-01T09:44:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-676.gf6922c 113/138 2022-12-01T09:44:18.065 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/138 2022-12-01T09:44:18.229 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 114/138 2022-12-01T09:44:18.576 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 114/138 2022-12-01T09:44:18.720 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 115/138 2022-12-01T09:44:20.149 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-12-01T09:44:20.471 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-12-01T09:44:20.490 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-12-01T09:44:20.722 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 125/138 2022-12-01T09:44:20.920 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 126/138 2022-12-01T09:44:21.178 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 127/138 2022-12-01T09:44:21.549 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 128/138 2022-12-01T09:44:21.906 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 129/138 2022-12-01T09:44:22.130 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/138 2022-12-01T09:44:22.204 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/138 2022-12-01T09:44:22.430 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/138 2022-12-01T09:44:22.442 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/138 2022-12-01T09:44:22.588 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 132/138 2022-12-01T09:44:22.596 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 132/138 2022-12-01T09:44:22.734 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 133/138 2022-12-01T09:44:22.940 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-12-01T09:44:22.941 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-12-01T09:44:23.124 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-12-01T09:44:23.125 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 136/138 2022-12-01T09:44:23.324 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 136/138 2022-12-01T09:44:23.324 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-12-01T09:44:23.610 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-12-01T09:44:23.795 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 138/138 2022-12-01T09:44:23.809 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 115/138 2022-12-01T09:44:24.099 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 116/138 2022-12-01T09:44:24.341 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 138/138 2022-12-01T09:44:24.341 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 1/138 2022-12-01T09:44:24.341 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 2/138 2022-12-01T09:44:24.341 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 3/138 2022-12-01T09:44:24.342 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 4/138 2022-12-01T09:44:24.342 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-676.gf6922c 5/138 2022-12-01T09:44:24.342 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 6/138 2022-12-01T09:44:24.342 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 7/138 2022-12-01T09:44:24.343 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 8/138 2022-12-01T09:44:24.343 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 9/138 2022-12-01T09:44:24.343 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 10/138 2022-12-01T09:44:24.343 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 11/138 2022-12-01T09:44:24.344 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 12/138 2022-12-01T09:44:24.344 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 13/138 2022-12-01T09:44:24.344 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_6 14/138 2022-12-01T09:44:24.344 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 15/138 2022-12-01T09:44:24.345 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 16/138 2022-12-01T09:44:24.345 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 17/138 2022-12-01T09:44:24.345 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 18/138 2022-12-01T09:44:24.345 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 19/138 2022-12-01T09:44:24.345 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8 20/138 2022-12-01T09:44:24.346 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x 21/138 2022-12-01T09:44:24.346 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 22/138 2022-12-01T09:44:24.346 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 23/138 2022-12-01T09:44:24.346 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 24/138 2022-12-01T09:44:24.347 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 25/138 2022-12-01T09:44:24.347 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 26/138 2022-12-01T09:44:24.347 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 27/138 2022-12-01T09:44:24.361 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 28/138 2022-12-01T09:44:24.361 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.e 29/138 2022-12-01T09:44:24.361 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 30/138 2022-12-01T09:44:24.361 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 31/138 2022-12-01T09:44:24.361 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 32/138 2022-12-01T09:44:24.362 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8 33/138 2022-12-01T09:44:24.362 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 34/138 2022-12-01T09:44:24.362 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el 35/138 2022-12-01T09:44:24.362 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 36/138 2022-12-01T09:44:24.363 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 37/138 2022-12-01T09:44:24.363 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 38/138 2022-12-01T09:44:24.363 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/138 2022-12-01T09:44:24.364 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/138 2022-12-01T09:44:24.364 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/138 2022-12-01T09:44:24.364 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/138 2022-12-01T09:44:24.364 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/138 2022-12-01T09:44:24.365 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/138 2022-12-01T09:44:24.365 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/138 2022-12-01T09:44:24.365 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/138 2022-12-01T09:44:24.365 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/138 2022-12-01T09:44:24.366 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/138 2022-12-01T09:44:24.366 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/138 2022-12-01T09:44:24.366 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/138 2022-12-01T09:44:24.366 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2022-12-01T09:44:24.366 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/138 2022-12-01T09:44:24.367 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/138 2022-12-01T09:44:24.367 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/138 2022-12-01T09:44:24.367 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/138 2022-12-01T09:44:24.367 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/138 2022-12-01T09:44:24.368 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/138 2022-12-01T09:44:24.368 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/138 2022-12-01T09:44:24.368 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/138 2022-12-01T09:44:24.369 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/138 2022-12-01T09:44:24.369 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/138 2022-12-01T09:44:24.369 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/138 2022-12-01T09:44:24.369 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/138 2022-12-01T09:44:24.370 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/138 2022-12-01T09:44:24.370 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/138 2022-12-01T09:44:24.370 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/138 2022-12-01T09:44:24.370 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/138 2022-12-01T09:44:24.370 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/138 2022-12-01T09:44:24.371 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-12-01T09:44:24.371 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/138 2022-12-01T09:44:24.371 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/138 2022-12-01T09:44:24.371 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 72/138 2022-12-01T09:44:24.372 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 73/138 2022-12-01T09:44:24.372 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/138 2022-12-01T09:44:24.372 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/138 2022-12-01T09:44:24.372 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 76/138 2022-12-01T09:44:24.372 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 77/138 2022-12-01T09:44:24.373 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 78/138 2022-12-01T09:44:24.373 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 79/138 2022-12-01T09:44:24.373 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 80/138 2022-12-01T09:44:24.373 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 81/138 2022-12-01T09:44:24.374 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 82/138 2022-12-01T09:44:24.374 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 83/138 2022-12-01T09:44:24.374 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/138 2022-12-01T09:44:24.374 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/138 2022-12-01T09:44:24.375 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 86/138 2022-12-01T09:44:24.375 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/138 2022-12-01T09:44:24.375 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 88/138 2022-12-01T09:44:24.375 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 89/138 2022-12-01T09:44:24.376 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 90/138 2022-12-01T09:44:24.376 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 91/138 2022-12-01T09:44:24.376 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 92/138 2022-12-01T09:44:24.376 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 93/138 2022-12-01T09:44:24.377 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 94/138 2022-12-01T09:44:24.377 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 95/138 2022-12-01T09:44:24.377 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 96/138 2022-12-01T09:44:24.377 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/138 2022-12-01T09:44:24.378 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 98/138 2022-12-01T09:44:24.378 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : bison-3.0.4-10.el8.x86_64 99/138 2022-12-01T09:44:24.378 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 100/138 2022-12-01T09:44:24.378 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 101/138 2022-12-01T09:44:24.378 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 102/138 2022-12-01T09:44:24.379 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 103/138 2022-12-01T09:44:24.379 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 104/138 2022-12-01T09:44:24.379 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 105/138 2022-12-01T09:44:24.379 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 106/138 2022-12-01T09:44:24.380 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 107/138 2022-12-01T09:44:24.380 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/138 2022-12-01T09:44:24.380 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 109/138 2022-12-01T09:44:24.380 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 110/138 2022-12-01T09:44:24.380 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 111/138 2022-12-01T09:44:24.381 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/138 2022-12-01T09:44:24.381 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 113/138 2022-12-01T09:44:24.381 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 114/138 2022-12-01T09:44:24.381 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : flex-2.6.1-9.el8.x86_64 115/138 2022-12-01T09:44:24.381 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 116/138 2022-12-01T09:44:24.382 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : jq-1.6-3.el8.x86_64 117/138 2022-12-01T09:44:24.382 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 118/138 2022-12-01T09:44:24.382 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : automake-1.16.1-7.el8.noarch 119/138 2022-12-01T09:44:24.382 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 120/138 2022-12-01T09:44:24.383 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 121/138 2022-12-01T09:44:24.383 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 122/138 2022-12-01T09:44:24.383 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libpq-13.5-1.el8.x86_64 123/138 2022-12-01T09:44:24.383 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 124/138 2022-12-01T09:44:24.383 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 125/138 2022-12-01T09:44:24.384 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 126/138 2022-12-01T09:44:24.384 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 127/138 2022-12-01T09:44:24.384 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 128/138 2022-12-01T09:44:24.384 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 129/138 2022-12-01T09:44:24.385 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2022-12-01T09:44:24.385 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 131/138 2022-12-01T09:44:24.385 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2022-12-01T09:44:24.385 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 133/138 2022-12-01T09:44:24.385 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-12-01T09:44:24.386 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 135/138 2022-12-01T09:44:24.386 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/138 2022-12-01T09:44:24.386 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 137/138 2022-12-01T09:44:24.891 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 117/138 2022-12-01T09:44:25.163 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/138 2022-12-01T09:44:25.437 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 119/138 2022-12-01T09:44:25.576 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/138 2022-12-01T09:44:25.767 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/138 2022-12-01T09:44:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 121/138 2022-12-01T09:44:26.205 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_6 122/138 2022-12-01T09:44:26.273 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 138/138 2022-12-01T09:44:26.273 INFO:teuthology.orchestra.run.smithi182.stdout:Installed products updated. 2022-12-01T09:44:26.377 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/138 2022-12-01T09:44:26.515 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:26.515 INFO:teuthology.orchestra.run.smithi182.stdout:Upgraded: 2022-12-01T09:44:26.516 INFO:teuthology.orchestra.run.smithi182.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2022-12-01T09:44:26.516 INFO:teuthology.orchestra.run.smithi182.stdout: librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.516 INFO:teuthology.orchestra.run.smithi182.stdout: librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.516 INFO:teuthology.orchestra.run.smithi182.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-12-01T09:44:26.517 INFO:teuthology.orchestra.run.smithi182.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-12-01T09:44:26.517 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2022-12-01T09:44:26.517 INFO:teuthology.orchestra.run.smithi182.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2022-12-01T09:44:26.517 INFO:teuthology.orchestra.run.smithi182.stdout: automake-1.16.1-7.el8.noarch 2022-12-01T09:44:26.517 INFO:teuthology.orchestra.run.smithi182.stdout: bison-3.0.4-10.el8.x86_64 2022-12-01T09:44:26.518 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.518 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.518 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.518 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.519 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.519 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-immutable-object-cache-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.519 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.519 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.520 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.520 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.520 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-local-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.520 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.520 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.521 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.521 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.521 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.521 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.522 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.522 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.522 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.522 INFO:teuthology.orchestra.run.smithi182.stdout: cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.522 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.523 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:26.523 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-12-01T09:44:26.523 INFO:teuthology.orchestra.run.smithi182.stdout: flex-2.6.1-9.el8.x86_64 2022-12-01T09:44:26.524 INFO:teuthology.orchestra.run.smithi182.stdout: fuse-2.9.7-15.el8.x86_64 2022-12-01T09:44:26.524 INFO:teuthology.orchestra.run.smithi182.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-12-01T09:44:26.524 INFO:teuthology.orchestra.run.smithi182.stdout: jq-1.6-3.el8.x86_64 2022-12-01T09:44:26.525 INFO:teuthology.orchestra.run.smithi182.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-12-01T09:44:26.525 INFO:teuthology.orchestra.run.smithi182.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-12-01T09:44:26.525 INFO:teuthology.orchestra.run.smithi182.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-12-01T09:44:26.525 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.526 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.526 INFO:teuthology.orchestra.run.smithi182.stdout: libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.526 INFO:teuthology.orchestra.run.smithi182.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-12-01T09:44:26.527 INFO:teuthology.orchestra.run.smithi182.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-12-01T09:44:26.527 INFO:teuthology.orchestra.run.smithi182.stdout: liboath-2.6.2-3.el8.x86_64 2022-12-01T09:44:26.527 INFO:teuthology.orchestra.run.smithi182.stdout: libpq-13.5-1.el8.x86_64 2022-12-01T09:44:26.527 INFO:teuthology.orchestra.run.smithi182.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-12-01T09:44:26.528 INFO:teuthology.orchestra.run.smithi182.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-12-01T09:44:26.528 INFO:teuthology.orchestra.run.smithi182.stdout: librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.528 INFO:teuthology.orchestra.run.smithi182.stdout: libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.528 INFO:teuthology.orchestra.run.smithi182.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-12-01T09:44:26.529 INFO:teuthology.orchestra.run.smithi182.stdout: librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.529 INFO:teuthology.orchestra.run.smithi182.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-12-01T09:44:26.529 INFO:teuthology.orchestra.run.smithi182.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-12-01T09:44:26.529 INFO:teuthology.orchestra.run.smithi182.stdout: libtool-2.4.6-25.el8.x86_64 2022-12-01T09:44:26.530 INFO:teuthology.orchestra.run.smithi182.stdout: libunwind-1.3.1-3.el8.x86_64 2022-12-01T09:44:26.530 INFO:teuthology.orchestra.run.smithi182.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-12-01T09:44:26.530 INFO:teuthology.orchestra.run.smithi182.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-12-01T09:44:26.530 INFO:teuthology.orchestra.run.smithi182.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-12-01T09:44:26.531 INFO:teuthology.orchestra.run.smithi182.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-12-01T09:44:26.531 INFO:teuthology.orchestra.run.smithi182.stdout: openblas-0.3.15-3.el8.x86_64 2022-12-01T09:44:26.531 INFO:teuthology.orchestra.run.smithi182.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-12-01T09:44:26.531 INFO:teuthology.orchestra.run.smithi182.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-12-01T09:44:26.532 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-12-01T09:44:26.532 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-12-01T09:44:26.532 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-12-01T09:44:26.532 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-12-01T09:44:26.532 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-12-01T09:44:26.533 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-12-01T09:44:26.533 INFO:teuthology.orchestra.run.smithi182.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-12-01T09:44:26.533 INFO:teuthology.orchestra.run.smithi182.stdout: python3-babel-2.5.1-7.el8.noarch 2022-12-01T09:44:26.534 INFO:teuthology.orchestra.run.smithi182.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-12-01T09:44:26.534 INFO:teuthology.orchestra.run.smithi182.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-12-01T09:44:26.534 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-12-01T09:44:26.534 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.535 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.535 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.535 INFO:teuthology.orchestra.run.smithi182.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-12-01T09:44:26.535 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-12-01T09:44:26.536 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-12-01T09:44:26.536 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-12-01T09:44:26.536 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-12-01T09:44:26.537 INFO:teuthology.orchestra.run.smithi182.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-12-01T09:44:26.537 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco-6.2-6.el8.noarch 2022-12-01T09:44:26.537 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-12-01T09:44:26.537 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-12-01T09:44:26.538 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-12-01T09:44:26.538 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-12-01T09:44:26.538 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-12-01T09:44:26.538 INFO:teuthology.orchestra.run.smithi182.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-12-01T09:44:26.538 INFO:teuthology.orchestra.run.smithi182.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-12-01T09:44:26.539 INFO:teuthology.orchestra.run.smithi182.stdout: python3-mako-1.0.6-13.el8.noarch 2022-12-01T09:44:26.539 INFO:teuthology.orchestra.run.smithi182.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-12-01T09:44:26.539 INFO:teuthology.orchestra.run.smithi182.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-12-01T09:44:26.539 INFO:teuthology.orchestra.run.smithi182.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-12-01T09:44:26.540 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-12-01T09:44:26.540 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-12-01T09:44:26.540 INFO:teuthology.orchestra.run.smithi182.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-12-01T09:44:26.540 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-12-01T09:44:26.541 INFO:teuthology.orchestra.run.smithi182.stdout: python3-portend-2.6-1.el8.noarch 2022-12-01T09:44:26.541 INFO:teuthology.orchestra.run.smithi182.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-12-01T09:44:26.541 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-12-01T09:44:26.541 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-12-01T09:44:26.542 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-12-01T09:44:26.542 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pycparser-2.14-14.el8.noarch 2022-12-01T09:44:26.542 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pytz-2017.2-9.el8.noarch 2022-12-01T09:44:26.542 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.543 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.543 INFO:teuthology.orchestra.run.smithi182.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-12-01T09:44:26.543 INFO:teuthology.orchestra.run.smithi182.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-12-01T09:44:26.544 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.544 INFO:teuthology.orchestra.run.smithi182.stdout: python3-routes-2.4.1-12.el8.noarch 2022-12-01T09:44:26.544 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rsa-4.8-1.el8.noarch 2022-12-01T09:44:26.545 INFO:teuthology.orchestra.run.smithi182.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-12-01T09:44:26.545 INFO:teuthology.orchestra.run.smithi182.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-12-01T09:44:26.545 INFO:teuthology.orchestra.run.smithi182.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-12-01T09:44:26.545 INFO:teuthology.orchestra.run.smithi182.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-12-01T09:44:26.545 INFO:teuthology.orchestra.run.smithi182.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-12-01T09:44:26.546 INFO:teuthology.orchestra.run.smithi182.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-12-01T09:44:26.546 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-12-01T09:44:26.546 INFO:teuthology.orchestra.run.smithi182.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-12-01T09:44:26.546 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-12-01T09:44:26.547 INFO:teuthology.orchestra.run.smithi182.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-12-01T09:44:26.547 INFO:teuthology.orchestra.run.smithi182.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-12-01T09:44:26.547 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.547 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.548 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:26.548 INFO:teuthology.orchestra.run.smithi182.stdout: socat-1.7.4.1-1.el8.x86_64 2022-12-01T09:44:26.548 INFO:teuthology.orchestra.run.smithi182.stdout: thrift-0.13.0-2.el8.x86_64 2022-12-01T09:44:26.548 INFO:teuthology.orchestra.run.smithi182.stdout: uuid-1.6.2-43.el8.x86_64 2022-12-01T09:44:26.548 INFO:teuthology.orchestra.run.smithi182.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-12-01T09:44:26.549 INFO:teuthology.orchestra.run.smithi182.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-12-01T09:44:26.549 INFO:teuthology.orchestra.run.smithi182.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-12-01T09:44:26.550 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:26.550 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2022-12-01T09:44:26.694 DEBUG:teuthology.parallel:result is None 2022-12-01T09:44:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-12-01T09:44:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-12-01T09:44:28.732 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-12-01T09:44:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 125/138 2022-12-01T09:44:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 126/138 2022-12-01T09:44:29.500 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 127/138 2022-12-01T09:44:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 128/138 2022-12-01T09:44:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 129/138 2022-12-01T09:44:30.442 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/138 2022-12-01T09:44:30.516 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/138 2022-12-01T09:44:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/138 2022-12-01T09:44:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/138 2022-12-01T09:44:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 132/138 2022-12-01T09:44:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 132/138 2022-12-01T09:44:31.063 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 133/138 2022-12-01T09:44:31.227 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-12-01T09:44:31.228 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-12-01T09:44:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-12-01T09:44:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 136/138 2022-12-01T09:44:31.761 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 136/138 2022-12-01T09:44:31.762 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-12-01T09:44:32.062 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-12-01T09:44:32.249 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 138/138 2022-12-01T09:44:32.849 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 138/138 2022-12-01T09:44:32.849 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 1/138 2022-12-01T09:44:32.849 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 2/138 2022-12-01T09:44:32.850 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 3/138 2022-12-01T09:44:32.850 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 4/138 2022-12-01T09:44:32.850 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-676.gf6922c 5/138 2022-12-01T09:44:32.850 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 6/138 2022-12-01T09:44:32.851 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 7/138 2022-12-01T09:44:32.851 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 8/138 2022-12-01T09:44:32.851 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 9/138 2022-12-01T09:44:32.851 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 10/138 2022-12-01T09:44:32.852 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 11/138 2022-12-01T09:44:32.852 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 12/138 2022-12-01T09:44:32.852 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 13/138 2022-12-01T09:44:32.852 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_6 14/138 2022-12-01T09:44:32.853 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 15/138 2022-12-01T09:44:32.853 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 16/138 2022-12-01T09:44:32.853 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 17/138 2022-12-01T09:44:32.853 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 18/138 2022-12-01T09:44:32.854 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 19/138 2022-12-01T09:44:32.854 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8 20/138 2022-12-01T09:44:32.854 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x 21/138 2022-12-01T09:44:32.854 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 22/138 2022-12-01T09:44:32.854 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 23/138 2022-12-01T09:44:32.855 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 24/138 2022-12-01T09:44:32.855 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 25/138 2022-12-01T09:44:32.855 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 26/138 2022-12-01T09:44:32.856 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 27/138 2022-12-01T09:44:32.856 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 28/138 2022-12-01T09:44:32.856 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.e 29/138 2022-12-01T09:44:32.856 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 30/138 2022-12-01T09:44:32.857 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 31/138 2022-12-01T09:44:32.857 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 32/138 2022-12-01T09:44:32.857 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8 33/138 2022-12-01T09:44:32.857 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 34/138 2022-12-01T09:44:32.857 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el 35/138 2022-12-01T09:44:32.858 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 36/138 2022-12-01T09:44:32.858 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 37/138 2022-12-01T09:44:32.858 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 38/138 2022-12-01T09:44:32.859 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/138 2022-12-01T09:44:32.859 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/138 2022-12-01T09:44:32.859 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/138 2022-12-01T09:44:32.859 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/138 2022-12-01T09:44:32.860 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/138 2022-12-01T09:44:32.860 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/138 2022-12-01T09:44:32.860 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/138 2022-12-01T09:44:32.860 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/138 2022-12-01T09:44:32.861 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/138 2022-12-01T09:44:32.861 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/138 2022-12-01T09:44:32.861 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/138 2022-12-01T09:44:32.861 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/138 2022-12-01T09:44:32.862 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2022-12-01T09:44:32.862 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/138 2022-12-01T09:44:32.862 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/138 2022-12-01T09:44:32.862 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/138 2022-12-01T09:44:32.863 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/138 2022-12-01T09:44:32.863 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/138 2022-12-01T09:44:32.863 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/138 2022-12-01T09:44:32.863 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/138 2022-12-01T09:44:32.864 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/138 2022-12-01T09:44:32.864 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/138 2022-12-01T09:44:32.864 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/138 2022-12-01T09:44:32.864 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/138 2022-12-01T09:44:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/138 2022-12-01T09:44:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/138 2022-12-01T09:44:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/138 2022-12-01T09:44:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/138 2022-12-01T09:44:32.865 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/138 2022-12-01T09:44:32.866 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/138 2022-12-01T09:44:32.866 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-12-01T09:44:32.866 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/138 2022-12-01T09:44:32.866 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/138 2022-12-01T09:44:32.867 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 72/138 2022-12-01T09:44:32.867 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 73/138 2022-12-01T09:44:32.867 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/138 2022-12-01T09:44:32.867 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/138 2022-12-01T09:44:32.868 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 76/138 2022-12-01T09:44:32.868 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 77/138 2022-12-01T09:44:32.868 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 78/138 2022-12-01T09:44:32.869 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 79/138 2022-12-01T09:44:32.869 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 80/138 2022-12-01T09:44:32.869 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 81/138 2022-12-01T09:44:32.869 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 82/138 2022-12-01T09:44:32.870 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 83/138 2022-12-01T09:44:32.870 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/138 2022-12-01T09:44:32.870 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/138 2022-12-01T09:44:32.870 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 86/138 2022-12-01T09:44:32.871 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/138 2022-12-01T09:44:32.871 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 88/138 2022-12-01T09:44:32.871 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 89/138 2022-12-01T09:44:32.871 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 90/138 2022-12-01T09:44:32.872 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 91/138 2022-12-01T09:44:32.872 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 92/138 2022-12-01T09:44:32.872 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 93/138 2022-12-01T09:44:32.872 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 94/138 2022-12-01T09:44:32.873 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 95/138 2022-12-01T09:44:32.873 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 96/138 2022-12-01T09:44:32.873 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/138 2022-12-01T09:44:32.873 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 98/138 2022-12-01T09:44:32.874 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.0.4-10.el8.x86_64 99/138 2022-12-01T09:44:32.874 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 100/138 2022-12-01T09:44:32.874 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 101/138 2022-12-01T09:44:32.875 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 102/138 2022-12-01T09:44:32.875 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 103/138 2022-12-01T09:44:32.875 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 104/138 2022-12-01T09:44:32.875 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 105/138 2022-12-01T09:44:32.876 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 106/138 2022-12-01T09:44:32.876 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 107/138 2022-12-01T09:44:32.876 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/138 2022-12-01T09:44:32.877 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 109/138 2022-12-01T09:44:32.877 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 110/138 2022-12-01T09:44:32.877 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 111/138 2022-12-01T09:44:32.877 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/138 2022-12-01T09:44:32.877 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 113/138 2022-12-01T09:44:32.878 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 114/138 2022-12-01T09:44:32.878 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.1-9.el8.x86_64 115/138 2022-12-01T09:44:32.878 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 116/138 2022-12-01T09:44:32.878 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : jq-1.6-3.el8.x86_64 117/138 2022-12-01T09:44:32.879 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 118/138 2022-12-01T09:44:32.879 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.1-7.el8.noarch 119/138 2022-12-01T09:44:32.879 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 120/138 2022-12-01T09:44:32.879 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 121/138 2022-12-01T09:44:32.880 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 122/138 2022-12-01T09:44:32.880 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpq-13.5-1.el8.x86_64 123/138 2022-12-01T09:44:32.880 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 124/138 2022-12-01T09:44:32.880 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 125/138 2022-12-01T09:44:32.881 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 126/138 2022-12-01T09:44:32.881 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 127/138 2022-12-01T09:44:32.881 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 128/138 2022-12-01T09:44:32.881 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 129/138 2022-12-01T09:44:32.882 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2022-12-01T09:44:32.882 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 131/138 2022-12-01T09:44:32.882 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2022-12-01T09:44:32.882 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 133/138 2022-12-01T09:44:32.882 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-12-01T09:44:32.883 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 135/138 2022-12-01T09:44:32.883 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/138 2022-12-01T09:44:32.883 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 137/138 2022-12-01T09:44:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 138/138 2022-12-01T09:44:34.852 INFO:teuthology.orchestra.run.smithi079.stdout:Installed products updated. 2022-12-01T09:44:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:35.097 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2022-12-01T09:44:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2022-12-01T09:44:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-12-01T09:44:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-12-01T09:44:35.098 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2022-12-01T09:44:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2022-12-01T09:44:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.1-7.el8.noarch 2022-12-01T09:44:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.0.4-10.el8.x86_64 2022-12-01T09:44:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.104 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.104 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.104 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.105 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.105 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:44:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-12-01T09:44:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.1-9.el8.x86_64 2022-12-01T09:44:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.7-15.el8.x86_64 2022-12-01T09:44:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-12-01T09:44:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: jq-1.6-3.el8.x86_64 2022-12-01T09:44:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-12-01T09:44:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-12-01T09:44:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-12-01T09:44:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-12-01T09:44:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-12-01T09:44:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.2-3.el8.x86_64 2022-12-01T09:44:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: libpq-13.5-1.el8.x86_64 2022-12-01T09:44:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-12-01T09:44:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-12-01T09:44:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-12-01T09:44:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-12-01T09:44:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-12-01T09:44:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-25.el8.x86_64 2022-12-01T09:44:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.3.1-3.el8.x86_64 2022-12-01T09:44:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-12-01T09:44:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-12-01T09:44:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-12-01T09:44:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-12-01T09:44:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.15-3.el8.x86_64 2022-12-01T09:44:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-12-01T09:44:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-12-01T09:44:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-12-01T09:44:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-12-01T09:44:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-12-01T09:44:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-12-01T09:44:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-12-01T09:44:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-12-01T09:44:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-12-01T09:44:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.5.1-7.el8.noarch 2022-12-01T09:44:35.125 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-12-01T09:44:35.125 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-12-01T09:44:35.125 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-12-01T09:44:35.126 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.126 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.126 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-12-01T09:44:35.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-12-01T09:44:35.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-12-01T09:44:35.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-12-01T09:44:35.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-12-01T09:44:35.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-12-01T09:44:35.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-6.2-6.el8.noarch 2022-12-01T09:44:35.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-12-01T09:44:35.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-12-01T09:44:35.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-12-01T09:44:35.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-12-01T09:44:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-12-01T09:44:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-12-01T09:44:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-12-01T09:44:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.0.6-13.el8.noarch 2022-12-01T09:44:35.130 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-12-01T09:44:35.131 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-12-01T09:44:35.131 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-12-01T09:44:35.131 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-12-01T09:44:35.131 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-12-01T09:44:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-12-01T09:44:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-12-01T09:44:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-2.6-1.el8.noarch 2022-12-01T09:44:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-12-01T09:44:35.132 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-12-01T09:44:35.133 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-12-01T09:44:35.133 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-12-01T09:44:35.134 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.14-14.el8.noarch 2022-12-01T09:44:35.134 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2017.2-9.el8.noarch 2022-12-01T09:44:35.134 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.134 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.134 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-12-01T09:44:35.135 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-12-01T09:44:35.135 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.135 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.4.1-12.el8.noarch 2022-12-01T09:44:35.135 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.8-1.el8.noarch 2022-12-01T09:44:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-12-01T09:44:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-12-01T09:44:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-12-01T09:44:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-12-01T09:44:35.136 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-12-01T09:44:35.137 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-12-01T09:44:35.137 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-12-01T09:44:35.137 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-12-01T09:44:35.138 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-12-01T09:44:35.138 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-12-01T09:44:35.138 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-12-01T09:44:35.139 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.139 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.139 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:44:35.139 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-1.el8.x86_64 2022-12-01T09:44:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.13.0-2.el8.x86_64 2022-12-01T09:44:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-43.el8.x86_64 2022-12-01T09:44:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-12-01T09:44:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-12-01T09:44:35.141 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-12-01T09:44:35.141 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:35.141 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2022-12-01T09:44:35.285 DEBUG:teuthology.parallel:result is None 2022-12-01T09:44:35.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo lsb_release -is 2022-12-01T09:44:35.344 INFO:teuthology.orchestra.run.smithi079.stdout:RedHatEnterprise 2022-12-01T09:44:35.346 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-12-01T09:44:35.347 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:44:35.601 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-12-01T09:44:35.625 INFO:teuthology.orchestra.run.smithi079.stdout:18.0.0-676.gf6922ca2.el8 2022-12-01T09:44:35.626 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-676.gf6922ca2.el8 2022-12-01T09:44:35.627 INFO:teuthology.task.install:The correct ceph version 18.0.0-676.gf6922ca2 is installed. 2022-12-01T09:44:35.627 DEBUG:teuthology.orchestra.run.smithi182:> sudo lsb_release -is 2022-12-01T09:44:35.693 INFO:teuthology.orchestra.run.smithi182.stdout:RedHatEnterprise 2022-12-01T09:44:35.694 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-12-01T09:44:35.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:44:35.939 DEBUG:teuthology.orchestra.run.smithi182:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-12-01T09:44:35.966 INFO:teuthology.orchestra.run.smithi182.stdout:18.0.0-676.gf6922ca2.el8 2022-12-01T09:44:35.966 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-676.gf6922ca2.el8 2022-12-01T09:44:35.967 INFO:teuthology.task.install:The correct ceph version 18.0.0-676.gf6922ca2 is installed. 2022-12-01T09:44:35.968 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-12-01T09:44:35.968 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:35.969 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-12-01T09:44:35.996 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:44:35.996 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-12-01T09:44:36.037 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-12-01T09:44:36.038 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:36.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2022-12-01T09:44:36.066 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-12-01T09:44:36.133 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:44:36.133 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/usr/bin/daemon-helper 2022-12-01T09:44:36.163 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-12-01T09:44:36.232 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-12-01T09:44:36.233 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:36.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2022-12-01T09:44:36.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-12-01T09:44:36.328 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:44:36.329 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/usr/bin/adjust-ulimits 2022-12-01T09:44:36.361 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-12-01T09:44:36.431 INFO:teuthology.run_tasks:Running task ceph... 2022-12-01T09:44:36.501 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-12-01T09:44:36.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2022-12-01T09:44:36.505 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 777 /var/log/ceph 2022-12-01T09:44:36.537 INFO:tasks.ceph:Disabling ceph logrotate... 2022-12-01T09:44:36.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2022-12-01T09:44:36.571 DEBUG:teuthology.orchestra.run.smithi182:> sudo rm -f -- /etc/logrotate.d/ceph 2022-12-01T09:44:36.607 INFO:tasks.ceph:Creating extra log directories... 2022-12-01T09:44:36.608 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-12-01T09:44:36.638 DEBUG:teuthology.orchestra.run.smithi182:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-12-01T09:44:36.685 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-12-01T09:44:36.686 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-12-01T09:44:36.686 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-12-01T09:44:36.686 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:36.687 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-12-01T09:44:36.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-12-01T09:44:36.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-12-01T09:44:36.861 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:44:36.861 DEBUG:teuthology.orchestra.run.smithi182:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-12-01T09:44:36.881 DEBUG:teuthology.orchestra.run.smithi182:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-12-01T09:44:37.003 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-12-01T09:44:37.040 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-12-01T09:44:37.040 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-12-01T09:44:37.041 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090977', 'branch': 'wip-khiremat-47893-test-mgr-finisher-thread-5', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}', 'email': None, 'first_in_suite': False, 'job_id': '7090977', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-khiremat-47893-test-mgr-finisher-thread-5'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-khiremat-47893-test-mgr-finisher-thread-5', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}}, 'owner': 'scheduled_khiremat@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'wip-khiremat-47893-test-mgr-finisher-thread-5', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_f6922ca21f63dad2b198f92826f75d268f12fc97/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi079.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGAcoQsU1nlc8k8Ij6OemRKm281Bqr8pdp41+SnG+zhXSh8aEDyBQnSw4CoBCOh8gDKlaMgSBMzS8ABzQUfx9WX7dm9I61BfbVVdWK+Uk726nBwjOTFoI5lIw0qDAhftotNjvOLprzvY1cJBDDn5P+SF/Zb6G9AqApOnf2cvHkOYjjqYZSEQugoi9hQB9hEcSe27nEBx3oEOQurCF1DPaujvqwqaTeZ2QS4aefmDaV9dOUVqq9Pb8jdhbIRZrZGh4wkXdWHHnTQbecWbCWkpOGSZk/yH2s/42J5VxO2YVWVxuV1Z1dNJL2TvZS/3Wy4RlBIpAwiZ+FgRWasDXo03e2ae+dICQVXFxv2q2OCxWe7Y5xmJa51XD7h/30wURK2l4r0XnEyavZW3WZEOR+fblG65b66vzoSU6yCAyhrfbGyt6ADOZNjDxYVvBN6us3JldpSawc9fy+oQOatvPBlbQA+Bp1ACeeNWmODLGU39i9quY1so7So3dRZ8JZzBK/C30=', 'smithi182.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsklMXDq1Mbiza+Ol4CHg0FKD1vvRA8GF6UCLbSfOBocluroGVblLAk5EZmgv2B22uKKDPLot7LceJUVaDypbZw0xdurBdJs7CA3EIk9LSQtS0ZKLEiIN49s1uuuPOxflI89fzSPp/E80KK193Q9/mb5SqKup/l7ekL+1HAJuYULkX9tXuOeET646c15nV2MbhbOODVCzosx2FH+XKksxvGYpWgJb5Uj8qPx9H6G8SoZRh28qHW1vHPX9JG//V5/jtoeUHe+r/4NHZ+jqve1hvqgxO9Zygk8HlQTxrKn9+TBMo9Uicjo/czQrvobV9DjZJUZVB7yi75CTCMTiUDS+sLEAolErEOXUfXg8U1BgGD8ERacaRQvsoyNBwJCzmnYbbDclHaVXV4AOz2L466KYd/5za2SzmMkQMjOvD78IZD0yPHyQLQs8YEQ+alCQXLqU4IfVCPokyDCfh/lRsvQByZKBgfabsc1yo37RGZ2iYuH3UqpouHM+cwL0gtyJO8N0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes', 'tasks.cephfs.test_subvolume.TestSubvolume']}}], 'teuthology_branch': 'main', 'teuthology_sha1': '4da97cf64e542f347ec47b7bdbe5eca99759f9b7', 'timestamp': '2022-11-24_05:02:42', 'tube': 'smithi', 'user': 'khiremat', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23126'} 2022-12-01T09:44:37.042 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-12-01T09:44:37.046 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-12-01T09:44:37.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2022-12-01T09:44:37.104 DEBUG:teuthology.orchestra.run.smithi182:> sudo install -d -m0777 -- /var/run/ceph 2022-12-01T09:44:37.161 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:37.162 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2022-12-01T09:44:37.193 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-12-01T09:44:37.194 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2022-12-01T09:44:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-12-01T09:44:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:44:37.252 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 360397 Links: 1 2022-12-01T09:44:37.252 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:44:37.252 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:44:37.253 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2022-12-01 09:44:32.512556339 +0000 2022-12-01T09:44:37.253 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2022-12-01 09:41:39.931590785 +0000 2022-12-01T09:44:37.253 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2022-12-01 09:41:39.931590785 +0000 2022-12-01T09:44:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2022-12-01T09:44:37.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2022-12-01T09:44:37.316 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2022-12-01T09:44:37.317 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2022-12-01T09:44:37.317 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000215826 s, 2.4 MB/s 2022-12-01T09:44:37.318 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2022-12-01T09:44:37.377 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2022-12-01T09:44:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-12-01T09:44:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:44:37.435 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 367769 Links: 1 2022-12-01T09:44:37.435 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:44:37.435 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:44:37.435 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2022-12-01 09:44:32.512556339 +0000 2022-12-01T09:44:37.436 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2022-12-01 09:41:40.463577722 +0000 2022-12-01T09:44:37.436 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2022-12-01 09:41:40.463577722 +0000 2022-12-01T09:44:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2022-12-01T09:44:37.436 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2022-12-01T09:44:37.499 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2022-12-01T09:44:37.500 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2022-12-01T09:44:37.500 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000213792 s, 2.4 MB/s 2022-12-01T09:44:37.501 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2022-12-01T09:44:37.560 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2022-12-01T09:44:37.616 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-12-01T09:44:37.617 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:44:37.617 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 368729 Links: 1 2022-12-01T09:44:37.617 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:44:37.617 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:44:37.618 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2022-12-01 09:44:32.512556339 +0000 2022-12-01T09:44:37.618 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2022-12-01 09:41:41.023563971 +0000 2022-12-01T09:44:37.618 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2022-12-01 09:41:41.023563971 +0000 2022-12-01T09:44:37.618 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2022-12-01T09:44:37.619 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2022-12-01T09:44:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2022-12-01T09:44:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2022-12-01T09:44:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000195957 s, 2.6 MB/s 2022-12-01T09:44:37.684 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2022-12-01T09:44:37.741 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2022-12-01T09:44:37.799 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-12-01T09:44:37.799 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:44:37.800 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 369795 Links: 1 2022-12-01T09:44:37.800 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:44:37.800 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:44:37.800 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2022-12-01 09:44:32.512556339 +0000 2022-12-01T09:44:37.800 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2022-12-01 09:41:41.588550097 +0000 2022-12-01T09:44:37.801 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2022-12-01 09:41:41.588550097 +0000 2022-12-01T09:44:37.801 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2022-12-01T09:44:37.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2022-12-01T09:44:37.864 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2022-12-01T09:44:37.865 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2022-12-01T09:44:37.865 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000216024 s, 2.4 MB/s 2022-12-01T09:44:37.866 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2022-12-01T09:44:37.924 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:37.924 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:44:37.925 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/scratch_devs of=/dev/stdout 2022-12-01T09:44:37.946 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-12-01T09:44:37.946 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_1 2022-12-01T09:44:38.006 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-12-01T09:44:38.007 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:44:38.007 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 362150 Links: 1 2022-12-01T09:44:38.008 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:44:38.008 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:44:38.009 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-12-01 09:44:24.038191105 +0000 2022-12-01T09:44:38.009 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-12-01 09:41:32.740703571 +0000 2022-12-01T09:44:38.009 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-12-01 09:41:32.740703571 +0000 2022-12-01T09:44:38.010 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-12-01T09:44:38.011 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2022-12-01T09:44:38.077 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-12-01T09:44:38.078 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-12-01T09:44:38.078 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000232123 s, 2.2 MB/s 2022-12-01T09:44:38.080 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2022-12-01T09:44:38.142 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_2 2022-12-01T09:44:38.203 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-12-01T09:44:38.203 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:44:38.203 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 359328 Links: 1 2022-12-01T09:44:38.203 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:44:38.204 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:44:38.204 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-12-01 09:44:24.038191105 +0000 2022-12-01T09:44:38.204 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-12-01 09:41:33.268690878 +0000 2022-12-01T09:44:38.204 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-12-01 09:41:33.268690878 +0000 2022-12-01T09:44:38.205 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-12-01T09:44:38.205 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2022-12-01T09:44:38.272 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-12-01T09:44:38.272 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-12-01T09:44:38.272 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000213682 s, 2.4 MB/s 2022-12-01T09:44:38.274 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2022-12-01T09:44:38.335 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_3 2022-12-01T09:44:38.394 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-12-01T09:44:38.394 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:44:38.394 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 367811 Links: 1 2022-12-01T09:44:38.395 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:44:38.395 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:44:38.395 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-12-01 09:44:24.038191105 +0000 2022-12-01T09:44:38.396 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-12-01 09:41:33.827677438 +0000 2022-12-01T09:44:38.396 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-12-01 09:41:33.827677438 +0000 2022-12-01T09:44:38.396 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-12-01T09:44:38.396 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2022-12-01T09:44:38.461 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-12-01T09:44:38.462 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-12-01T09:44:38.462 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000223092 s, 2.3 MB/s 2022-12-01T09:44:38.463 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2022-12-01T09:44:38.523 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_4 2022-12-01T09:44:38.581 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-12-01T09:44:38.582 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:44:38.582 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 366490 Links: 1 2022-12-01T09:44:38.583 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:44:38.583 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:44:38.583 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-12-01 09:44:24.038191105 +0000 2022-12-01T09:44:38.583 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-12-01 09:41:34.381664120 +0000 2022-12-01T09:44:38.584 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-12-01 09:41:34.381664120 +0000 2022-12-01T09:44:38.584 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-12-01T09:44:38.584 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2022-12-01T09:44:38.648 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-12-01T09:44:38.648 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-12-01T09:44:38.648 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000208008 s, 2.5 MB/s 2022-12-01T09:44:38.650 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2022-12-01T09:44:38.708 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:38.709 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi182.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-12-01T09:44:38.709 INFO:tasks.ceph:Generating config... 2022-12-01T09:44:38.712 INFO:tasks.ceph:[client] client mount timeout = 600 2022-12-01T09:44:38.712 INFO:tasks.ceph:[client] debug client = 20 2022-12-01T09:44:38.712 INFO:tasks.ceph:[client] debug ms = 1 2022-12-01T09:44:38.713 INFO:tasks.ceph:[client] pid file = 2022-12-01T09:44:38.713 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-12-01T09:44:38.713 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-12-01T09:44:38.714 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-12-01T09:44:38.714 INFO:tasks.ceph:[mds] debug mds = 20 2022-12-01T09:44:38.715 INFO:tasks.ceph:[mds] debug mds balancer = 20 2022-12-01T09:44:38.715 INFO:tasks.ceph:[mds] debug ms = 1 2022-12-01T09:44:38.716 INFO:tasks.ceph:[mds] mds debug frag = True 2022-12-01T09:44:38.716 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-12-01T09:44:38.716 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-12-01T09:44:38.717 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-12-01T09:44:38.717 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-12-01T09:44:38.718 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-12-01T09:44:38.718 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-12-01T09:44:38.718 INFO:tasks.ceph:[mgr] debug client = 20 2022-12-01T09:44:38.719 INFO:tasks.ceph:[mgr] debug finisher = 20 2022-12-01T09:44:38.719 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-12-01T09:44:38.719 INFO:tasks.ceph:[mgr] debug ms = 1 2022-12-01T09:44:38.720 INFO:tasks.ceph:[mon] debug mon = 20 2022-12-01T09:44:38.720 INFO:tasks.ceph:[mon] debug ms = 1 2022-12-01T09:44:38.721 INFO:tasks.ceph:[mon] debug paxos = 20 2022-12-01T09:44:38.721 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-12-01T09:44:38.721 INFO:tasks.ceph:[osd] bdev async discard = True 2022-12-01T09:44:38.722 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-12-01T09:44:38.722 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-12-01T09:44:38.722 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-12-01T09:44:38.723 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-12-01T09:44:38.723 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2022-12-01T09:44:38.724 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2022-12-01T09:44:38.724 INFO:tasks.ceph:[osd] debug ms = 1 2022-12-01T09:44:38.725 INFO:tasks.ceph:[osd] debug osd = 20 2022-12-01T09:44:38.726 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2022-12-01T09:44:38.726 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-12-01T09:44:38.727 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-12-01T09:44:38.727 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-12-01T09:44:38.728 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-12-01T09:44:38.728 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-12-01T09:44:38.729 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-12-01T09:44:38.729 INFO:tasks.ceph:Setting up mon.a... 2022-12-01T09:44:38.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-12-01T09:44:38.788 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2022-12-01T09:44:38.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-12-01T09:44:38.840 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-12-01T09:44:38.869 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.79'), ('mon.b', '172.21.15.182'), ('mon.c', '[v2:172.21.15.182:3301,v1:172.21.15.182:6790]')] 2022-12-01T09:44:38.871 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.79,172.21.15.182,[v2:172.21.15.182:3301,v1:172.21.15.182:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-12-01T09:44:38.873 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:38.873 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-12-01T09:44:38.927 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.79 --add b 172.21.15.182 --addv c '[v2:172.21.15.182:3301,v1:172.21.15.182:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:44:39.015 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:44:39.016 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid e7b489bb-0e60-496d-af31-008ef9057b43 2022-12-01T09:44:39.016 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = pacific 2022-12-01T09:44:39.017 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2022-12-01T09:44:39.017 INFO:teuthology.orchestra.run.smithi079.stdout:fsid e7b489bb-0e60-496d-af31-008ef9057b43 2022-12-01T09:44:39.017 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2022-12-01T09:44:39.012961+0000 2022-12-01T09:44:39.018 INFO:teuthology.orchestra.run.smithi079.stdout:created 2022-12-01T09:44:39.012961+0000 2022-12-01T09:44:39.018 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 16 (pacific) 2022-12-01T09:44:39.019 INFO:teuthology.orchestra.run.smithi079.stdout:election_strategy: 1 2022-12-01T09:44:39.019 INFO:teuthology.orchestra.run.smithi079.stdout:0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2022-12-01T09:44:39.019 INFO:teuthology.orchestra.run.smithi079.stdout:1: [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] mon.b 2022-12-01T09:44:39.020 INFO:teuthology.orchestra.run.smithi079.stdout:2: [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] mon.c 2022-12-01T09:44:39.020 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-12-01T09:44:39.022 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-12-01T09:44:39.039 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e7b489bb-0e60-496d-af31-008ef9057b43... 2022-12-01T09:44:39.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-12-01T09:44:39.082 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-12-01T09:44:39.124 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2022-12-01T09:44:39.124 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2022-12-01T09:44:39.124 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-12-01T09:44:39.125 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2022-12-01T09:44:39.125 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.125 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2022-12-01T09:44:39.126 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.126 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2022-12-01T09:44:39.126 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.126 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2022-12-01T09:44:39.127 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2022-12-01T09:44:39.127 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.127 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2022-12-01T09:44:39.127 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2022-12-01T09:44:39.128 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.128 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2022-12-01T09:44:39.128 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2022-12-01T09:44:39.128 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.129 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2022-12-01T09:44:39.129 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2022-12-01T09:44:39.129 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.130 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2022-12-01T09:44:39.130 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.130 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2022-12-01T09:44:39.130 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2022-12-01T09:44:39.131 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2022-12-01T09:44:39.131 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2022-12-01T09:44:39.131 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2022-12-01T09:44:39.131 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2022-12-01T09:44:39.132 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2022-12-01T09:44:39.132 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-12-01T09:44:39.132 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2022-12-01T09:44:39.132 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2022-12-01T09:44:39.133 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.133 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-12-01T09:44:39.133 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.133 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2022-12-01T09:44:39.133 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.134 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2022-12-01T09:44:39.134 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.135 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2022-12-01T09:44:39.135 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2022-12-01T09:44:39.136 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2022-12-01T09:44:39.136 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.182,[v2:172.21.15.182:3301,v1:172.21.15.182:6790]" 2022-12-01T09:44:39.136 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2022-12-01T09:44:39.137 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = e7b489bb-0e60-496d-af31-008ef9057b43 2022-12-01T09:44:39.137 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.138 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2022-12-01T09:44:39.138 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2022-12-01T09:44:39.139 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.139 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2022-12-01T09:44:39.139 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2022-12-01T09:44:39.140 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.140 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2022-12-01T09:44:39.141 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2022-12-01T09:44:39.141 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.141 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2022-12-01T09:44:39.141 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2022-12-01T09:44:39.142 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2022-12-01T09:44:39.142 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.142 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2022-12-01T09:44:39.142 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2022-12-01T09:44:39.143 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.143 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2022-12-01T09:44:39.143 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.143 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2022-12-01T09:44:39.144 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.144 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2022-12-01T09:44:39.144 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.144 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2022-12-01T09:44:39.145 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2022-12-01T09:44:39.145 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.145 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2022-12-01T09:44:39.145 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2022-12-01T09:44:39.146 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2022-12-01T09:44:39.146 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2022-12-01T09:44:39.146 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2022-12-01T09:44:39.146 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2022-12-01T09:44:39.147 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2022-12-01T09:44:39.147 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2022-12-01T09:44:39.147 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2022-12-01T09:44:39.147 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2022-12-01T09:44:39.148 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2022-12-01T09:44:39.148 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2022-12-01T09:44:39.148 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2022-12-01T09:44:39.148 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2022-12-01T09:44:39.149 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2022-12-01T09:44:39.149 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2022-12-01T09:44:39.149 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2022-12-01T09:44:39.149 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2022-12-01T09:44:39.149 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.150 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2022-12-01T09:44:39.150 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2022-12-01T09:44:39.150 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2022-12-01T09:44:39.150 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2022-12-01T09:44:39.150 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2022-12-01T09:44:39.151 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2022-12-01T09:44:39.151 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2022-12-01T09:44:39.151 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2022-12-01T09:44:39.151 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2022-12-01T09:44:39.152 INFO:teuthology.orchestra.run.smithi079.stdout: debug finisher = 20 2022-12-01T09:44:39.152 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.152 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2022-12-01T09:44:39.153 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2022-12-01T09:44:39.153 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2022-12-01T09:44:39.153 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2022-12-01T09:44:39.153 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2022-12-01T09:44:39.153 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2022-12-01T09:44:39.154 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2022-12-01T09:44:39.154 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2022-12-01T09:44:39.154 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2022-12-01T09:44:39.154 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2022-12-01T09:44:39.155 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2022-12-01T09:44:39.155 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.155 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-12-01T09:44:39.155 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2022-12-01T09:44:39.155 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2022-12-01T09:44:39.156 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.156 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2022-12-01T09:44:39.156 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-12-01T09:44:39.156 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-12-01T09:44:39.156 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.157 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2022-12-01T09:44:39.157 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2022-12-01T09:44:39.157 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.157 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2022-12-01T09:44:39.158 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2022-12-01T09:44:39.158 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:44:39.158 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2022-12-01T09:44:39.158 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2022-12-01T09:44:39.158 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2022-12-01T09:44:39.159 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2022-12-01T09:44:39.159 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-12-01T09:44:39.159 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-12-01T09:44:39.159 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2022-12-01T09:44:39.159 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2022-12-01T09:44:39.160 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2022-12-01T09:44:39.160 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2022-12-01T09:44:39.160 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2022-12-01T09:44:39.160 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2022-12-01T09:44:39.161 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2022-12-01T09:44:39.161 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2022-12-01T09:44:39.161 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2022-12-01T09:44:39.161 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2022-12-01T09:44:39.161 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2022-12-01T09:44:39.162 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2022-12-01T09:44:39.162 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2022-12-01T09:44:39.162 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2022-12-01T09:44:39.162 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2022-12-01T09:44:39.163 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2022-12-01T09:44:39.163 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2022-12-01T09:44:39.163 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2022-12-01T09:44:39.164 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2022-12-01T09:44:39.164 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2022-12-01T09:44:39.164 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2022-12-01T09:44:39.164 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2022-12-01T09:44:39.164 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2022-12-01T09:44:39.165 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2022-12-01T09:44:39.167 INFO:teuthology.orchestra.run.smithi182.stdout:[global] 2022-12-01T09:44:39.167 INFO:teuthology.orchestra.run.smithi182.stdout: chdir = "" 2022-12-01T09:44:39.167 INFO:teuthology.orchestra.run.smithi182.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-12-01T09:44:39.167 INFO:teuthology.orchestra.run.smithi182.stdout: auth supported = cephx 2022-12-01T09:44:39.168 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.168 INFO:teuthology.orchestra.run.smithi182.stdout: filestore xattr use omap = true 2022-12-01T09:44:39.168 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.168 INFO:teuthology.orchestra.run.smithi182.stdout: mon clock drift allowed = 1.000 2022-12-01T09:44:39.169 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.169 INFO:teuthology.orchestra.run.smithi182.stdout: osd crush chooseleaf type = 0 2022-12-01T09:44:39.169 INFO:teuthology.orchestra.run.smithi182.stdout: auth debug = true 2022-12-01T09:44:39.169 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.169 INFO:teuthology.orchestra.run.smithi182.stdout: ms die on old message = true 2022-12-01T09:44:39.170 INFO:teuthology.orchestra.run.smithi182.stdout: ms die on bug = true 2022-12-01T09:44:39.170 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.170 INFO:teuthology.orchestra.run.smithi182.stdout: mon max pg per osd = 10000 # >= luminous 2022-12-01T09:44:39.170 INFO:teuthology.orchestra.run.smithi182.stdout: mon pg warn max object skew = 0 2022-12-01T09:44:39.170 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.171 INFO:teuthology.orchestra.run.smithi182.stdout: # disable pg_autoscaler by default for new pools 2022-12-01T09:44:39.171 INFO:teuthology.orchestra.run.smithi182.stdout: osd_pool_default_pg_autoscale_mode = off 2022-12-01T09:44:39.171 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.171 INFO:teuthology.orchestra.run.smithi182.stdout: osd pool default size = 2 2022-12-01T09:44:39.172 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.172 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd allow primary affinity = true 2022-12-01T09:44:39.172 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd allow pg remap = true 2022-12-01T09:44:39.172 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on legacy crush tunables = false 2022-12-01T09:44:39.172 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on crush straw calc version zero = false 2022-12-01T09:44:39.173 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on no sortbitwise = false 2022-12-01T09:44:39.173 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on osd down out interval zero = false 2022-12-01T09:44:39.173 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on too few osds = false 2022-12-01T09:44:39.174 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-12-01T09:44:39.174 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_pool_no_redundancy = false 2022-12-01T09:44:39.174 INFO:teuthology.orchestra.run.smithi182.stdout: mon_allow_pool_size_one = true 2022-12-01T09:44:39.174 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.174 INFO:teuthology.orchestra.run.smithi182.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-12-01T09:44:39.175 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.175 INFO:teuthology.orchestra.run.smithi182.stdout: osd default data pool replay window = 5 2022-12-01T09:44:39.175 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.175 INFO:teuthology.orchestra.run.smithi182.stdout: mon allow pool delete = true 2022-12-01T09:44:39.176 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.176 INFO:teuthology.orchestra.run.smithi182.stdout: mon cluster log file level = debug 2022-12-01T09:44:39.176 INFO:teuthology.orchestra.run.smithi182.stdout: debug asserts on shutdown = true 2022-12-01T09:44:39.176 INFO:teuthology.orchestra.run.smithi182.stdout: mon health detail to clog = false 2022-12-01T09:44:39.177 INFO:teuthology.orchestra.run.smithi182.stdout: mon host = "172.21.15.79,172.21.15.182,[v2:172.21.15.182:3301,v1:172.21.15.182:6790]" 2022-12-01T09:44:39.177 INFO:teuthology.orchestra.run.smithi182.stdout: ms die on skipped message = False 2022-12-01T09:44:39.177 INFO:teuthology.orchestra.run.smithi182.stdout: fsid = e7b489bb-0e60-496d-af31-008ef9057b43 2022-12-01T09:44:39.177 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.177 INFO:teuthology.orchestra.run.smithi182.stdout:[osd] 2022-12-01T09:44:39.178 INFO:teuthology.orchestra.run.smithi182.stdout: osd journal size = 100 2022-12-01T09:44:39.178 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.178 INFO:teuthology.orchestra.run.smithi182.stdout: osd scrub load threshold = 5.0 2022-12-01T09:44:39.179 INFO:teuthology.orchestra.run.smithi182.stdout: osd scrub max interval = 600 2022-12-01T09:44:39.179 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.179 INFO:teuthology.orchestra.run.smithi182.stdout: osd recover clone overlap = true 2022-12-01T09:44:39.179 INFO:teuthology.orchestra.run.smithi182.stdout: osd recovery max chunk = 1048576 2022-12-01T09:44:39.180 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.180 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug shutdown = true 2022-12-01T09:44:39.180 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug op order = true 2022-12-01T09:44:39.180 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug verify stray on activate = true 2022-12-01T09:44:39.181 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.181 INFO:teuthology.orchestra.run.smithi182.stdout: osd open classes on start = true 2022-12-01T09:44:39.181 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug pg log writeout = true 2022-12-01T09:44:39.181 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.181 INFO:teuthology.orchestra.run.smithi182.stdout: osd deep scrub update digest min age = 30 2022-12-01T09:44:39.182 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.182 INFO:teuthology.orchestra.run.smithi182.stdout: osd map max advance = 10 2022-12-01T09:44:39.182 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.182 INFO:teuthology.orchestra.run.smithi182.stdout: journal zero on create = true 2022-12-01T09:44:39.183 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.183 INFO:teuthology.orchestra.run.smithi182.stdout: filestore ondisk finisher threads = 3 2022-12-01T09:44:39.183 INFO:teuthology.orchestra.run.smithi182.stdout: filestore apply finisher threads = 3 2022-12-01T09:44:39.183 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.183 INFO:teuthology.orchestra.run.smithi182.stdout: bdev debug aio = true 2022-12-01T09:44:39.184 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug misdirected ops = true 2022-12-01T09:44:39.184 INFO:teuthology.orchestra.run.smithi182.stdout: bdev async discard = True 2022-12-01T09:44:39.184 INFO:teuthology.orchestra.run.smithi182.stdout: bdev enable discard = True 2022-12-01T09:44:39.184 INFO:teuthology.orchestra.run.smithi182.stdout: bluestore allocator = bitmap 2022-12-01T09:44:39.185 INFO:teuthology.orchestra.run.smithi182.stdout: bluestore block size = 96636764160 2022-12-01T09:44:39.185 INFO:teuthology.orchestra.run.smithi182.stdout: bluestore fsck on mount = True 2022-12-01T09:44:39.185 INFO:teuthology.orchestra.run.smithi182.stdout: debug bluefs = 1/20 2022-12-01T09:44:39.185 INFO:teuthology.orchestra.run.smithi182.stdout: debug bluestore = 1/20 2022-12-01T09:44:39.185 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2022-12-01T09:44:39.186 INFO:teuthology.orchestra.run.smithi182.stdout: debug osd = 20 2022-12-01T09:44:39.186 INFO:teuthology.orchestra.run.smithi182.stdout: debug rocksdb = 4/10 2022-12-01T09:44:39.186 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd backfillfull_ratio = 0.85 2022-12-01T09:44:39.186 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd full ratio = 0.9 2022-12-01T09:44:39.187 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd nearfull ratio = 0.8 2022-12-01T09:44:39.187 INFO:teuthology.orchestra.run.smithi182.stdout: osd failsafe full ratio = 0.95 2022-12-01T09:44:39.187 INFO:teuthology.orchestra.run.smithi182.stdout: osd objectstore = bluestore 2022-12-01T09:44:39.187 INFO:teuthology.orchestra.run.smithi182.stdout: osd op complaint time = 180 2022-12-01T09:44:39.188 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.188 INFO:teuthology.orchestra.run.smithi182.stdout:[mgr] 2022-12-01T09:44:39.188 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2022-12-01T09:44:39.188 INFO:teuthology.orchestra.run.smithi182.stdout: debug mgr = 20 2022-12-01T09:44:39.189 INFO:teuthology.orchestra.run.smithi182.stdout: debug mon = 20 2022-12-01T09:44:39.189 INFO:teuthology.orchestra.run.smithi182.stdout: debug auth = 20 2022-12-01T09:44:39.189 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min pgs per osd = 4 2022-12-01T09:44:39.189 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min bytes per osd = 10 2022-12-01T09:44:39.189 INFO:teuthology.orchestra.run.smithi182.stdout: mgr/telemetry/nag = false 2022-12-01T09:44:39.190 INFO:teuthology.orchestra.run.smithi182.stdout: debug client = 20 2022-12-01T09:44:39.190 INFO:teuthology.orchestra.run.smithi182.stdout: debug finisher = 20 2022-12-01T09:44:39.190 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.190 INFO:teuthology.orchestra.run.smithi182.stdout:[mon] 2022-12-01T09:44:39.191 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2022-12-01T09:44:39.191 INFO:teuthology.orchestra.run.smithi182.stdout: debug mon = 20 2022-12-01T09:44:39.191 INFO:teuthology.orchestra.run.smithi182.stdout: debug paxos = 20 2022-12-01T09:44:39.191 INFO:teuthology.orchestra.run.smithi182.stdout: debug auth = 20 2022-12-01T09:44:39.192 INFO:teuthology.orchestra.run.smithi182.stdout: mon data avail warn = 5 2022-12-01T09:44:39.192 INFO:teuthology.orchestra.run.smithi182.stdout: mon mgr mkfs grace = 240 2022-12-01T09:44:39.192 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min pgs per osd = 4 2022-12-01T09:44:39.192 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd reporter subtree level = osd 2022-12-01T09:44:39.192 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd prime pg temp = true 2022-12-01T09:44:39.193 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min bytes per osd = 10 2022-12-01T09:44:39.193 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.193 INFO:teuthology.orchestra.run.smithi182.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-12-01T09:44:39.193 INFO:teuthology.orchestra.run.smithi182.stdout: auth mon ticket ttl = 660 # 11m 2022-12-01T09:44:39.193 INFO:teuthology.orchestra.run.smithi182.stdout: auth service ticket ttl = 240 # 4m 2022-12-01T09:44:39.194 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.194 INFO:teuthology.orchestra.run.smithi182.stdout: # don't complain about insecure global_id in the test suite 2022-12-01T09:44:39.194 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-12-01T09:44:39.194 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-12-01T09:44:39.195 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.195 INFO:teuthology.orchestra.run.smithi182.stdout: # 1m isn't quite enough 2022-12-01T09:44:39.195 INFO:teuthology.orchestra.run.smithi182.stdout: mon_down_mkfs_grace = 2m 2022-12-01T09:44:39.195 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.196 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_filestore_osds = false 2022-12-01T09:44:39.196 INFO:teuthology.orchestra.run.smithi182.stdout: mon op complaint time = 120 2022-12-01T09:44:39.196 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-12-01T09:44:39.196 INFO:teuthology.orchestra.run.smithi182.stdout:[client] 2022-12-01T09:44:39.196 INFO:teuthology.orchestra.run.smithi182.stdout: rgw cache enabled = true 2022-12-01T09:44:39.197 INFO:teuthology.orchestra.run.smithi182.stdout: rgw enable ops log = true 2022-12-01T09:44:39.197 INFO:teuthology.orchestra.run.smithi182.stdout: rgw enable usage log = true 2022-12-01T09:44:39.197 INFO:teuthology.orchestra.run.smithi182.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-12-01T09:44:39.197 INFO:teuthology.orchestra.run.smithi182.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-12-01T09:44:39.198 INFO:teuthology.orchestra.run.smithi182.stdout: client mount timeout = 600 2022-12-01T09:44:39.198 INFO:teuthology.orchestra.run.smithi182.stdout: debug client = 20 2022-12-01T09:44:39.198 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2022-12-01T09:44:39.198 INFO:teuthology.orchestra.run.smithi182.stdout: pid file = "" 2022-12-01T09:44:39.198 INFO:teuthology.orchestra.run.smithi182.stdout: rados mon op timeout = 900 2022-12-01T09:44:39.199 INFO:teuthology.orchestra.run.smithi182.stdout: rados osd op timeout = 900 2022-12-01T09:44:39.199 INFO:teuthology.orchestra.run.smithi182.stdout:[mon.a] 2022-12-01T09:44:39.199 INFO:teuthology.orchestra.run.smithi182.stdout:[mon.b] 2022-12-01T09:44:39.199 INFO:teuthology.orchestra.run.smithi182.stdout:[mon.c] 2022-12-01T09:44:39.200 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.a] 2022-12-01T09:44:39.200 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.c] 2022-12-01T09:44:39.200 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.b] 2022-12-01T09:44:39.200 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.d] 2022-12-01T09:44:39.200 INFO:teuthology.orchestra.run.smithi182.stdout:[mds] 2022-12-01T09:44:39.201 INFO:teuthology.orchestra.run.smithi182.stdout: debug mds = 20 2022-12-01T09:44:39.201 INFO:teuthology.orchestra.run.smithi182.stdout: debug mds balancer = 20 2022-12-01T09:44:39.209 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2022-12-01T09:44:39.209 INFO:teuthology.orchestra.run.smithi182.stdout: mds debug frag = True 2022-12-01T09:44:39.210 INFO:teuthology.orchestra.run.smithi182.stdout: mds debug scatterstat = True 2022-12-01T09:44:39.210 INFO:teuthology.orchestra.run.smithi182.stdout: mds op complaint time = 180 2022-12-01T09:44:39.210 INFO:teuthology.orchestra.run.smithi182.stdout: mds verify scatter = True 2022-12-01T09:44:39.210 INFO:teuthology.orchestra.run.smithi182.stdout: osd op complaint time = 180 2022-12-01T09:44:39.210 INFO:teuthology.orchestra.run.smithi182.stdout: rados mon op timeout = 900 2022-12-01T09:44:39.211 INFO:teuthology.orchestra.run.smithi182.stdout: rados osd op timeout = 900 2022-12-01T09:44:39.211 INFO:tasks.ceph:Creating admin key on mon.a... 2022-12-01T09:44:39.212 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-12-01T09:44:39.268 INFO:tasks.ceph:Copying monmap to all nodes... 2022-12-01T09:44:39.269 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:39.269 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-12-01T09:44:39.287 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:39.287 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-12-01T09:44:39.343 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2022-12-01T09:44:39.344 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:39.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2022-12-01T09:44:39.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-12-01T09:44:39.420 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:44:39.421 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:44:39.477 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi182.front.sepia.ceph.com 2022-12-01T09:44:39.478 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:44:39.478 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/ceph/ceph.keyring 2022-12-01T09:44:39.478 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-12-01T09:44:39.522 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:44:39.522 DEBUG:teuthology.orchestra.run.smithi182:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:44:39.580 INFO:tasks.ceph:Setting up mon nodes... 2022-12-01T09:44:39.581 INFO:tasks.ceph:Setting up mgr nodes... 2022-12-01T09:44:39.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-12-01T09:44:39.635 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-12-01T09:44:39.637 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-12-01T09:44:39.701 INFO:teuthology.orchestra.run.smithi182.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-12-01T09:44:39.704 INFO:tasks.ceph:Setting up mds nodes... 2022-12-01T09:44:39.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-12-01T09:44:39.758 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-12-01T09:44:39.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-12-01T09:44:39.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-12-01T09:44:39.881 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-12-01T09:44:39.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-12-01T09:44:39.910 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-12-01T09:44:39.966 INFO:teuthology.orchestra.run.smithi182.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-12-01T09:44:39.968 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-12-01T09:44:39.995 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-12-01T09:44:40.087 INFO:teuthology.orchestra.run.smithi182.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-12-01T09:44:40.090 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-12-01T09:44:40.116 INFO:tasks.ceph_client:Setting up client nodes... 2022-12-01T09:44:40.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-12-01T09:44:40.160 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-12-01T09:44:40.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2022-12-01T09:44:40.256 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.2.keyring 2022-12-01T09:44:40.269 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-12-01T09:44:40.313 INFO:teuthology.orchestra.run.smithi182.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-12-01T09:44:40.326 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2022-12-01T09:44:40.408 INFO:teuthology.orchestra.run.smithi182.stdout:creating /etc/ceph/ceph.client.3.keyring 2022-12-01T09:44:40.421 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-12-01T09:44:40.422 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi182.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-12-01T09:44:40.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-12-01T09:44:40.449 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:40.450 INFO:tasks.ceph:role: osd.0 2022-12-01T09:44:40.450 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2022-12-01T09:44:40.451 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-12-01T09:44:40.523 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:44:40.523 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:44:40.524 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:44:40.524 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:44:40.524 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:44:40.524 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:44:40.524 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:44:40.525 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:44:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:44:40.525 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:44:40.954 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2022-12-01T09:44:40.956 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2022-12-01T09:44:40.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-12-01T09:44:41.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-12-01T09:44:41.160 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-12-01T09:44:41.228 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:41.229 INFO:tasks.ceph:role: osd.1 2022-12-01T09:44:41.229 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2022-12-01T09:44:41.229 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-12-01T09:44:41.302 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:44:41.357 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:44:41.358 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:44:41.358 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:44:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:44:41.359 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:44:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:44:41.360 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:44:41.360 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:44:41.360 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:44:41.728 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2022-12-01T09:44:41.730 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2022-12-01T09:44:41.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-12-01T09:44:41.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-12-01T09:44:41.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-12-01T09:44:41.930 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:41.930 INFO:tasks.ceph:role: osd.2 2022-12-01T09:44:41.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2022-12-01T09:44:41.931 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-12-01T09:44:42.003 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:44:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:44:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:44:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:44:42.005 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:44:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:44:42.006 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:44:42.006 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:44:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:44:42.006 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:44:42.456 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2022-12-01T09:44:42.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2022-12-01T09:44:42.459 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-12-01T09:44:42.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-12-01T09:44:42.669 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-12-01T09:44:42.738 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:42.739 INFO:tasks.ceph:role: osd.3 2022-12-01T09:44:42.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2022-12-01T09:44:42.739 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-12-01T09:44:42.813 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:44:42.814 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:44:42.814 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:44:42.814 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:44:42.814 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:44:42.815 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:44:42.815 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:44:42.815 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:44:42.816 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:44:42.816 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:44:43.249 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2022-12-01T09:44:43.251 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2022-12-01T09:44:43.251 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-12-01T09:44:43.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-12-01T09:44:43.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:44:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:43.532+0000 7f43c93915c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-12-01T09:44:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:43.532+0000 7f43c93915c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-12-01T09:44:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:43.532+0000 7f43c93915c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-12-01T09:44:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:43.532+0000 7f43c93915c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-12-01T09:44:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:43.532+0000 7f43c93915c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-12-01T09:44:43.539 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:43.533+0000 7f43c93915c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-12-01T09:44:46.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-12-01T09:44:46.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:44:46.527 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:46.523+0000 7f0daf1415c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-12-01T09:44:46.527 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:46.523+0000 7f0daf1415c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-12-01T09:44:46.528 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:46.523+0000 7f0daf1415c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-12-01T09:44:46.528 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:46.523+0000 7f0daf1415c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-12-01T09:44:46.528 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:46.523+0000 7f0daf1415c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-12-01T09:44:46.528 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:46.523+0000 7f0daf1415c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-12-01T09:44:49.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-12-01T09:44:49.415 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:44:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:49.501+0000 7fdb7d9975c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-12-01T09:44:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:49.501+0000 7fdb7d9975c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-12-01T09:44:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:49.501+0000 7fdb7d9975c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-12-01T09:44:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:49.501+0000 7fdb7d9975c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-12-01T09:44:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:49.501+0000 7fdb7d9975c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-12-01T09:44:49.507 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:49.502+0000 7fdb7d9975c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-12-01T09:44:52.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-12-01T09:44:52.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:44:52.493 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:52.490+0000 7f1f413c65c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-12-01T09:44:52.494 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:52.490+0000 7f1f413c65c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-12-01T09:44:52.494 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:52.490+0000 7f1f413c65c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-12-01T09:44:52.494 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:52.490+0000 7f1f413c65c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-12-01T09:44:52.495 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:52.490+0000 7f1f413c65c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-12-01T09:44:52.495 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:44:52.491+0000 7f1f413c65c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-12-01T09:44:55.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-12-01T09:44:55.394 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-12-01T09:44:55.428 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:55.429 INFO:tasks.ceph:role: osd.4 2022-12-01T09:44:55.429 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi182.front.sepia.ceph.com 2022-12-01T09:44:55.430 DEBUG:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-12-01T09:44:55.508 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:44:55.508 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:44:55.508 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:44:55.508 INFO:teuthology.orchestra.run.smithi182.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:44:55.509 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:44:55.509 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:44:55.509 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:44:55.509 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:44:55.510 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:44:55.510 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:44:55.939 INFO:teuthology.orchestra.run.smithi182.stdout:Discarding blocks...Done. 2022-12-01T09:44:55.942 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2022-12-01T09:44:55.942 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-12-01T09:44:56.130 DEBUG:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-12-01T09:44:56.169 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-12-01T09:44:56.239 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:56.240 INFO:tasks.ceph:role: osd.5 2022-12-01T09:44:56.240 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi182.front.sepia.ceph.com 2022-12-01T09:44:56.241 DEBUG:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-12-01T09:44:56.317 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:44:56.317 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:44:56.317 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:44:56.317 INFO:teuthology.orchestra.run.smithi182.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:44:56.318 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:44:56.318 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:44:56.318 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:44:56.318 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:44:56.319 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:44:56.319 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:44:56.728 INFO:teuthology.orchestra.run.smithi182.stdout:Discarding blocks...Done. 2022-12-01T09:44:56.730 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2022-12-01T09:44:56.730 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-12-01T09:44:56.835 DEBUG:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-12-01T09:44:56.869 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-12-01T09:44:56.940 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:56.940 INFO:tasks.ceph:role: osd.6 2022-12-01T09:44:56.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi182.front.sepia.ceph.com 2022-12-01T09:44:56.942 DEBUG:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-12-01T09:44:57.016 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:44:57.017 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:44:57.017 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:44:57.017 INFO:teuthology.orchestra.run.smithi182.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:44:57.018 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:44:57.018 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:44:57.018 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:44:57.018 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:44:57.018 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:44:57.019 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:44:57.465 INFO:teuthology.orchestra.run.smithi182.stdout:Discarding blocks...Done. 2022-12-01T09:44:57.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2022-12-01T09:44:57.467 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-12-01T09:44:57.625 DEBUG:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-12-01T09:44:57.663 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-12-01T09:44:57.732 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:44:57.732 INFO:tasks.ceph:role: osd.7 2022-12-01T09:44:57.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi182.front.sepia.ceph.com 2022-12-01T09:44:57.733 DEBUG:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-12-01T09:44:57.808 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:44:57.808 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:44:57.808 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:44:57.809 INFO:teuthology.orchestra.run.smithi182.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:44:57.809 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:44:57.809 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:44:57.810 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:44:57.810 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:44:57.810 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:44:57.810 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:44:58.251 INFO:teuthology.orchestra.run.smithi182.stdout:Discarding blocks...Done. 2022-12-01T09:44:58.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2022-12-01T09:44:58.254 DEBUG:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-12-01T09:44:58.444 DEBUG:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-12-01T09:44:58.483 DEBUG:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:44:58.576 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:44:58.572+0000 7f44ab1cb5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-12-01T09:44:58.576 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:44:58.572+0000 7f44ab1cb5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-12-01T09:44:58.577 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:44:58.572+0000 7f44ab1cb5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-12-01T09:44:58.577 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:44:58.572+0000 7f44ab1cb5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-12-01T09:44:58.577 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:44:58.572+0000 7f44ab1cb5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-12-01T09:44:58.577 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:44:58.573+0000 7f44ab1cb5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-12-01T09:45:01.435 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-12-01T09:45:01.466 DEBUG:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:45:01.557 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:01.553+0000 7f6555d3e5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-12-01T09:45:01.557 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:01.553+0000 7f6555d3e5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-12-01T09:45:01.558 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:01.553+0000 7f6555d3e5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-12-01T09:45:01.558 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:01.553+0000 7f6555d3e5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-12-01T09:45:01.558 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:01.553+0000 7f6555d3e5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-12-01T09:45:01.558 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:01.554+0000 7f6555d3e5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-12-01T09:45:04.416 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-12-01T09:45:04.446 DEBUG:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:45:04.536 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:04.532+0000 7f8c8d48a5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-12-01T09:45:04.536 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:04.532+0000 7f8c8d48a5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-12-01T09:45:04.536 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:04.532+0000 7f8c8d48a5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-12-01T09:45:04.536 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:04.532+0000 7f8c8d48a5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-12-01T09:45:04.537 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:04.532+0000 7f8c8d48a5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-12-01T09:45:04.537 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:04.532+0000 7f8c8d48a5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-12-01T09:45:07.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-12-01T09:45:07.051 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-12-01T09:45:07.409 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-12-01T09:45:07.439 DEBUG:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:45:07.529 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:07.525+0000 7f995a9c55c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-12-01T09:45:07.530 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:07.526+0000 7f995a9c55c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-12-01T09:45:07.531 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:07.526+0000 7f995a9c55c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-12-01T09:45:07.531 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:07.526+0000 7f995a9c55c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-12-01T09:45:07.532 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:07.526+0000 7f995a9c55c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-12-01T09:45:07.532 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:07.526+0000 7f995a9c55c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-12-01T09:45:10.387 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-12-01T09:45:10.419 INFO:tasks.ceph:Reading keys from all nodes... 2022-12-01T09:45:10.419 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:10.420 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-12-01T09:45:10.452 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:10.452 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-12-01T09:45:10.522 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:10.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-12-01T09:45:10.592 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:10.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-12-01T09:45:10.664 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:10.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-12-01T09:45:10.732 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:10.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-12-01T09:45:10.800 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:10.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-12-01T09:45:10.868 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:10.868 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-12-01T09:45:10.900 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:10.901 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-12-01T09:45:10.971 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:10.972 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-12-01T09:45:11.041 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:11.042 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-12-01T09:45:11.109 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:11.110 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-12-01T09:45:11.178 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:11.179 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-12-01T09:45:11.246 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:11.247 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-12-01T09:45:11.313 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:11.313 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-12-01T09:45:11.333 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:11.334 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2022-12-01T09:45:11.393 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:11.393 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2022-12-01T09:45:11.412 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:11.413 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2022-12-01T09:45:11.469 INFO:tasks.ceph:Adding keys to all mons... 2022-12-01T09:45:11.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2022-12-01T09:45:11.472 DEBUG:teuthology.orchestra.run.smithi182:> sudo tee -a /etc/ceph/ceph.keyring 2022-12-01T09:45:11.513 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2022-12-01T09:45:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCHd4hjrZK3JRAAR/Et873a/XyehGCxURr8ww== 2022-12-01T09:45:11.514 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2022-12-01T09:45:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCHd4hjGZcFLRAAwdVQUKnI1aGNil3ZQYCtKg== 2022-12-01T09:45:11.516 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2022-12-01T09:45:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCHd4hj9mNgNBAAu8vi0hMSCQK1ZWu6et61FQ== 2022-12-01T09:45:11.517 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2022-12-01T09:45:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCLd4hjZkDMHxAAsbJRa1m39+A+kUORfd/pUw== 2022-12-01T09:45:11.517 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2022-12-01T09:45:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCOd4hjpeA+HxAAKZXWuMFonHmyzt0vvR4SCQ== 2022-12-01T09:45:11.518 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2022-12-01T09:45:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCRd4hj/BT2HRAAtrjQZmUvCVjDqnWsIMFGjg== 2022-12-01T09:45:11.519 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2022-12-01T09:45:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCUd4hjbjo/HRAA+sIh8M+ZMtE9bPjwA//gCA== 2022-12-01T09:45:11.520 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2022-12-01T09:45:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCHd4hjdMWmKRAA2SmE44oM9lRmR6tlcfoZxQ== 2022-12-01T09:45:11.521 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2022-12-01T09:45:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCHd4hjCKNxORAAfFNOb8J9kyTzyuQo3AP6Vg== 2022-12-01T09:45:11.521 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2022-12-01T09:45:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCId4hjMCEVBRAAPVVn0kYgifWsGzP8ypK3ww== 2022-12-01T09:45:11.522 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2022-12-01T09:45:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCad4hjq2sqIhAA2BYoo+DOxfJVXuBYQLlyzA== 2022-12-01T09:45:11.523 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2022-12-01T09:45:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCdd4hjJNYGIRAAfiI5KpvjLFe7hDLVlvWOsQ== 2022-12-01T09:45:11.524 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2022-12-01T09:45:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCgd4hjdvvAHxAAQUGISD1hvQWQeu6QDEw4QA== 2022-12-01T09:45:11.524 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2022-12-01T09:45:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCjd4hj2L9iHxAALW31voxWdVAq4RuJUQY26A== 2022-12-01T09:45:11.525 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2022-12-01T09:45:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCId4hjEvRpCRAAX+es8tUV1xuGjvpRyoW6hw== 2022-12-01T09:45:11.525 INFO:teuthology.orchestra.run.smithi079.stdout:[client.2] 2022-12-01T09:45:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCId4hjHYUjDxAA2LYtOXMc5FLWXXOAdliG7w== 2022-12-01T09:45:11.526 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2022-12-01T09:45:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCId4hjaOKAEhAA1vVe5xia2ik+KV7hKKi15g== 2022-12-01T09:45:11.526 INFO:teuthology.orchestra.run.smithi079.stdout:[client.3] 2022-12-01T09:45:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCId4hj1Ag0GBAADIFgGlvlaqpwRG1pijD5HA== 2022-12-01T09:45:11.534 INFO:teuthology.orchestra.run.smithi182.stdout:[mgr.y] 2022-12-01T09:45:11.534 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCHd4hjrZK3JRAAR/Et873a/XyehGCxURr8ww== 2022-12-01T09:45:11.535 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.a] 2022-12-01T09:45:11.535 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCHd4hjGZcFLRAAwdVQUKnI1aGNil3ZQYCtKg== 2022-12-01T09:45:11.535 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.c] 2022-12-01T09:45:11.535 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCHd4hj9mNgNBAAu8vi0hMSCQK1ZWu6et61FQ== 2022-12-01T09:45:11.536 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.0] 2022-12-01T09:45:11.536 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCLd4hjZkDMHxAAsbJRa1m39+A+kUORfd/pUw== 2022-12-01T09:45:11.536 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.1] 2022-12-01T09:45:11.536 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCOd4hjpeA+HxAAKZXWuMFonHmyzt0vvR4SCQ== 2022-12-01T09:45:11.537 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.2] 2022-12-01T09:45:11.537 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCRd4hj/BT2HRAAtrjQZmUvCVjDqnWsIMFGjg== 2022-12-01T09:45:11.537 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.3] 2022-12-01T09:45:11.537 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCUd4hjbjo/HRAA+sIh8M+ZMtE9bPjwA//gCA== 2022-12-01T09:45:11.538 INFO:teuthology.orchestra.run.smithi182.stdout:[mgr.x] 2022-12-01T09:45:11.538 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCHd4hjdMWmKRAA2SmE44oM9lRmR6tlcfoZxQ== 2022-12-01T09:45:11.538 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.b] 2022-12-01T09:45:11.538 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCHd4hjCKNxORAAfFNOb8J9kyTzyuQo3AP6Vg== 2022-12-01T09:45:11.538 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.d] 2022-12-01T09:45:11.539 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCId4hjMCEVBRAAPVVn0kYgifWsGzP8ypK3ww== 2022-12-01T09:45:11.539 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.4] 2022-12-01T09:45:11.539 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCad4hjq2sqIhAA2BYoo+DOxfJVXuBYQLlyzA== 2022-12-01T09:45:11.539 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.5] 2022-12-01T09:45:11.540 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCdd4hjJNYGIRAAfiI5KpvjLFe7hDLVlvWOsQ== 2022-12-01T09:45:11.540 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.6] 2022-12-01T09:45:11.540 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCgd4hjdvvAHxAAQUGISD1hvQWQeu6QDEw4QA== 2022-12-01T09:45:11.540 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.7] 2022-12-01T09:45:11.541 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCjd4hj2L9iHxAALW31voxWdVAq4RuJUQY26A== 2022-12-01T09:45:11.541 INFO:teuthology.orchestra.run.smithi182.stdout:[client.0] 2022-12-01T09:45:11.541 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCId4hjEvRpCRAAX+es8tUV1xuGjvpRyoW6hw== 2022-12-01T09:45:11.541 INFO:teuthology.orchestra.run.smithi182.stdout:[client.2] 2022-12-01T09:45:11.542 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCId4hjHYUjDxAA2LYtOXMc5FLWXXOAdliG7w== 2022-12-01T09:45:11.542 INFO:teuthology.orchestra.run.smithi182.stdout:[client.1] 2022-12-01T09:45:11.542 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCId4hjaOKAEhAA1vVe5xia2ik+KV7hKKi15g== 2022-12-01T09:45:11.542 INFO:teuthology.orchestra.run.smithi182.stdout:[client.3] 2022-12-01T09:45:11.542 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQCId4hj1Ag0GBAADIFgGlvlaqpwRG1pijD5HA== 2022-12-01T09:45:11.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-12-01T09:45:11.571 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-12-01T09:45:11.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:45:11.639 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:45:11.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:45:11.699 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:45:11.754 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:11.757 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:11.809 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:11.812 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:11.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:11.868 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:11.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:11.925 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:11.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-12-01T09:45:11.983 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-12-01T09:45:12.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:45:12.054 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:45:12.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:45:12.113 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:45:12.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:12.173 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:12.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:12.229 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:12.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:12.289 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:12.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:12.351 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:45:12.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:45:12.408 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:45:12.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:45:12.467 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:45:12.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:45:12.526 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:45:12.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:45:12.585 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:45:12.641 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-12-01T09:45:12.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-12-01T09:45:12.669 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-12-01T09:45:12.765 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-12-01T09:45:12.792 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-12-01T09:45:12.823 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-12-01T09:45:12.918 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-12-01T09:45:12.946 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-12-01T09:45:13.013 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-12-01T09:45:13.110 DEBUG:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-12-01T09:45:13.137 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:45:13.140 DEBUG:teuthology.orchestra.run.smithi182:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:45:13.194 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-12-01T09:45:13.194 INFO:tasks.ceph.mon.a:Restarting daemon 2022-12-01T09:45:13.195 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-12-01T09:45:13.197 INFO:tasks.ceph.mon.a:Started 2022-12-01T09:45:13.198 INFO:tasks.ceph.mon.b:Restarting daemon 2022-12-01T09:45:13.198 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-12-01T09:45:13.236 INFO:tasks.ceph.mon.b:Started 2022-12-01T09:45:13.237 INFO:tasks.ceph.mon.c:Restarting daemon 2022-12-01T09:45:13.238 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-12-01T09:45:13.241 INFO:tasks.ceph.mon.c:Started 2022-12-01T09:45:13.242 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-12-01T09:45:13.242 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-12-01T09:45:13.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-12-01T09:45:13.246 INFO:tasks.ceph.mgr.y:Started 2022-12-01T09:45:13.247 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-12-01T09:45:13.247 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-12-01T09:45:13.251 INFO:tasks.ceph.mgr.x:Started 2022-12-01T09:45:13.252 INFO:tasks.ceph:Setting crush tunables to default 2022-12-01T09:45:13.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2022-12-01T09:45:13.375 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.371+0000 7f52a8294700 1 Processor -- start 2022-12-01T09:45:13.375 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.371+0000 7f52a8294700 1 -- start start 2022-12-01T09:45:13.377 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a8294700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 0x7f52a006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:13.378 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a8294700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52a006aaf0 0x7f52a006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:13.378 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a8294700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a015a720 con 0x7f52a0159990 2022-12-01T09:45:13.378 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a8294700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a00c9190 con 0x7f52a006aaf0 2022-12-01T09:45:13.378 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a8294700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a015b2c0 con 0x7f52a0159d60 2022-12-01T09:45:13.379 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a6030700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f52a0159990 0x7f52a015abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39096/0 (socket says 172.21.15.79:39096) 2022-12-01T09:45:13.379 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a6030700 1 -- 172.21.15.79:0/227337780 learned_addr learned my addr 172.21.15.79:0/227337780 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:13.379 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a6831700 1 --2- 172.21.15.79:0/227337780 >> v2:172.21.15.79:3300/0 conn(0x7f52a006aaf0 0x7f52a006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:13.379 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a6831700 1 -- 172.21.15.79:0/227337780 >> v2:172.21.15.79:3300/0 conn(0x7f52a006aaf0 msgr2=0x7f52a006f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:45:13.379 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a6831700 1 -- 172.21.15.79:0/227337780 >> v2:172.21.15.79:3300/0 conn(0x7f52a006aaf0 msgr2=0x7f52a006f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:45:13.380 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a6831700 1 --2- 172.21.15.79:0/227337780 >> v2:172.21.15.79:3300/0 conn(0x7f52a006aaf0 0x7f52a006f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:45:13.380 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a6831700 1 --2- 172.21.15.79:0/227337780 >> v2:172.21.15.79:3300/0 conn(0x7f52a006aaf0 0x7f52a006f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-12-01T09:45:13.380 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a582f700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 0x7f52a006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:13.380 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a582f700 1 -- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 msgr2=0x7f52a006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-12-01T09:45:13.381 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a582f700 1 -- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 msgr2=0x7f52a006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:45:13.381 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a582f700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 0x7f52a006a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:45:13.381 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.372+0000 7f52a582f700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 0x7f52a006a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-12-01T09:45:13.560 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273029028 0 0) 0x7f52a015a720 con 0x7f52a0159990 2022-12-01T09:45:13.561 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52880035b0 con 0x7f52a0159990 2022-12-01T09:45:13.561 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 524179972 0 0) 0x7f52880035b0 con 0x7f52a0159990 2022-12-01T09:45:13.561 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 msgr2=0x7f52a006a5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-12-01T09:45:13.561 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 0x7f52a006a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.562 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 >> v2:172.21.15.79:3300/0 conn(0x7f52a006aaf0 msgr2=0x7f52a006f9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-12-01T09:45:13.562 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 --2- 172.21.15.79:0/227337780 >> v2:172.21.15.79:3300/0 conn(0x7f52a006aaf0 0x7f52a006f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.562 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a00cdfb0 con 0x7f52a0159990 2022-12-01T09:45:13.562 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 805749679 0 0) 0x7f529c001670 con 0x7f52a0159990 2022-12-01T09:45:13.563 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 >> v1:172.21.15.79:6789/0 conn(0x7f52a0159990 legacy=0x7f52a015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:13.563 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5288003a00 0x7f5288003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:13.563 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 0x7f5288004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:13.563 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5288004d90 0x7f5288005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:13.564 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a00c9190 con 0x7f5288003a00 2022-12-01T09:45:13.564 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a015b2c0 con 0x7f5288004d90 2022-12-01T09:45:13.564 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528800bac0 con 0x7f52a0159d60 2022-12-01T09:45:13.564 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a6030700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5288003a00 0x7f5288003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:13.564 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a582f700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 0x7f5288004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:13.565 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a6831700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5288004d90 0x7f5288005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:13.565 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a6030700 1 -- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 msgr2=0x7f5288004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:13.565 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a6030700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f52a0159d60 0x7f5288004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.565 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a6030700 1 -- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5288004d90 msgr2=0x7f5288005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:13.566 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a6030700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5288004d90 0x7f5288005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.566 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.546+0000 7f52a6030700 1 -- 172.21.15.79:0/227337780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880035b0 con 0x7f5288003a00 2022-12-01T09:45:13.566 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.547+0000 7f52a6030700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5288003a00 0x7f5288003e10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c370 tx=0x7f5288005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb38c5a0cb8eeb2 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:13.567 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.547+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c007c60 con 0x7f5288003a00 2022-12-01T09:45:13.568 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.547+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c005960 con 0x7f5288003a00 2022-12-01T09:45:13.568 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.547+0000 7f52a502e700 1 -- 172.21.15.79:0/227337780 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c005d10 con 0x7f5288003a00 2022-12-01T09:45:13.569 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.547+0000 7f52a8294700 1 -- 172.21.15.79:0/227337780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5288003a00 msgr2=0x7f5288003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:13.569 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.547+0000 7f52a8294700 1 --2- 172.21.15.79:0/227337780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5288003a00 0x7f5288003e10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c370 tx=0x7f5288005880 comp rx=0 tx=0).stop 2022-12-01T09:45:13.569 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.547+0000 7f52a6831700 1 -- 172.21.15.79:0/227337780 reap_dead start 2022-12-01T09:45:13.570 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.548+0000 7f52a8294700 1 -- 172.21.15.79:0/227337780 shutdown_connections 2022-12-01T09:45:13.570 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.548+0000 7f52a8294700 1 -- 172.21.15.79:0/227337780 >> 172.21.15.79:0/227337780 conn(0x7f52a00ce920 msgr2=0x7f52a00cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:13.571 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.548+0000 7f52a8294700 1 -- 172.21.15.79:0/227337780 shutdown_connections 2022-12-01T09:45:13.571 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.548+0000 7f52a8294700 1 -- 172.21.15.79:0/227337780 wait complete. 2022-12-01T09:45:13.572 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.549+0000 7f52a8294700 1 Processor -- start 2022-12-01T09:45:13.572 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.549+0000 7f52a8294700 1 -- start start 2022-12-01T09:45:13.573 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a8294700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5288003a00 0x7f52a0153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:13.573 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a8294700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a0156120 0x7f52a00cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:13.574 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a8294700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a015c450 0x7f52a015c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:13.574 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a8294700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a015ce30 con 0x7f52a0156120 2022-12-01T09:45:13.574 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a8294700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0156620 con 0x7f52a015c450 2022-12-01T09:45:13.575 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a8294700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a00b26f0 con 0x7f5288003a00 2022-12-01T09:45:13.575 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a582f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a0156120 0x7f52a00cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:13.576 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a582f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a0156120 0x7f52a00cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46966/0 (socket says 172.21.15.79:46966) 2022-12-01T09:45:13.576 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a582f700 1 -- 172.21.15.79:0/413057826 learned_addr learned my addr 172.21.15.79:0/413057826 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:13.577 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a6831700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a015c450 0x7f52a015c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:13.577 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a6030700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5288003a00 0x7f52a0153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:13.577 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a582f700 1 -- 172.21.15.79:0/413057826 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5288003a00 msgr2=0x7f52a0153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:13.578 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a582f700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5288003a00 0x7f52a0153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.578 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a582f700 1 -- 172.21.15.79:0/413057826 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a015c450 msgr2=0x7f52a015c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:13.578 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a582f700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a015c450 0x7f52a015c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.579 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a582f700 1 -- 172.21.15.79:0/413057826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a00b29d0 con 0x7f52a0156120 2022-12-01T09:45:13.579 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a6831700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a015c450 0x7f52a015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-12-01T09:45:13.580 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a582f700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a0156120 0x7f52a00cb610 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f52900109f0 tx=0x7f5290010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:13.580 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f528effd700 1 -- 172.21.15.79:0/413057826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290006ea0 con 0x7f52a0156120 2022-12-01T09:45:13.580 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f528effd700 1 -- 172.21.15.79:0/413057826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529000ea70 con 0x7f52a0156120 2022-12-01T09:45:13.581 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f528effd700 1 -- 172.21.15.79:0/413057826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529000ee20 con 0x7f52a0156120 2022-12-01T09:45:13.581 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a8294700 1 -- 172.21.15.79:0/413057826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a00b2cb0 con 0x7f52a0156120 2022-12-01T09:45:13.582 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f52a8294700 1 -- 172.21.15.79:0/413057826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a00cbb50 con 0x7f52a0156120 2022-12-01T09:45:13.582 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f528effd700 1 -- 172.21.15.79:0/413057826 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f5290026070 con 0x7f52a0156120 2022-12-01T09:45:13.582 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.550+0000 7f528effd700 1 -- 172.21.15.79:0/413057826 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5290016420 con 0x7f52a0156120 2022-12-01T09:45:13.583 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.551+0000 7f52a8294700 1 -- 172.21.15.79:0/413057826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a00669f0 con 0x7f52a0156120 2022-12-01T09:45:13.583 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.553+0000 7f528effd700 1 -- 172.21.15.79:0/413057826 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f529003e6e0 con 0x7f52a0156120 2022-12-01T09:45:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.626+0000 7f52a8294700 1 -- 172.21.15.79:0/413057826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f52a0070c70 con 0x7f52a0156120 2022-12-01T09:45:13.632 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.629+0000 7f528effd700 1 -- 172.21.15.79:0/413057826 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f529002d020 con 0x7f52a0156120 2022-12-01T09:45:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.630+0000 7f52a8294700 1 -- 172.21.15.79:0/413057826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a0156120 msgr2=0x7f52a00cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.630+0000 7f52a8294700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a0156120 0x7f52a00cb610 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f52900109f0 tx=0x7f5290010db0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.634 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.630+0000 7f52a8294700 1 -- 172.21.15.79:0/413057826 shutdown_connections 2022-12-01T09:45:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.630+0000 7f52a8294700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f52a015c450 0x7f52a015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.630+0000 7f52a8294700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5288003a00 0x7f52a0153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.630+0000 7f52a8294700 1 --2- 172.21.15.79:0/413057826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52a0156120 0x7f52a00cb610 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:13.635 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.630+0000 7f52a8294700 1 -- 172.21.15.79:0/413057826 >> 172.21.15.79:0/413057826 conn(0x7f52a00ce920 msgr2=0x7f52a006a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.630+0000 7f52a8294700 1 -- 172.21.15.79:0/413057826 shutdown_connections 2022-12-01T09:45:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:13.630+0000 7f52a8294700 1 -- 172.21.15.79:0/413057826 wait complete. 2022-12-01T09:45:13.636 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2022-12-01T09:45:13.645 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-12-01T09:45:13.646 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:13.646 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-12-01T09:45:13.673 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:13.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-12-01T09:45:13.740 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:13.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-12-01T09:45:13.807 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2022-12-01T09:45:13.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-12-01T09:45:13.873 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:13.874 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-12-01T09:45:13.901 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:13.902 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-12-01T09:45:13.968 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:13.968 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-12-01T09:45:14.035 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-12-01T09:45:14.035 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-12-01T09:45:14.037 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:14.030+0000 7fe18a763200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-12-01T09:45:14.044 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:14.039+0000 7fe708a16200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-12-01T09:45:14.070 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new f65efd56-e00f-4915-a254-99ba3bad5ca4 0 2022-12-01T09:45:14.097 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:14.093+0000 7fe18a763200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-12-01T09:45:14.109 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:14.105+0000 7fe708a16200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-12-01T09:45:14.171 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:14.167+0000 7fe18a763200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-12-01T09:45:14.186 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:14.182+0000 7fe708a16200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-12-01T09:45:14.229 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.224+0000 7f26525cf700 1 Processor -- start 2022-12-01T09:45:14.229 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.225+0000 7f26525cf700 1 -- start start 2022-12-01T09:45:14.232 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.225+0000 7f26525cf700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f264c0b19a0 0x7f264c15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.233 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.225+0000 7f26525cf700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b11b0 0x7f264c0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.233 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.225+0000 7f26525cf700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264c15d270 con 0x7f264c0b0de0 2022-12-01T09:45:14.233 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.225+0000 7f26525cf700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c15c910 con 0x7f264c0b19a0 2022-12-01T09:45:14.234 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.225+0000 7f26525cf700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c070300 con 0x7f264c0b11b0 2022-12-01T09:45:14.234 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.225+0000 7f264b7fe700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f264c0b19a0 0x7f264c15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.234 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.225+0000 7f2650b6c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b11b0 0x7f264c0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.235 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264bfff700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f264c0b0de0 0x7f264c160240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.182:44146/0 (socket says 172.21.15.182:44146) 2022-12-01T09:45:14.235 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f2650b6c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b11b0 0x7f264c0cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55794/0 (socket says 172.21.15.182:55794) 2022-12-01T09:45:14.235 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264b7fe700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f264c0b19a0 0x7f264c15cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:39404/0 (socket says 172.21.15.182:39404) 2022-12-01T09:45:14.235 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264bfff700 1 -- 172.21.15.182:0/3545094334 learned_addr learned my addr 172.21.15.182:0/3545094334 (peer_addr_for_me v1:172.21.15.182:0/0) 2022-12-01T09:45:14.235 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264b7fe700 1 -- 172.21.15.182:0/3545094334 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b11b0 msgr2=0x7f264c0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:14.236 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264b7fe700 1 --2- 172.21.15.182:0/3545094334 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b11b0 0x7f264c0cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.236 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264b7fe700 1 -- 172.21.15.182:0/3545094334 >> v1:172.21.15.182:6789/0 conn(0x7f264c0b0de0 legacy=0x7f264c160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.236 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264b7fe700 1 -- 172.21.15.182:0/3545094334 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0705e0 con 0x7f264c0b19a0 2022-12-01T09:45:14.236 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f2650b6c700 1 --2- 172.21.15.182:0/3545094334 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b11b0 0x7f264c0cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:14.237 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264b7fe700 1 --2- 172.21.15.182:0/3545094334 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b19a0 0x7f264c15cd30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2640009820 tx=0x7f2640009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cccada65006832c0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:14.237 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264affd700 1 -- 172.21.15.182:0/3545094334 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640005e30 con 0x7f264c0b19a0 2022-12-01T09:45:14.237 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264affd700 1 -- 172.21.15.182:0/3545094334 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2640006030 con 0x7f264c0b19a0 2022-12-01T09:45:14.237 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.226+0000 7f264affd700 1 -- 172.21.15.182:0/3545094334 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26400063c0 con 0x7f264c0b19a0 2022-12-01T09:45:14.238 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.227+0000 7f26525cf700 1 -- 172.21.15.182:0/3545094334 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b19a0 msgr2=0x7f264c15cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.238 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.227+0000 7f26525cf700 1 --2- 172.21.15.182:0/3545094334 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b19a0 0x7f264c15cd30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2640009820 tx=0x7f2640009b30 comp rx=0 tx=0).stop 2022-12-01T09:45:14.238 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.227+0000 7f26525cf700 1 -- 172.21.15.182:0/3545094334 shutdown_connections 2022-12-01T09:45:14.238 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.227+0000 7f26525cf700 1 --2- 172.21.15.182:0/3545094334 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b11b0 0x7f264c0cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.239 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.227+0000 7f26525cf700 1 --2- 172.21.15.182:0/3545094334 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b19a0 0x7f264c15cd30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.239 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.227+0000 7f26525cf700 1 -- 172.21.15.182:0/3545094334 >> 172.21.15.182:0/3545094334 conn(0x7f264c06c530 msgr2=0x7f264c06c930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:14.239 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.227+0000 7f26525cf700 1 -- 172.21.15.182:0/3545094334 shutdown_connections 2022-12-01T09:45:14.239 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.227+0000 7f26525cf700 1 -- 172.21.15.182:0/3545094334 wait complete. 2022-12-01T09:45:14.239 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.228+0000 7f26525cf700 1 Processor -- start 2022-12-01T09:45:14.240 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.228+0000 7f26525cf700 1 -- start start 2022-12-01T09:45:14.243 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f26525cf700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b0de0 0x7f264c0b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.243 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f26525cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f264c0b11b0 0x7f264c14fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.243 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f26525cf700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b19a0 0x7f264c0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.243 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f26525cf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c150530 con 0x7f264c0b11b0 2022-12-01T09:45:14.244 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f26525cf700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0cc580 con 0x7f264c0b0de0 2022-12-01T09:45:14.244 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f26525cf700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0cafa0 con 0x7f264c0b19a0 2022-12-01T09:45:14.244 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f264bfff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b0de0 0x7f264c0b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.245 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f2650b6c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b19a0 0x7f264c0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.245 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f2650b6c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b19a0 0x7f264c0cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55800/0 (socket says 172.21.15.182:55800) 2022-12-01T09:45:14.245 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f264bfff700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b0de0 0x7f264c0b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:39408/0 (socket says 172.21.15.182:39408) 2022-12-01T09:45:14.245 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f2650b6c700 1 -- 172.21.15.182:0/1928018368 learned_addr learned my addr 172.21.15.182:0/1928018368 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:14.246 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f264b7fe700 1 --2- 172.21.15.182:0/1928018368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f264c0b11b0 0x7f264c14fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.246 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f2650b6c700 1 -- 172.21.15.182:0/1928018368 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b0de0 msgr2=0x7f264c0b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.246 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f2650b6c700 1 --2- 172.21.15.182:0/1928018368 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b0de0 0x7f264c0b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.246 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f2650b6c700 1 -- 172.21.15.182:0/1928018368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f264c0b11b0 msgr2=0x7f264c14fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.246 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f2650b6c700 1 --2- 172.21.15.182:0/1928018368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f264c0b11b0 0x7f264c14fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.247 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f2650b6c700 1 -- 172.21.15.182:0/1928018368 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644009a70 con 0x7f264c0b19a0 2022-12-01T09:45:14.247 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.229+0000 7f264bfff700 1 --2- 172.21.15.182:0/1928018368 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b0de0 0x7f264c0b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:14.247 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.230+0000 7f2650b6c700 1 --2- 172.21.15.182:0/1928018368 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b19a0 0x7f264c0cc040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f264400efc0 tx=0x7f264400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:14.247 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.230+0000 7f2648ff9700 1 -- 172.21.15.182:0/1928018368 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400ca90 con 0x7f264c0b19a0 2022-12-01T09:45:14.248 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.230+0000 7f2648ff9700 1 -- 172.21.15.182:0/1928018368 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400f040 con 0x7f264c0b19a0 2022-12-01T09:45:14.248 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.230+0000 7f2648ff9700 1 -- 172.21.15.182:0/1928018368 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400ce30 con 0x7f264c0b19a0 2022-12-01T09:45:14.248 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.230+0000 7f26525cf700 1 -- 172.21.15.182:0/1928018368 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2640009430 con 0x7f264c0b19a0 2022-12-01T09:45:14.248 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.230+0000 7f26525cf700 1 -- 172.21.15.182:0/1928018368 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c0cb560 con 0x7f264c0b19a0 2022-12-01T09:45:14.249 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.230+0000 7f2648ff9700 1 -- 172.21.15.182:0/1928018368 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2644003a20 con 0x7f264c0b19a0 2022-12-01T09:45:14.249 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.230+0000 7f2648ff9700 1 -- 172.21.15.182:0/1928018368 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f26440147c0 con 0x7f264c0b19a0 2022-12-01T09:45:14.249 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.231+0000 7f26525cf700 1 -- 172.21.15.182:0/1928018368 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c0669f0 con 0x7f264c0b19a0 2022-12-01T09:45:14.249 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.233+0000 7f2648ff9700 1 -- 172.21.15.182:0/1928018368 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f2644018030 con 0x7f264c0b19a0 2022-12-01T09:45:14.250 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:14.244+0000 7fe18a763200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-12-01T09:45:14.269 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:14.264+0000 7fe708a16200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-12-01T09:45:14.320 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.315+0000 7f26525cf700 1 -- 172.21.15.182:0/1928018368 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f65efd56-e00f-4915-a254-99ba3bad5ca4", "id": 0} v 0) v1 -- 0x7f264c0ccaa0 con 0x7f264c0b19a0 2022-12-01T09:45:14.327 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.321+0000 7f2648ff9700 1 -- 172.21.15.182:0/1928018368 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f65efd56-e00f-4915-a254-99ba3bad5ca4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2644004790 con 0x7f264c0b19a0 2022-12-01T09:45:14.327 INFO:teuthology.orchestra.run.smithi182.stdout:0 2022-12-01T09:45:14.330 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.322+0000 7f26525cf700 1 -- 172.21.15.182:0/1928018368 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b19a0 msgr2=0x7f264c0cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.330 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.322+0000 7f26525cf700 1 --2- 172.21.15.182:0/1928018368 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b19a0 0x7f264c0cc040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f264400efc0 tx=0x7f264400c3a0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.331 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.322+0000 7f26525cf700 1 -- 172.21.15.182:0/1928018368 shutdown_connections 2022-12-01T09:45:14.331 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.322+0000 7f26525cf700 1 --2- 172.21.15.182:0/1928018368 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f264c0b19a0 0x7f264c0cc040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.331 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.322+0000 7f26525cf700 1 --2- 172.21.15.182:0/1928018368 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f264c0b0de0 0x7f264c0b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.332 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.322+0000 7f26525cf700 1 --2- 172.21.15.182:0/1928018368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f264c0b11b0 0x7f264c14fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.332 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.322+0000 7f26525cf700 1 -- 172.21.15.182:0/1928018368 >> 172.21.15.182:0/1928018368 conn(0x7f264c06c530 msgr2=0x7f264c15e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:14.333 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.322+0000 7f26525cf700 1 -- 172.21.15.182:0/1928018368 shutdown_connections 2022-12-01T09:45:14.333 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.322+0000 7f26525cf700 1 -- 172.21.15.182:0/1928018368 wait complete. 2022-12-01T09:45:14.338 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new 51034ab5-541d-48e6-957b-d23ba4bf28d4 1 2022-12-01T09:45:14.387 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:14.383+0000 7fe18a763200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-12-01T09:45:14.418 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:14.413+0000 7fe708a16200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-12-01T09:45:14.462 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.457+0000 7fb08b70e700 1 Processor -- start 2022-12-01T09:45:14.462 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.458+0000 7fb08b70e700 1 -- start start 2022-12-01T09:45:14.465 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.458+0000 7fb08b70e700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.465 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.458+0000 7fb08b70e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0840af2a0 0x7fb0840acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.465 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.458+0000 7fb08b70e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840d0040 con 0x7fb0840aedb0 2022-12-01T09:45:14.465 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.458+0000 7fb08b70e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0840cc610 con 0x7fb0840af2a0 2022-12-01T09:45:14.466 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.458+0000 7fb08b70e700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08415a0a0 con 0x7fb0840ce510 2022-12-01T09:45:14.466 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb088ca9700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.466 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb088ca9700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55804/0 (socket says 172.21.15.182:55804) 2022-12-01T09:45:14.466 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb088ca9700 1 -- 172.21.15.182:0/3427909227 learned_addr learned my addr 172.21.15.182:0/3427909227 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:14.467 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb089cab700 1 --2- 172.21.15.182:0/3427909227 >> v2:172.21.15.79:3300/0 conn(0x7fb0840af2a0 0x7fb0840acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.467 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb088ca9700 1 -- 172.21.15.182:0/3427909227 >> v2:172.21.15.79:3300/0 conn(0x7fb0840af2a0 msgr2=0x7fb0840acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:14.467 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb088ca9700 1 --2- 172.21.15.182:0/3427909227 >> v2:172.21.15.79:3300/0 conn(0x7fb0840af2a0 0x7fb0840acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.467 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb088ca9700 1 -- 172.21.15.182:0/3427909227 >> v1:172.21.15.79:6789/0 conn(0x7fb0840aedb0 legacy=0x7fb0840cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.468 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb088ca9700 1 -- 172.21.15.182:0/3427909227 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840cb990 con 0x7fb0840ce510 2022-12-01T09:45:14.468 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb088ca9700 1 --2- 172.21.15.182:0/3427909227 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840cb290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0740098f0 tx=0x7fb074009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfde92717b49cf05 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:14.468 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb073fff700 1 -- 172.21.15.182:0/3427909227 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074011830 con 0x7fb0840ce510 2022-12-01T09:45:14.468 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb073fff700 1 -- 172.21.15.182:0/3427909227 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074011990 con 0x7fb0840ce510 2022-12-01T09:45:14.468 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.459+0000 7fb073fff700 1 -- 172.21.15.182:0/3427909227 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074011d20 con 0x7fb0840ce510 2022-12-01T09:45:14.469 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.460+0000 7fb08b70e700 1 -- 172.21.15.182:0/3427909227 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 msgr2=0x7fb0840cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.469 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.460+0000 7fb08b70e700 1 --2- 172.21.15.182:0/3427909227 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840cb290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0740098f0 tx=0x7fb074009c00 comp rx=0 tx=0).stop 2022-12-01T09:45:14.469 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.460+0000 7fb08b70e700 1 -- 172.21.15.182:0/3427909227 shutdown_connections 2022-12-01T09:45:14.469 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.460+0000 7fb08b70e700 1 --2- 172.21.15.182:0/3427909227 >> v2:172.21.15.79:3300/0 conn(0x7fb0840af2a0 0x7fb0840acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.470 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.460+0000 7fb08b70e700 1 --2- 172.21.15.182:0/3427909227 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840cb290 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.470 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.460+0000 7fb08b70e700 1 -- 172.21.15.182:0/3427909227 >> 172.21.15.182:0/3427909227 conn(0x7fb08408a000 msgr2=0x7fb0840d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:14.470 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.460+0000 7fb08b70e700 1 -- 172.21.15.182:0/3427909227 shutdown_connections 2022-12-01T09:45:14.470 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.460+0000 7fb08b70e700 1 -- 172.21.15.182:0/3427909227 wait complete. 2022-12-01T09:45:14.473 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.461+0000 7fb08b70e700 1 Processor -- start 2022-12-01T09:45:14.473 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.461+0000 7fb08b70e700 1 -- start start 2022-12-01T09:45:14.474 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb08b70e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0840aedb0 0x7fb0841f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.474 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb08b70e700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb0840af2a0 0x7fb0841f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.474 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb08b70e700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.474 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb08b70e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841f5c00 con 0x7fb0840aedb0 2022-12-01T09:45:14.475 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb08b70e700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840b4e90 con 0x7fb0840af2a0 2022-12-01T09:45:14.475 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb08b70e700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840b50e0 con 0x7fb0840ce510 2022-12-01T09:45:14.475 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb089cab700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.475 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb088ca9700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb0840af2a0 0x7fb0841f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.476 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb089cab700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55812/0 (socket says 172.21.15.182:55812) 2022-12-01T09:45:14.476 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb089cab700 1 -- 172.21.15.182:0/1836954143 learned_addr learned my addr 172.21.15.182:0/1836954143 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:14.476 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb0894aa700 1 --2- 172.21.15.182:0/1836954143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0840aedb0 0x7fb0841f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.476 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb088ca9700 1 -- 172.21.15.182:0/1836954143 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 msgr2=0x7fb0840b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.477 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb088ca9700 1 --2- 172.21.15.182:0/1836954143 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.477 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb088ca9700 1 -- 172.21.15.182:0/1836954143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0840aedb0 msgr2=0x7fb0841f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.477 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb088ca9700 1 --2- 172.21.15.182:0/1836954143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0840aedb0 0x7fb0841f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.477 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb088ca9700 1 -- 172.21.15.182:0/1836954143 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074009550 con 0x7fb0840af2a0 2022-12-01T09:45:14.477 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.462+0000 7fb089cab700 1 --2- 172.21.15.182:0/1836954143 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:14.478 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.463+0000 7fb088ca9700 1 --2- 172.21.15.182:0/1836954143 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb0840af2a0 0x7fb0841f56c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb084070380 tx=0x7fb074004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:14.478 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.463+0000 7fb071ffb700 1 -- 172.21.15.182:0/1836954143 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074004510 con 0x7fb0840af2a0 2022-12-01T09:45:14.478 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.463+0000 7fb071ffb700 1 -- 172.21.15.182:0/1836954143 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740036a0 con 0x7fb0840af2a0 2022-12-01T09:45:14.478 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.463+0000 7fb08b70e700 1 -- 172.21.15.182:0/1836954143 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0840b53c0 con 0x7fb0840af2a0 2022-12-01T09:45:14.478 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.463+0000 7fb071ffb700 1 -- 172.21.15.182:0/1836954143 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074003a10 con 0x7fb0840af2a0 2022-12-01T09:45:14.479 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.463+0000 7fb08b70e700 1 -- 172.21.15.182:0/1836954143 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0840b5980 con 0x7fb0840af2a0 2022-12-01T09:45:14.479 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.463+0000 7fb071ffb700 1 -- 172.21.15.182:0/1836954143 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb07402d070 con 0x7fb0840af2a0 2022-12-01T09:45:14.479 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.463+0000 7fb071ffb700 1 -- 172.21.15.182:0/1836954143 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fb074021030 con 0x7fb0840af2a0 2022-12-01T09:45:14.479 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.464+0000 7fb08b70e700 1 -- 172.21.15.182:0/1836954143 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0840669f0 con 0x7fb0840af2a0 2022-12-01T09:45:14.480 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.466+0000 7fb071ffb700 1 -- 172.21.15.182:0/1836954143 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fb0740456e0 con 0x7fb0840af2a0 2022-12-01T09:45:14.556 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.551+0000 7fb08b70e700 1 -- 172.21.15.182:0/1836954143 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd new", "uuid": "51034ab5-541d-48e6-957b-d23ba4bf28d4", "id": 1} v 0) v1 -- 0x7fb0840c3740 con 0x7fb0840af2a0 2022-12-01T09:45:14.563 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.558+0000 7fb071ffb700 1 -- 172.21.15.182:0/1836954143 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "51034ab5-541d-48e6-957b-d23ba4bf28d4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb074034030 con 0x7fb0840af2a0 2022-12-01T09:45:14.563 INFO:teuthology.orchestra.run.smithi182.stdout:1 2022-12-01T09:45:14.564 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.559+0000 7fb08b70e700 1 -- 172.21.15.182:0/1836954143 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb0840af2a0 msgr2=0x7fb0841f56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.565 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.559+0000 7fb08b70e700 1 --2- 172.21.15.182:0/1836954143 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb0840af2a0 0x7fb0841f56c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb084070380 tx=0x7fb074004750 comp rx=0 tx=0).stop 2022-12-01T09:45:14.565 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.559+0000 7fb08b70e700 1 -- 172.21.15.182:0/1836954143 shutdown_connections 2022-12-01T09:45:14.565 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.559+0000 7fb08b70e700 1 --2- 172.21.15.182:0/1836954143 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fb0840ce510 0x7fb0840b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.566 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.559+0000 7fb08b70e700 1 --2- 172.21.15.182:0/1836954143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0840aedb0 0x7fb0841f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.566 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.559+0000 7fb08b70e700 1 --2- 172.21.15.182:0/1836954143 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fb0840af2a0 0x7fb0841f56c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.566 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.559+0000 7fb08b70e700 1 -- 172.21.15.182:0/1836954143 >> 172.21.15.182:0/1836954143 conn(0x7fb08408a000 msgr2=0x7fb0840add30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:14.566 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.559+0000 7fb08b70e700 1 -- 172.21.15.182:0/1836954143 shutdown_connections 2022-12-01T09:45:14.567 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.559+0000 7fb08b70e700 1 -- 172.21.15.182:0/1836954143 wait complete. 2022-12-01T09:45:14.576 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new 83191444-237f-49fc-9046-58c92f1d68f2 2 2022-12-01T09:45:14.701 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.691+0000 7f4908e12700 1 Processor -- start 2022-12-01T09:45:14.702 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.691+0000 7f4908e12700 1 -- start start 2022-12-01T09:45:14.702 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.691+0000 7f4908e12700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f490415be80 0x7f49040ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.702 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.691+0000 7f4908e12700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f490415c250 0x7f49040ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.703 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f4908e12700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040cd550 con 0x7f49040cd040 2022-12-01T09:45:14.703 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f4908e12700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49040cd830 con 0x7f490415be80 2022-12-01T09:45:14.703 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f4908e12700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49040cdb10 con 0x7f490415c250 2022-12-01T09:45:14.703 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490259c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f490415be80 0x7f49040ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.704 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f4901d9b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f490415c250 0x7f49040ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.704 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f4901d9b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f490415c250 0x7f49040ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55818/0 (socket says 172.21.15.182:55818) 2022-12-01T09:45:14.704 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490259c700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f490415be80 0x7f49040ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:39426/0 (socket says 172.21.15.182:39426) 2022-12-01T09:45:14.705 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f4901d9b700 1 -- 172.21.15.182:0/3937799621 learned_addr learned my addr 172.21.15.182:0/3937799621 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:14.705 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490259c700 1 -- 172.21.15.182:0/3937799621 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f490415c250 msgr2=0x7f49040ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:14.706 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490259c700 1 --2- 172.21.15.182:0/3937799621 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f490415c250 0x7f49040ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.706 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490259c700 1 -- 172.21.15.182:0/3937799621 >> v1:172.21.15.79:6789/0 conn(0x7f49040cd040 legacy=0x7f49040d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.707 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490259c700 1 -- 172.21.15.182:0/3937799621 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040cddf0 con 0x7f490415be80 2022-12-01T09:45:14.707 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f4901d9b700 1 --2- 172.21.15.182:0/3937799621 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f490415c250 0x7f49040ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:14.707 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490259c700 1 --2- 172.21.15.182:0/3937799621 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 0x7f49040ce5f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009820 tx=0x7f48f4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aa60a9e0b6f3ed7 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:14.708 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490159a700 1 -- 172.21.15.182:0/3937799621 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4005e30 con 0x7f490415be80 2022-12-01T09:45:14.708 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490159a700 1 -- 172.21.15.182:0/3937799621 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4006030 con 0x7f490415be80 2022-12-01T09:45:14.709 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.692+0000 7f490159a700 1 -- 172.21.15.182:0/3937799621 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f40063c0 con 0x7f490415be80 2022-12-01T09:45:14.709 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.693+0000 7f4908e12700 1 -- 172.21.15.182:0/3937799621 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 msgr2=0x7f49040ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.710 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.693+0000 7f4908e12700 1 --2- 172.21.15.182:0/3937799621 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 0x7f49040ce5f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009820 tx=0x7f48f4009b30 comp rx=0 tx=0).stop 2022-12-01T09:45:14.710 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.693+0000 7f4908e12700 1 -- 172.21.15.182:0/3937799621 shutdown_connections 2022-12-01T09:45:14.710 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.693+0000 7f4908e12700 1 --2- 172.21.15.182:0/3937799621 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 0x7f49040ce5f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.711 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.693+0000 7f4908e12700 1 --2- 172.21.15.182:0/3937799621 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f490415c250 0x7f49040ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.711 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.693+0000 7f4908e12700 1 -- 172.21.15.182:0/3937799621 >> 172.21.15.182:0/3937799621 conn(0x7f49040713e0 msgr2=0x7f490409b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:14.712 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.693+0000 7f4908e12700 1 -- 172.21.15.182:0/3937799621 shutdown_connections 2022-12-01T09:45:14.712 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.693+0000 7f4908e12700 1 -- 172.21.15.182:0/3937799621 wait complete. 2022-12-01T09:45:14.713 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.694+0000 7f4908e12700 1 Processor -- start 2022-12-01T09:45:14.713 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.694+0000 7f4908e12700 1 -- start start 2022-12-01T09:45:14.713 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f4908e12700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f49040cd040 0x7f49040b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.714 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f4908e12700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 0x7f49041f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.714 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f4908e12700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f490415c250 0x7f49040b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.715 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f4908e12700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040b1910 con 0x7f490415c250 2022-12-01T09:45:14.715 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f4908e12700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040b1bf0 con 0x7f490415be80 2022-12-01T09:45:14.716 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f4908e12700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49040b1ed0 con 0x7f49040cd040 2022-12-01T09:45:14.716 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f490259c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f49040cd040 0x7f49040b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.717 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f4901d9b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 0x7f49041f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.717 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f490259c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f49040cd040 0x7f49040b7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55820/0 (socket says 172.21.15.182:55820) 2022-12-01T09:45:14.718 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f490259c700 1 -- 172.21.15.182:0/66797264 learned_addr learned my addr 172.21.15.182:0/66797264 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:14.718 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.695+0000 7f4902d9d700 1 --2- 172.21.15.182:0/66797264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f490415c250 0x7f49040b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.719 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f490259c700 1 -- 172.21.15.182:0/66797264 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 msgr2=0x7f49041f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.719 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f490259c700 1 --2- 172.21.15.182:0/66797264 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 0x7f49041f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.720 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f490259c700 1 -- 172.21.15.182:0/66797264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f490415c250 msgr2=0x7f49040b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.720 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f490259c700 1 --2- 172.21.15.182:0/66797264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f490415c250 0x7f49040b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.721 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f490259c700 1 -- 172.21.15.182:0/66797264 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f8009550 con 0x7f49040cd040 2022-12-01T09:45:14.721 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f4901d9b700 1 --2- 172.21.15.182:0/66797264 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 0x7f49041f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:14.721 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f490259c700 1 --2- 172.21.15.182:0/66797264 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f49040cd040 0x7f49040b7010 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009fd0 tx=0x7f48f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:14.722 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f48f2ffd700 1 -- 172.21.15.182:0/66797264 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f40063a0 con 0x7f49040cd040 2022-12-01T09:45:14.722 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f48f2ffd700 1 -- 172.21.15.182:0/66797264 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4006500 con 0x7f49040cd040 2022-12-01T09:45:14.723 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f4908e12700 1 -- 172.21.15.182:0/66797264 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f4009430 con 0x7f49040cd040 2022-12-01T09:45:14.723 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f48f2ffd700 1 -- 172.21.15.182:0/66797264 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4006890 con 0x7f49040cd040 2022-12-01T09:45:14.724 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f4908e12700 1 -- 172.21.15.182:0/66797264 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49040b2490 con 0x7f49040cd040 2022-12-01T09:45:14.724 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f48f2ffd700 1 -- 172.21.15.182:0/66797264 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f48f400f050 con 0x7f49040cd040 2022-12-01T09:45:14.724 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.696+0000 7f48f2ffd700 1 -- 172.21.15.182:0/66797264 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f48f401b850 con 0x7f49040cd040 2022-12-01T09:45:14.725 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.697+0000 7f4908e12700 1 -- 172.21.15.182:0/66797264 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49040d3360 con 0x7f49040cd040 2022-12-01T09:45:14.726 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.699+0000 7f48f2ffd700 1 -- 172.21.15.182:0/66797264 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f48f402a020 con 0x7f49040cd040 2022-12-01T09:45:14.747 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:14.743+0000 7fe18a763200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-12-01T09:45:14.756 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:14.751+0000 7fe708a16200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-12-01T09:45:14.786 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.782+0000 7f4908e12700 1 -- 172.21.15.182:0/66797264 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83191444-237f-49fc-9046-58c92f1d68f2", "id": 2} v 0) v1 -- 0x7f49040669f0 con 0x7f49040cd040 2022-12-01T09:45:14.794 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.790+0000 7f48f2ffd700 1 -- 172.21.15.182:0/66797264 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83191444-237f-49fc-9046-58c92f1d68f2", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48f401b540 con 0x7f49040cd040 2022-12-01T09:45:14.795 INFO:teuthology.orchestra.run.smithi182.stdout:2 2022-12-01T09:45:14.796 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.791+0000 7f4908e12700 1 -- 172.21.15.182:0/66797264 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f49040cd040 msgr2=0x7f49040b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.796 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.791+0000 7f4908e12700 1 --2- 172.21.15.182:0/66797264 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f49040cd040 0x7f49040b7010 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009fd0 tx=0x7f48f4004750 comp rx=0 tx=0).stop 2022-12-01T09:45:14.797 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.791+0000 7f4908e12700 1 -- 172.21.15.182:0/66797264 shutdown_connections 2022-12-01T09:45:14.797 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.791+0000 7f4908e12700 1 --2- 172.21.15.182:0/66797264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f490415c250 0x7f49040b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.797 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.791+0000 7f4908e12700 1 --2- 172.21.15.182:0/66797264 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f49040cd040 0x7f49040b7010 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.797 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.791+0000 7f4908e12700 1 --2- 172.21.15.182:0/66797264 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f490415be80 0x7f49041f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.798 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.791+0000 7f4908e12700 1 -- 172.21.15.182:0/66797264 >> 172.21.15.182:0/66797264 conn(0x7f49040713e0 msgr2=0x7f4904159370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:14.798 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.791+0000 7f4908e12700 1 -- 172.21.15.182:0/66797264 shutdown_connections 2022-12-01T09:45:14.798 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.791+0000 7f4908e12700 1 -- 172.21.15.182:0/66797264 wait complete. 2022-12-01T09:45:14.807 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new b5c70400-233c-43e1-9dc9-436eda906f14 3 2022-12-01T09:45:14.821 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:14.817+0000 7fe18a763200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-12-01T09:45:14.834 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:14.829+0000 7fe708a16200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-12-01T09:45:14.927 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.923+0000 7f3dacd4d700 1 Processor -- start 2022-12-01T09:45:14.928 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.923+0000 7f3dacd4d700 1 -- start start 2022-12-01T09:45:14.931 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3dacd4d700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.931 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3dacd4d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3da8070cc0 0x7f3da8071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.931 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3dacd4d700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da80ccb20 con 0x7f3da80ce300 2022-12-01T09:45:14.932 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3dacd4d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da8071680 con 0x7f3da8070cc0 2022-12-01T09:45:14.932 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3dacd4d700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80ceae0 con 0x7f3da8159ab0 2022-12-01T09:45:14.932 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da659c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.932 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da659c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55826/0 (socket says 172.21.15.182:55826) 2022-12-01T09:45:14.932 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da5d9b700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f3da80ce300 0x7f3da8069d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.182:44184/0 (socket says 172.21.15.182:44184) 2022-12-01T09:45:14.933 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da659c700 1 -- 172.21.15.182:0/3331003671 learned_addr learned my addr 172.21.15.182:0/3331003671 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:14.933 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da6d9d700 1 --2- 172.21.15.182:0/3331003671 >> v2:172.21.15.79:3300/0 conn(0x7f3da8070cc0 0x7f3da8071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.933 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da659c700 1 -- 172.21.15.182:0/3331003671 >> v2:172.21.15.79:3300/0 conn(0x7f3da8070cc0 msgr2=0x7f3da8071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:14.933 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da659c700 1 --2- 172.21.15.182:0/3331003671 >> v2:172.21.15.79:3300/0 conn(0x7f3da8070cc0 0x7f3da8071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.934 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da659c700 1 -- 172.21.15.182:0/3331003671 >> v1:172.21.15.182:6789/0 conn(0x7f3da80ce300 legacy=0x7f3da8069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.934 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da559a700 1 -- 172.21.15.182:0/3331003671 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561403548 0 0) 0x7f3d9c0011d0 con 0x7f3da80ce300 2022-12-01T09:45:14.934 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.924+0000 7f3da659c700 1 -- 172.21.15.182:0/3331003671 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80cedc0 con 0x7f3da8159ab0 2022-12-01T09:45:14.934 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3da659c700 1 --2- 172.21.15.182:0/3331003671 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80cc5e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d980098f0 tx=0x7f3d98009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=300c9f0759078341 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:14.935 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3da559a700 1 -- 172.21.15.182:0/3331003671 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98011830 con 0x7f3da8159ab0 2022-12-01T09:45:14.935 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3da559a700 1 -- 172.21.15.182:0/3331003671 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d98011990 con 0x7f3da8159ab0 2022-12-01T09:45:14.935 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3da559a700 1 -- 172.21.15.182:0/3331003671 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98011d20 con 0x7f3da8159ab0 2022-12-01T09:45:14.935 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3dacd4d700 1 -- 172.21.15.182:0/3331003671 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 msgr2=0x7f3da80cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.936 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3dacd4d700 1 --2- 172.21.15.182:0/3331003671 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80cc5e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d980098f0 tx=0x7f3d98009c00 comp rx=0 tx=0).stop 2022-12-01T09:45:14.936 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3dacd4d700 1 -- 172.21.15.182:0/3331003671 shutdown_connections 2022-12-01T09:45:14.936 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3dacd4d700 1 --2- 172.21.15.182:0/3331003671 >> v2:172.21.15.79:3300/0 conn(0x7f3da8070cc0 0x7f3da8071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.936 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3dacd4d700 1 --2- 172.21.15.182:0/3331003671 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80cc5e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.936 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.925+0000 7f3dacd4d700 1 -- 172.21.15.182:0/3331003671 >> 172.21.15.182:0/3331003671 conn(0x7f3da806c530 msgr2=0x7f3da806c930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:14.937 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.926+0000 7f3dacd4d700 1 -- 172.21.15.182:0/3331003671 shutdown_connections 2022-12-01T09:45:14.937 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.926+0000 7f3dacd4d700 1 -- 172.21.15.182:0/3331003671 wait complete. 2022-12-01T09:45:14.937 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.927+0000 7f3dacd4d700 1 Processor -- start 2022-12-01T09:45:14.937 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.927+0000 7f3dacd4d700 1 -- start start 2022-12-01T09:45:14.940 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3dacd4d700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3da8070cc0 0x7f3da8155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.940 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3dacd4d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da80ce300 0x7f3da80c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.941 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3dacd4d700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:14.941 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3dacd4d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80c4e70 con 0x7f3da80ce300 2022-12-01T09:45:14.941 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3dacd4d700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80c6260 con 0x7f3da8070cc0 2022-12-01T09:45:14.941 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3dacd4d700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80c4260 con 0x7f3da8159ab0 2022-12-01T09:45:14.941 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da659c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3da8070cc0 0x7f3da8155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.942 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da6d9d700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.942 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da659c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3da8070cc0 0x7f3da8155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:39444/0 (socket says 172.21.15.182:39444) 2022-12-01T09:45:14.942 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da659c700 1 -- 172.21.15.182:0/29959288 learned_addr learned my addr 172.21.15.182:0/29959288 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:14.942 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da5d9b700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da80ce300 0x7f3da80c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:14.942 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da659c700 1 -- 172.21.15.182:0/29959288 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 msgr2=0x7f3da80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.943 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da659c700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.943 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da659c700 1 -- 172.21.15.182:0/29959288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da80ce300 msgr2=0x7f3da80c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:14.943 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da659c700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da80ce300 0x7f3da80c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:14.943 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da659c700 1 -- 172.21.15.182:0/29959288 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98009550 con 0x7f3da8070cc0 2022-12-01T09:45:14.944 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da6d9d700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:14.944 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da5d9b700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da80ce300 0x7f3da80c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-12-01T09:45:14.944 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3da659c700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3da8070cc0 0x7f3da8155200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3da80717c0 tx=0x7f3d98004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:14.944 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3d96ffd700 1 -- 172.21.15.182:0/29959288 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98004510 con 0x7f3da8070cc0 2022-12-01T09:45:14.944 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3d96ffd700 1 -- 172.21.15.182:0/29959288 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d980036a0 con 0x7f3da8070cc0 2022-12-01T09:45:14.945 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3dacd4d700 1 -- 172.21.15.182:0/29959288 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da80c4540 con 0x7f3da8070cc0 2022-12-01T09:45:14.945 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3d96ffd700 1 -- 172.21.15.182:0/29959288 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98003a10 con 0x7f3da8070cc0 2022-12-01T09:45:14.945 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.928+0000 7f3dacd4d700 1 -- 172.21.15.182:0/29959288 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da80c4b00 con 0x7f3da8070cc0 2022-12-01T09:45:14.945 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.929+0000 7f3d96ffd700 1 -- 172.21.15.182:0/29959288 <== mon.1 v2:172.21.15.182:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f3d9802a030 con 0x7f3da8070cc0 2022-12-01T09:45:14.946 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.929+0000 7f3d96ffd700 1 -- 172.21.15.182:0/29959288 <== mon.1 v2:172.21.15.182:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f3d9802d440 con 0x7f3da8070cc0 2022-12-01T09:45:14.946 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.929+0000 7f3dacd4d700 1 -- 172.21.15.182:0/29959288 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da80669f0 con 0x7f3da8070cc0 2022-12-01T09:45:14.946 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:14.933+0000 7f3d96ffd700 1 -- 172.21.15.182:0/29959288 <== mon.1 v2:172.21.15.182:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f3d98032060 con 0x7f3da8070cc0 2022-12-01T09:45:14.947 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:14.936+0000 7fe18a763200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-12-01T09:45:14.965 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:14.961+0000 7fe708a16200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-12-01T09:45:15.019 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:15.015+0000 7fe18a763200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-12-01T09:45:15.019 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.015+0000 7f3dacd4d700 1 -- 172.21.15.182:0/29959288 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b5c70400-233c-43e1-9dc9-436eda906f14", "id": 3} v 0) v1 -- 0x7f3da80b4fd0 con 0x7f3da8070cc0 2022-12-01T09:45:15.027 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.023+0000 7f3d96ffd700 1 -- 172.21.15.182:0/29959288 <== mon.1 v2:172.21.15.182:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5c70400-233c-43e1-9dc9-436eda906f14", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3d98028070 con 0x7f3da8070cc0 2022-12-01T09:45:15.028 INFO:teuthology.orchestra.run.smithi182.stdout:3 2022-12-01T09:45:15.029 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.024+0000 7f3dacd4d700 1 -- 172.21.15.182:0/29959288 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3da8070cc0 msgr2=0x7f3da8155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.030 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.024+0000 7f3dacd4d700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3da8070cc0 0x7f3da8155200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3da80717c0 tx=0x7f3d98004750 comp rx=0 tx=0).stop 2022-12-01T09:45:15.030 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.024+0000 7f3dacd4d700 1 -- 172.21.15.182:0/29959288 shutdown_connections 2022-12-01T09:45:15.030 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.024+0000 7f3dacd4d700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f3da8159ab0 0x7f3da80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.030 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.024+0000 7f3dacd4d700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f3da8070cc0 0x7f3da8155200 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.031 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.024+0000 7f3dacd4d700 1 --2- 172.21.15.182:0/29959288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da80ce300 0x7f3da80c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.031 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.024+0000 7f3dacd4d700 1 -- 172.21.15.182:0/29959288 >> 172.21.15.182:0/29959288 conn(0x7f3da806c530 msgr2=0x7f3da8158790 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:15.031 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.024+0000 7f3dacd4d700 1 -- 172.21.15.182:0/29959288 shutdown_connections 2022-12-01T09:45:15.032 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.025+0000 7f3dacd4d700 1 -- 172.21.15.182:0/29959288 wait complete. 2022-12-01T09:45:15.045 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new 9acb459b-66e7-4eb2-b2cf-19eac220adfc 4 2022-12-01T09:45:15.054 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:15.049+0000 7fe708a16200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-12-01T09:45:15.174 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.170+0000 7faa48194700 1 Processor -- start 2022-12-01T09:45:15.175 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.170+0000 7faa48194700 1 -- start start 2022-12-01T09:45:15.178 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa48194700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faa400ce510 0x7faa400cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.178 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa48194700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7faa400af2a0 0x7faa400acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.179 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa48194700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400d0040 con 0x7faa400aedb0 2022-12-01T09:45:15.179 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa48194700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa400cc610 con 0x7faa400ce510 2022-12-01T09:45:15.182 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa48194700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4015a0a0 con 0x7faa400af2a0 2022-12-01T09:45:15.182 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa46731700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7faa400af2a0 0x7faa400acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.183 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa46731700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7faa400af2a0 0x7faa400acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:39454/0 (socket says 172.21.15.182:39454) 2022-12-01T09:45:15.183 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa46731700 1 -- 172.21.15.182:0/90985226 learned_addr learned my addr 172.21.15.182:0/90985226 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:15.184 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa4572f700 1 --2- 172.21.15.182:0/90985226 >> v2:172.21.15.79:3300/0 conn(0x7faa400ce510 0x7faa400cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.184 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa46731700 1 -- 172.21.15.182:0/90985226 >> v2:172.21.15.79:3300/0 conn(0x7faa400ce510 msgr2=0x7faa400cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:15.184 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa46731700 1 --2- 172.21.15.182:0/90985226 >> v2:172.21.15.79:3300/0 conn(0x7faa400ce510 0x7faa400cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.185 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa46731700 1 -- 172.21.15.182:0/90985226 >> v1:172.21.15.79:6789/0 conn(0x7faa400aedb0 legacy=0x7faa400cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.185 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.171+0000 7faa46731700 1 -- 172.21.15.182:0/90985226 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400cb990 con 0x7faa400af2a0 2022-12-01T09:45:15.186 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa46731700 1 --2- 172.21.15.182:0/90985226 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa400af2a0 0x7faa400acef0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faa400c7290 tx=0x7faa3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=715e5f49900be447 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:15.186 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa44f2e700 1 -- 172.21.15.182:0/90985226 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800e070 con 0x7faa400af2a0 2022-12-01T09:45:15.186 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa44f2e700 1 -- 172.21.15.182:0/90985226 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3800b910 con 0x7faa400af2a0 2022-12-01T09:45:15.187 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa44f2e700 1 -- 172.21.15.182:0/90985226 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800bcc0 con 0x7faa400af2a0 2022-12-01T09:45:15.187 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa48194700 1 -- 172.21.15.182:0/90985226 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa400af2a0 msgr2=0x7faa400acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.188 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa48194700 1 --2- 172.21.15.182:0/90985226 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa400af2a0 0x7faa400acef0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faa400c7290 tx=0x7faa3800b330 comp rx=0 tx=0).stop 2022-12-01T09:45:15.188 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa48194700 1 -- 172.21.15.182:0/90985226 shutdown_connections 2022-12-01T09:45:15.188 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa48194700 1 --2- 172.21.15.182:0/90985226 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa400af2a0 0x7faa400acef0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.189 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa48194700 1 --2- 172.21.15.182:0/90985226 >> v2:172.21.15.79:3300/0 conn(0x7faa400ce510 0x7faa400cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.189 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa48194700 1 -- 172.21.15.182:0/90985226 >> 172.21.15.182:0/90985226 conn(0x7faa4008a000 msgr2=0x7faa400d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:15.189 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.172+0000 7faa48194700 1 -- 172.21.15.182:0/90985226 shutdown_connections 2022-12-01T09:45:15.189 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.173+0000 7faa48194700 1 -- 172.21.15.182:0/90985226 wait complete. 2022-12-01T09:45:15.192 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.174+0000 7faa48194700 1 Processor -- start 2022-12-01T09:45:15.193 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.174+0000 7faa48194700 1 -- start start 2022-12-01T09:45:15.193 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa48194700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa400aedb0 0x7faa400b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.193 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa48194700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa400af2a0 0x7faa4014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.193 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa48194700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa400ce510 0x7faa4015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.194 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa48194700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400c67b0 con 0x7faa400ce510 2022-12-01T09:45:15.194 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa48194700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400c5b30 con 0x7faa400aedb0 2022-12-01T09:45:15.194 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa48194700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400c5e10 con 0x7faa400af2a0 2022-12-01T09:45:15.194 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa4572f700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa400af2a0 0x7faa4014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.195 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa45f30700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa400aedb0 0x7faa400b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.195 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa4572f700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa400af2a0 0x7faa4014e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55846/0 (socket says 172.21.15.182:55846) 2022-12-01T09:45:15.195 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa4572f700 1 -- 172.21.15.182:0/491110847 learned_addr learned my addr 172.21.15.182:0/491110847 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:15.195 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.175+0000 7faa46731700 1 --2- 172.21.15.182:0/491110847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa400ce510 0x7faa4015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.196 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa4572f700 1 -- 172.21.15.182:0/491110847 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa400aedb0 msgr2=0x7faa400b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.196 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa4572f700 1 --2- 172.21.15.182:0/491110847 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa400aedb0 0x7faa400b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.196 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa4572f700 1 -- 172.21.15.182:0/491110847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa400ce510 msgr2=0x7faa4015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.196 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa4572f700 1 --2- 172.21.15.182:0/491110847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa400ce510 0x7faa4015c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.197 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa4572f700 1 -- 172.21.15.182:0/491110847 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38009b30 con 0x7faa400af2a0 2022-12-01T09:45:15.197 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa4572f700 1 --2- 172.21.15.182:0/491110847 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa400af2a0 0x7faa4014e640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faa3000e9b0 tx=0x7faa3000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:15.197 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa2e7fc700 1 -- 172.21.15.182:0/491110847 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000ee50 con 0x7faa400af2a0 2022-12-01T09:45:15.197 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa2e7fc700 1 -- 172.21.15.182:0/491110847 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3000c7f0 con 0x7faa400af2a0 2022-12-01T09:45:15.197 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa48194700 1 -- 172.21.15.182:0/491110847 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa400c60f0 con 0x7faa400af2a0 2022-12-01T09:45:15.198 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa2e7fc700 1 -- 172.21.15.182:0/491110847 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000cb60 con 0x7faa400af2a0 2022-12-01T09:45:15.198 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa48194700 1 -- 172.21.15.182:0/491110847 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4014eb80 con 0x7faa400af2a0 2022-12-01T09:45:15.198 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa2e7fc700 1 -- 172.21.15.182:0/491110847 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7faa30019030 con 0x7faa400af2a0 2022-12-01T09:45:15.198 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.176+0000 7faa2e7fc700 1 -- 172.21.15.182:0/491110847 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7faa30006610 con 0x7faa400af2a0 2022-12-01T09:45:15.199 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.177+0000 7faa48194700 1 -- 172.21.15.182:0/491110847 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa400c68f0 con 0x7faa400af2a0 2022-12-01T09:45:15.199 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.179+0000 7faa2e7fc700 1 -- 172.21.15.182:0/491110847 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7faa400c68f0 con 0x7faa400af2a0 2022-12-01T09:45:15.267 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.262+0000 7faa48194700 1 -- 172.21.15.182:0/491110847 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9acb459b-66e7-4eb2-b2cf-19eac220adfc", "id": 4} v 0) v1 -- 0x7faa400669f0 con 0x7faa400af2a0 2022-12-01T09:45:15.274 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.270+0000 7faa2e7fc700 1 -- 172.21.15.182:0/491110847 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9acb459b-66e7-4eb2-b2cf-19eac220adfc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa30021060 con 0x7faa400af2a0 2022-12-01T09:45:15.275 INFO:teuthology.orchestra.run.smithi182.stdout:4 2022-12-01T09:45:15.276 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.271+0000 7faa48194700 1 -- 172.21.15.182:0/491110847 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa400af2a0 msgr2=0x7faa4014e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.277 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.271+0000 7faa48194700 1 --2- 172.21.15.182:0/491110847 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa400af2a0 0x7faa4014e640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faa3000e9b0 tx=0x7faa3000ecc0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.277 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.271+0000 7faa48194700 1 -- 172.21.15.182:0/491110847 shutdown_connections 2022-12-01T09:45:15.277 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.271+0000 7faa48194700 1 --2- 172.21.15.182:0/491110847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa400ce510 0x7faa4015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.277 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.271+0000 7faa48194700 1 --2- 172.21.15.182:0/491110847 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7faa400aedb0 0x7faa400b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.277 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.271+0000 7faa48194700 1 --2- 172.21.15.182:0/491110847 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7faa400af2a0 0x7faa4014e640 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.278 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.271+0000 7faa48194700 1 -- 172.21.15.182:0/491110847 >> 172.21.15.182:0/491110847 conn(0x7faa4008a000 msgr2=0x7faa40159550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:15.278 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.271+0000 7faa48194700 1 -- 172.21.15.182:0/491110847 shutdown_connections 2022-12-01T09:45:15.278 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.271+0000 7faa48194700 1 -- 172.21.15.182:0/491110847 wait complete. 2022-12-01T09:45:15.287 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new dc64787f-8edc-4941-9746-94a17af0662b 5 2022-12-01T09:45:15.410 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.402+0000 7fc4f39ee700 1 Processor -- start 2022-12-01T09:45:15.410 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.402+0000 7fc4f39ee700 1 -- start start 2022-12-01T09:45:15.411 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.403+0000 7fc4f39ee700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.411 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.403+0000 7fc4f39ee700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc4ec06f9d0 0x7fc4ec06fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.412 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.403+0000 7fc4f39ee700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec06d1a0 con 0x7fc4ec06cad0 2022-12-01T09:45:15.412 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.403+0000 7fc4f39ee700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec070390 con 0x7fc4ec06f9d0 2022-12-01T09:45:15.412 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.403+0000 7fc4f39ee700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec069390 con 0x7fc4ec06a780 2022-12-01T09:45:15.412 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.403+0000 7fc4f0f89700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.412 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.403+0000 7fc4f1f8b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc4ec06f9d0 0x7fc4ec06fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.413 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.403+0000 7fc4f178a700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7fc4ec06cad0 0x7fc4ec069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.182:44206/0 (socket says 172.21.15.182:44206) 2022-12-01T09:45:15.413 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.403+0000 7fc4f178a700 1 -- 172.21.15.182:0/3941260605 learned_addr learned my addr 172.21.15.182:0/3941260605 (peer_addr_for_me v1:172.21.15.182:0/0) 2022-12-01T09:45:15.413 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4f0f89700 1 -- 172.21.15.182:0/3941260605 >> v2:172.21.15.182:3300/0 conn(0x7fc4ec06f9d0 msgr2=0x7fc4ec06fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:15.413 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4f0f89700 1 --2- 172.21.15.182:0/3941260605 >> v2:172.21.15.182:3300/0 conn(0x7fc4ec06f9d0 0x7fc4ec06fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.414 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4f0f89700 1 -- 172.21.15.182:0/3941260605 >> v1:172.21.15.182:6789/0 conn(0x7fc4ec06cad0 legacy=0x7fc4ec069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.414 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4dbfff700 1 -- 172.21.15.182:0/3941260605 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891267254 0 0) 0x7fc4ec06d1a0 con 0x7fc4ec06cad0 2022-12-01T09:45:15.414 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4f0f89700 1 -- 172.21.15.182:0/3941260605 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec06cea0 con 0x7fc4ec06a780 2022-12-01T09:45:15.414 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4f1f8b700 1 --2- 172.21.15.182:0/3941260605 >> v2:172.21.15.182:3300/0 conn(0x7fc4ec06f9d0 0x7fc4ec06fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:15.415 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4f0f89700 1 --2- 172.21.15.182:0/3941260605 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0cab40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009840 tx=0x7fc4dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e662ce46a8217255 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:15.415 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4dbfff700 1 -- 172.21.15.182:0/3941260605 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc011830 con 0x7fc4ec06a780 2022-12-01T09:45:15.416 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4dbfff700 1 -- 172.21.15.182:0/3941260605 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc011990 con 0x7fc4ec06a780 2022-12-01T09:45:15.416 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.404+0000 7fc4dbfff700 1 -- 172.21.15.182:0/3941260605 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc011d20 con 0x7fc4ec06a780 2022-12-01T09:45:15.416 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.405+0000 7fc4f39ee700 1 -- 172.21.15.182:0/3941260605 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 msgr2=0x7fc4ec0cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.416 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.405+0000 7fc4f39ee700 1 --2- 172.21.15.182:0/3941260605 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0cab40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009840 tx=0x7fc4dc009b50 comp rx=0 tx=0).stop 2022-12-01T09:45:15.417 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.405+0000 7fc4f39ee700 1 -- 172.21.15.182:0/3941260605 shutdown_connections 2022-12-01T09:45:15.417 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.405+0000 7fc4f39ee700 1 --2- 172.21.15.182:0/3941260605 >> v2:172.21.15.182:3300/0 conn(0x7fc4ec06f9d0 0x7fc4ec06fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.418 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.405+0000 7fc4f39ee700 1 --2- 172.21.15.182:0/3941260605 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0cab40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.418 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.405+0000 7fc4f39ee700 1 -- 172.21.15.182:0/3941260605 >> 172.21.15.182:0/3941260605 conn(0x7fc4ec0ce920 msgr2=0x7fc4ec0cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:15.419 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.405+0000 7fc4f39ee700 1 -- 172.21.15.182:0/3941260605 shutdown_connections 2022-12-01T09:45:15.419 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.405+0000 7fc4f39ee700 1 -- 172.21.15.182:0/3941260605 wait complete. 2022-12-01T09:45:15.419 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.406+0000 7fc4f39ee700 1 Processor -- start 2022-12-01T09:45:15.420 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.406+0000 7fc4f39ee700 1 -- start start 2022-12-01T09:45:15.426 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f39ee700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.426 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f39ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ec06cad0 0x7fc4ec1f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.427 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f39ee700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4ec06f9d0 0x7fc4ec15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.427 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f39ee700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec1f5590 con 0x7fc4ec06cad0 2022-12-01T09:45:15.428 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f39ee700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec1f5870 con 0x7fc4ec06f9d0 2022-12-01T09:45:15.428 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f39ee700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec1f5b50 con 0x7fc4ec06a780 2022-12-01T09:45:15.428 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f178a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.428 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f1f8b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4ec06f9d0 0x7fc4ec15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.428 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f178a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55856/0 (socket says 172.21.15.182:55856) 2022-12-01T09:45:15.429 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f1f8b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4ec06f9d0 0x7fc4ec15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:39472/0 (socket says 172.21.15.182:39472) 2022-12-01T09:45:15.429 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f178a700 1 -- 172.21.15.182:0/2161183156 learned_addr learned my addr 172.21.15.182:0/2161183156 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:15.429 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f0f89700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ec06cad0 0x7fc4ec1f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.429 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f178a700 1 -- 172.21.15.182:0/2161183156 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4ec06f9d0 msgr2=0x7fc4ec15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.430 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f178a700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4ec06f9d0 0x7fc4ec15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.430 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f178a700 1 -- 172.21.15.182:0/2161183156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ec06cad0 msgr2=0x7fc4ec1f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.430 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f178a700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ec06cad0 0x7fc4ec1f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.430 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f178a700 1 -- 172.21.15.182:0/2161183156 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e4009a70 con 0x7fc4ec06a780 2022-12-01T09:45:15.430 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f0f89700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ec06cad0 0x7fc4ec1f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:45:15.431 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f1f8b700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4ec06f9d0 0x7fc4ec15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:15.431 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f178a700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0b3e10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80011e0 tx=0x7fc4e800cae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:15.431 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4d9ffb700 1 -- 172.21.15.182:0/2161183156 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8004c80 con 0x7fc4ec06a780 2022-12-01T09:45:15.431 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4d9ffb700 1 -- 172.21.15.182:0/2161183156 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e8004e00 con 0x7fc4ec06a780 2022-12-01T09:45:15.432 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4d9ffb700 1 -- 172.21.15.182:0/2161183156 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8007310 con 0x7fc4ec06a780 2022-12-01T09:45:15.432 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.407+0000 7fc4f39ee700 1 -- 172.21.15.182:0/2161183156 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc0094a0 con 0x7fc4ec06a780 2022-12-01T09:45:15.432 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.408+0000 7fc4d9ffb700 1 -- 172.21.15.182:0/2161183156 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc4e801a020 con 0x7fc4ec06a780 2022-12-01T09:45:15.432 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.408+0000 7fc4f39ee700 1 -- 172.21.15.182:0/2161183156 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec1f1730 con 0x7fc4ec06a780 2022-12-01T09:45:15.432 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.408+0000 7fc4d9ffb700 1 -- 172.21.15.182:0/2161183156 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fc4e80075c0 con 0x7fc4ec06a780 2022-12-01T09:45:15.433 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.408+0000 7fc4f39ee700 1 -- 172.21.15.182:0/2161183156 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec1f1ca0 con 0x7fc4ec06a780 2022-12-01T09:45:15.433 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.410+0000 7fc4d9ffb700 1 -- 172.21.15.182:0/2161183156 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fc4ec1f1ca0 con 0x7fc4ec06a780 2022-12-01T09:45:15.456 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:15.452+0000 7fe18a763200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-12-01T09:45:15.498 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.493+0000 7fc4f39ee700 1 -- 172.21.15.182:0/2161183156 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dc64787f-8edc-4941-9746-94a17af0662b", "id": 5} v 0) v1 -- 0x7fc4ec0669f0 con 0x7fc4ec06a780 2022-12-01T09:45:15.500 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:15.496+0000 7fe708a16200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-12-01T09:45:15.508 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.500+0000 7fc4d9ffb700 1 -- 172.21.15.182:0/2161183156 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc64787f-8edc-4941-9746-94a17af0662b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc4e8013490 con 0x7fc4ec06a780 2022-12-01T09:45:15.509 INFO:teuthology.orchestra.run.smithi182.stdout:5 2022-12-01T09:45:15.511 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.501+0000 7fc4f39ee700 1 -- 172.21.15.182:0/2161183156 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 msgr2=0x7fc4ec0b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.511 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.501+0000 7fc4f39ee700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0b3e10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80011e0 tx=0x7fc4e800cae0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.512 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.501+0000 7fc4f39ee700 1 -- 172.21.15.182:0/2161183156 shutdown_connections 2022-12-01T09:45:15.513 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.501+0000 7fc4f39ee700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc4ec06f9d0 0x7fc4ec15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.513 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.501+0000 7fc4f39ee700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc4ec06a780 0x7fc4ec0b3e10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.514 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.501+0000 7fc4f39ee700 1 --2- 172.21.15.182:0/2161183156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4ec06cad0 0x7fc4ec1f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.514 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.501+0000 7fc4f39ee700 1 -- 172.21.15.182:0/2161183156 >> 172.21.15.182:0/2161183156 conn(0x7fc4ec0ce920 msgr2=0x7fc4ec0c9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:15.515 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.501+0000 7fc4f39ee700 1 -- 172.21.15.182:0/2161183156 shutdown_connections 2022-12-01T09:45:15.515 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.501+0000 7fc4f39ee700 1 -- 172.21.15.182:0/2161183156 wait complete. 2022-12-01T09:45:15.518 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new f0dee44e-bffd-4740-912f-94193d3fe5ef 6 2022-12-01T09:45:15.642 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.638+0000 7f479ecef700 1 Processor -- start 2022-12-01T09:45:15.642 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.638+0000 7f479ecef700 1 -- start start 2022-12-01T09:45:15.648 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.638+0000 7f479ecef700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980af260 0x7f47980cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.648 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.638+0000 7f479ecef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f47980cf780 0x7f47980cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.648 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.638+0000 7f479ecef700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47980ce6e0 con 0x7f47980b0a10 2022-12-01T09:45:15.649 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.638+0000 7f479ecef700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47980ce9c0 con 0x7f47980cf780 2022-12-01T09:45:15.649 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.638+0000 7f479ecef700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47980ceca0 con 0x7f47980af260 2022-12-01T09:45:15.649 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f479ca8b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980af260 0x7f47980cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.649 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f479ca8b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980af260 0x7f47980cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55862/0 (socket says 172.21.15.182:55862) 2022-12-01T09:45:15.650 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f479ca8b700 1 -- 172.21.15.182:0/405851460 learned_addr learned my addr 172.21.15.182:0/405851460 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:15.650 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f479d28c700 1 --2- 172.21.15.182:0/405851460 >> v2:172.21.15.79:3300/0 conn(0x7f47980cf780 0x7f47980cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.650 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f479ca8b700 1 -- 172.21.15.182:0/405851460 >> v2:172.21.15.79:3300/0 conn(0x7f47980cf780 msgr2=0x7f47980cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:15.650 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f479ca8b700 1 --2- 172.21.15.182:0/405851460 >> v2:172.21.15.79:3300/0 conn(0x7f47980cf780 0x7f47980cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.650 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f479ca8b700 1 -- 172.21.15.182:0/405851460 >> v1:172.21.15.79:6789/0 conn(0x7f47980b0a10 legacy=0x7f47980ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.651 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f479ca8b700 1 -- 172.21.15.182:0/405851460 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980cef80 con 0x7f47980af260 2022-12-01T09:45:15.651 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f479ca8b700 1 --2- 172.21.15.182:0/405851460 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980af260 0x7f47980cde00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f478c0098f0 tx=0x7f478c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53a7bd7e8475de79 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:15.651 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f47977fe700 1 -- 172.21.15.182:0/405851460 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00b8a0 con 0x7f47980af260 2022-12-01T09:45:15.651 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f47977fe700 1 -- 172.21.15.182:0/405851460 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00ba00 con 0x7f47980af260 2022-12-01T09:45:15.652 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.639+0000 7f47977fe700 1 -- 172.21.15.182:0/405851460 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00bd90 con 0x7f47980af260 2022-12-01T09:45:15.652 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.640+0000 7f479ecef700 1 -- 172.21.15.182:0/405851460 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980af260 msgr2=0x7f47980cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.652 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.640+0000 7f479ecef700 1 --2- 172.21.15.182:0/405851460 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980af260 0x7f47980cde00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f478c0098f0 tx=0x7f478c009c00 comp rx=0 tx=0).stop 2022-12-01T09:45:15.652 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.640+0000 7f479ecef700 1 -- 172.21.15.182:0/405851460 shutdown_connections 2022-12-01T09:45:15.652 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.640+0000 7f479ecef700 1 --2- 172.21.15.182:0/405851460 >> v2:172.21.15.79:3300/0 conn(0x7f47980cf780 0x7f47980cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.653 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.640+0000 7f479ecef700 1 --2- 172.21.15.182:0/405851460 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980af260 0x7f47980cde00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.653 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.640+0000 7f479ecef700 1 -- 172.21.15.182:0/405851460 >> 172.21.15.182:0/405851460 conn(0x7f479808a000 msgr2=0x7f47980d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:15.653 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.640+0000 7f479ecef700 1 -- 172.21.15.182:0/405851460 shutdown_connections 2022-12-01T09:45:15.653 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.640+0000 7f479ecef700 1 -- 172.21.15.182:0/405851460 wait complete. 2022-12-01T09:45:15.653 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.641+0000 7f479ecef700 1 Processor -- start 2022-12-01T09:45:15.654 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.641+0000 7f479ecef700 1 -- start start 2022-12-01T09:45:15.654 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479ecef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47980af260 0x7f47981f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.654 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479ecef700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980b0a10 0x7f47980cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.654 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479ecef700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47980cf780 0x7f47980ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.654 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479ecef700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47981f2260 con 0x7f47980af260 2022-12-01T09:45:15.655 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479ecef700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980cd330 con 0x7f47980cf780 2022-12-01T09:45:15.655 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479ecef700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47980c7fc0 con 0x7f47980b0a10 2022-12-01T09:45:15.655 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f4797fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980b0a10 0x7f47980cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.655 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479d28c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47980cf780 0x7f47980ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.656 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479ca8b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47980af260 0x7f47981f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.656 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f4797fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980b0a10 0x7f47980cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55870/0 (socket says 172.21.15.182:55870) 2022-12-01T09:45:15.656 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479d28c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47980cf780 0x7f47980ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.182:39484/0 (socket says 172.21.15.182:39484) 2022-12-01T09:45:15.656 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f4797fff700 1 -- 172.21.15.182:0/168279035 learned_addr learned my addr 172.21.15.182:0/168279035 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:15.656 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f479ca8b700 1 --2- 172.21.15.182:0/168279035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47980af260 0x7f47981f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.182:45120/0 (socket says 172.21.15.182:45120) 2022-12-01T09:45:15.657 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f4797fff700 1 -- 172.21.15.182:0/168279035 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47980cf780 msgr2=0x7f47980ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.657 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f4797fff700 1 --2- 172.21.15.182:0/168279035 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47980cf780 0x7f47980ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.657 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f4797fff700 1 -- 172.21.15.182:0/168279035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47980af260 msgr2=0x7f47981f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.657 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f4797fff700 1 --2- 172.21.15.182:0/168279035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47980af260 0x7f47981f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.657 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f4797fff700 1 -- 172.21.15.182:0/168279035 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009550 con 0x7f47980b0a10 2022-12-01T09:45:15.658 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.642+0000 7f4797fff700 1 --2- 172.21.15.182:0/168279035 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980b0a10 0x7f47980cc8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f478400c4e0 tx=0x7f478400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:15.658 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.643+0000 7f47957fa700 1 -- 172.21.15.182:0/168279035 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840052d0 con 0x7f47980b0a10 2022-12-01T09:45:15.659 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.643+0000 7f47957fa700 1 -- 172.21.15.182:0/168279035 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4784005430 con 0x7f47980b0a10 2022-12-01T09:45:15.659 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.643+0000 7f479ecef700 1 -- 172.21.15.182:0/168279035 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47981f19c0 con 0x7f47980b0a10 2022-12-01T09:45:15.659 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.643+0000 7f47957fa700 1 -- 172.21.15.182:0/168279035 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840038c0 con 0x7f47980b0a10 2022-12-01T09:45:15.659 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.643+0000 7f479ecef700 1 -- 172.21.15.182:0/168279035 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47981f1f80 con 0x7f47980b0a10 2022-12-01T09:45:15.660 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.643+0000 7f47957fa700 1 -- 172.21.15.182:0/168279035 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f4784019030 con 0x7f47980b0a10 2022-12-01T09:45:15.660 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.643+0000 7f47957fa700 1 -- 172.21.15.182:0/168279035 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f4784011db0 con 0x7f47980b0a10 2022-12-01T09:45:15.660 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.644+0000 7f479ecef700 1 -- 172.21.15.182:0/168279035 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47980669f0 con 0x7f47980b0a10 2022-12-01T09:45:15.661 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.646+0000 7f47957fa700 1 -- 172.21.15.182:0/168279035 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f4784017070 con 0x7f47980b0a10 2022-12-01T09:45:15.733 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.728+0000 7f479ecef700 1 -- 172.21.15.182:0/168279035 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0dee44e-bffd-4740-912f-94193d3fe5ef", "id": 6} v 0) v1 -- 0x7f47980ad8a0 con 0x7f47980b0a10 2022-12-01T09:45:15.740 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.736+0000 7f47957fa700 1 -- 172.21.15.182:0/168279035 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0dee44e-bffd-4740-912f-94193d3fe5ef", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4784003a20 con 0x7f47980b0a10 2022-12-01T09:45:15.741 INFO:teuthology.orchestra.run.smithi182.stdout:6 2022-12-01T09:45:15.743 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.737+0000 7f479ecef700 1 -- 172.21.15.182:0/168279035 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980b0a10 msgr2=0x7f47980cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.743 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.737+0000 7f479ecef700 1 --2- 172.21.15.182:0/168279035 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980b0a10 0x7f47980cc8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f478400c4e0 tx=0x7f478400c7f0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.744 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.737+0000 7f479ecef700 1 -- 172.21.15.182:0/168279035 shutdown_connections 2022-12-01T09:45:15.744 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.737+0000 7f479ecef700 1 --2- 172.21.15.182:0/168279035 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f47980cf780 0x7f47980ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.744 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.737+0000 7f479ecef700 1 --2- 172.21.15.182:0/168279035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47980af260 0x7f47981f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.745 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.737+0000 7f479ecef700 1 --2- 172.21.15.182:0/168279035 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47980b0a10 0x7f47980cc8b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.745 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.737+0000 7f479ecef700 1 -- 172.21.15.182:0/168279035 >> 172.21.15.182:0/168279035 conn(0x7f479808a000 msgr2=0x7f479815b880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:15.746 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.737+0000 7f479ecef700 1 -- 172.21.15.182:0/168279035 shutdown_connections 2022-12-01T09:45:15.746 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.737+0000 7f479ecef700 1 -- 172.21.15.182:0/168279035 wait complete. 2022-12-01T09:45:15.753 DEBUG:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd new dae7edb0-c2ae-45c2-8103-49ba8af5267e 7 2022-12-01T09:45:15.881 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.870+0000 7fcedddf1700 1 Processor -- start 2022-12-01T09:45:15.882 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.870+0000 7fcedddf1700 1 -- start start 2022-12-01T09:45:15.882 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fcedddf1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fced80af260 0x7fced80cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.882 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fcedddf1700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.883 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fcedddf1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80ce6e0 con 0x7fced80ad3a0 2022-12-01T09:45:15.883 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fcedddf1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced80ce9c0 con 0x7fced80af260 2022-12-01T09:45:15.883 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fcedddf1700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced80ceca0 con 0x7fced80b0a10 2022-12-01T09:45:15.883 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced6ffd700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.883 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced6ffd700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55876/0 (socket says 172.21.15.182:55876) 2022-12-01T09:45:15.884 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced6ffd700 1 -- 172.21.15.182:0/2093714891 learned_addr learned my addr 172.21.15.182:0/2093714891 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:15.884 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced77fe700 1 --2- 172.21.15.182:0/2093714891 >> v2:172.21.15.79:3300/0 conn(0x7fced80af260 0x7fced80cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.884 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced6ffd700 1 -- 172.21.15.182:0/2093714891 >> v2:172.21.15.79:3300/0 conn(0x7fced80af260 msgr2=0x7fced80cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:15.884 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced6ffd700 1 --2- 172.21.15.182:0/2093714891 >> v2:172.21.15.79:3300/0 conn(0x7fced80af260 0x7fced80cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.885 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced6ffd700 1 -- 172.21.15.182:0/2093714891 >> v1:172.21.15.79:6789/0 conn(0x7fced80ad3a0 legacy=0x7fced80cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.885 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced6ffd700 1 -- 172.21.15.182:0/2093714891 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80cef80 con 0x7fced80b0a10 2022-12-01T09:45:15.885 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced6ffd700 1 --2- 172.21.15.182:0/2093714891 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80ace60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098f0 tx=0x7fcecc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19cc25c6ec581ca3 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:15.885 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.871+0000 7fced67fc700 1 -- 172.21.15.182:0/2093714891 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00b8a0 con 0x7fced80b0a10 2022-12-01T09:45:15.885 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fced67fc700 1 -- 172.21.15.182:0/2093714891 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00ba00 con 0x7fced80b0a10 2022-12-01T09:45:15.886 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fced67fc700 1 -- 172.21.15.182:0/2093714891 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00bd90 con 0x7fced80b0a10 2022-12-01T09:45:15.886 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fcedddf1700 1 -- 172.21.15.182:0/2093714891 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 msgr2=0x7fced80ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.886 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fcedddf1700 1 --2- 172.21.15.182:0/2093714891 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80ace60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098f0 tx=0x7fcecc009c00 comp rx=0 tx=0).stop 2022-12-01T09:45:15.886 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fcedddf1700 1 -- 172.21.15.182:0/2093714891 shutdown_connections 2022-12-01T09:45:15.886 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fcedddf1700 1 --2- 172.21.15.182:0/2093714891 >> v2:172.21.15.79:3300/0 conn(0x7fced80af260 0x7fced80cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.887 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fcedddf1700 1 --2- 172.21.15.182:0/2093714891 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80ace60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.887 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fcedddf1700 1 -- 172.21.15.182:0/2093714891 >> 172.21.15.182:0/2093714891 conn(0x7fced808a000 msgr2=0x7fced80d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:15.887 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fcedddf1700 1 -- 172.21.15.182:0/2093714891 shutdown_connections 2022-12-01T09:45:15.887 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.872+0000 7fcedddf1700 1 -- 172.21.15.182:0/2093714891 wait complete. 2022-12-01T09:45:15.888 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.873+0000 7fcedddf1700 1 Processor -- start 2022-12-01T09:45:15.888 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.873+0000 7fcedddf1700 1 -- start start 2022-12-01T09:45:15.888 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fcedddf1700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fced80ad3a0 0x7fced8150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.888 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fcedddf1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fced80af260 0x7fced81e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.888 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fcedddf1700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:15.889 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fcedddf1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced80cd260 con 0x7fced80af260 2022-12-01T09:45:15.889 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fcedddf1700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8151330 con 0x7fced80ad3a0 2022-12-01T09:45:15.889 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fcedddf1700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced80c7eb0 con 0x7fced80b0a10 2022-12-01T09:45:15.889 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fced7fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.890 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fced77fe700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fced80ad3a0 0x7fced8150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.890 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fced7fff700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.182:55884/0 (socket says 172.21.15.182:55884) 2022-12-01T09:45:15.890 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fced7fff700 1 -- 172.21.15.182:0/2716485084 learned_addr learned my addr 172.21.15.182:0/2716485084 (peer_addr_for_me v2:172.21.15.182:0/0) 2022-12-01T09:45:15.890 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.874+0000 7fced6ffd700 1 --2- 172.21.15.182:0/2716485084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fced80af260 0x7fced81e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:15.890 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fced7fff700 1 -- 172.21.15.182:0/2716485084 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fced80ad3a0 msgr2=0x7fced8150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.891 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fced7fff700 1 --2- 172.21.15.182:0/2716485084 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fced80ad3a0 0x7fced8150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.891 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fced7fff700 1 -- 172.21.15.182:0/2716485084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fced80af260 msgr2=0x7fced81e31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:15.891 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fced7fff700 1 --2- 172.21.15.182:0/2716485084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fced80af260 0x7fced81e31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:15.891 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fced7fff700 1 -- 172.21.15.182:0/2716485084 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009550 con 0x7fced80b0a10 2022-12-01T09:45:15.892 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fced77fe700 1 --2- 172.21.15.182:0/2716485084 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fced80ad3a0 0x7fced8150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:15.892 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fced7fff700 1 --2- 172.21.15.182:0/2716485084 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80cc390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fced000cc80 tx=0x7fced000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:15.893 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fcebffff700 1 -- 172.21.15.182:0/2716485084 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0003c00 con 0x7fced80b0a10 2022-12-01T09:45:15.894 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fcebffff700 1 -- 172.21.15.182:0/2716485084 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0003d60 con 0x7fced80b0a10 2022-12-01T09:45:15.895 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fcedddf1700 1 -- 172.21.15.182:0/2716485084 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced80cb660 con 0x7fced80b0a10 2022-12-01T09:45:15.895 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fcebffff700 1 -- 172.21.15.182:0/2716485084 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000aaa0 con 0x7fced80b0a10 2022-12-01T09:45:15.895 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fcedddf1700 1 -- 172.21.15.182:0/2716485084 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced80cbc20 con 0x7fced80b0a10 2022-12-01T09:45:15.896 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fcebffff700 1 -- 172.21.15.182:0/2716485084 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fced0010050 con 0x7fced80b0a10 2022-12-01T09:45:15.896 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.875+0000 7fcebffff700 1 -- 172.21.15.182:0/2716485084 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fced0012a80 con 0x7fced80b0a10 2022-12-01T09:45:15.896 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.876+0000 7fcedddf1700 1 -- 172.21.15.182:0/2716485084 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced80c8070 con 0x7fced80b0a10 2022-12-01T09:45:15.897 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.878+0000 7fcebffff700 1 -- 172.21.15.182:0/2716485084 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fced0012ce0 con 0x7fced80b0a10 2022-12-01T09:45:15.995 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:15.991+0000 7fe18a763200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-12-01T09:45:15.997 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:15.993+0000 7fcedddf1700 1 -- 172.21.15.182:0/2716485084 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dae7edb0-c2ae-45c2-8103-49ba8af5267e", "id": 7} v 0) v1 -- 0x7fced80669f0 con 0x7fced80b0a10 2022-12-01T09:45:16.005 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.001+0000 7fcebffff700 1 -- 172.21.15.182:0/2716485084 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dae7edb0-c2ae-45c2-8103-49ba8af5267e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fced00050d0 con 0x7fced80b0a10 2022-12-01T09:45:16.006 INFO:teuthology.orchestra.run.smithi182.stdout:7 2022-12-01T09:45:16.007 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.002+0000 7fcedddf1700 1 -- 172.21.15.182:0/2716485084 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 msgr2=0x7fced80cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:16.008 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.002+0000 7fcedddf1700 1 --2- 172.21.15.182:0/2716485084 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80cc390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fced000cc80 tx=0x7fced000cf90 comp rx=0 tx=0).stop 2022-12-01T09:45:16.008 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.002+0000 7fcedddf1700 1 -- 172.21.15.182:0/2716485084 shutdown_connections 2022-12-01T09:45:16.008 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.002+0000 7fcedddf1700 1 --2- 172.21.15.182:0/2716485084 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fced80b0a10 0x7fced80cc390 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:16.008 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.002+0000 7fcedddf1700 1 --2- 172.21.15.182:0/2716485084 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fced80ad3a0 0x7fced8150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:16.009 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.002+0000 7fcedddf1700 1 --2- 172.21.15.182:0/2716485084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fced80af260 0x7fced81e31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:16.009 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.002+0000 7fcedddf1700 1 -- 172.21.15.182:0/2716485084 >> 172.21.15.182:0/2716485084 conn(0x7fced808a000 msgr2=0x7fced8151620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:16.009 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.002+0000 7fcedddf1700 1 -- 172.21.15.182:0/2716485084 shutdown_connections 2022-12-01T09:45:16.009 INFO:teuthology.orchestra.run.smithi182.stderr:2022-12-01T09:45:16.002+0000 7fcedddf1700 1 -- 172.21.15.182:0/2716485084 wait complete. 2022-12-01T09:45:16.018 INFO:tasks.ceph.osd.0:Restarting daemon 2022-12-01T09:45:16.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-12-01T09:45:16.021 INFO:tasks.ceph.osd.0:Started 2022-12-01T09:45:16.022 INFO:tasks.ceph.osd.1:Restarting daemon 2022-12-01T09:45:16.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-12-01T09:45:16.025 INFO:tasks.ceph.osd.1:Started 2022-12-01T09:45:16.026 INFO:tasks.ceph.osd.2:Restarting daemon 2022-12-01T09:45:16.026 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-12-01T09:45:16.029 INFO:tasks.ceph.osd.2:Started 2022-12-01T09:45:16.030 INFO:tasks.ceph.osd.3:Restarting daemon 2022-12-01T09:45:16.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-12-01T09:45:16.032 INFO:tasks.ceph.osd.3:Started 2022-12-01T09:45:16.033 INFO:tasks.ceph.osd.4:Restarting daemon 2022-12-01T09:45:16.033 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-12-01T09:45:16.036 INFO:tasks.ceph.osd.4:Started 2022-12-01T09:45:16.036 INFO:tasks.ceph.osd.5:Restarting daemon 2022-12-01T09:45:16.037 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-12-01T09:45:16.040 INFO:tasks.ceph.osd.5:Started 2022-12-01T09:45:16.042 INFO:tasks.ceph.osd.6:Restarting daemon 2022-12-01T09:45:16.043 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-12-01T09:45:16.048 INFO:tasks.ceph.osd.6:Started 2022-12-01T09:45:16.049 INFO:tasks.ceph.osd.7:Restarting daemon 2022-12-01T09:45:16.050 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-12-01T09:45:16.053 INFO:tasks.ceph.osd.7:Started 2022-12-01T09:45:16.054 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-12-01T09:45:16.097 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:16.092+0000 7fe708a16200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-12-01T09:45:16.172 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:16.168+0000 7fe18a763200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-12-01T09:45:16.204 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.200+0000 7f5efad5a700 1 Processor -- start 2022-12-01T09:45:16.204 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.200+0000 7f5efad5a700 1 -- start start 2022-12-01T09:45:16.206 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5efad5a700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f5ef40cbb20 0x7f5ef40cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:16.206 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5efad5a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef415b360 con 0x7f5ef40cdbd0 2022-12-01T09:45:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5efad5a700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef415aac0 con 0x7f5ef406f4c0 2022-12-01T09:45:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5efad5a700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef415ada0 con 0x7f5ef40cbb20 2022-12-01T09:45:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef8af6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5ef40cdbd0 0x7f5ef40cdfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39160/0 (socket says 172.21.15.79:39160) 2022-12-01T09:45:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef8af6700 1 -- 172.21.15.79:0/737927181 learned_addr learned my addr 172.21.15.79:0/737927181 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef92f7700 1 --2- 172.21.15.79:0/737927181 >> v2:172.21.15.182:3300/0 conn(0x7f5ef40cbb20 0x7f5ef40cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef37fe700 1 -- 172.21.15.79:0/737927181 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038528137 0 0) 0x7f5ef415b360 con 0x7f5ef40cdbd0 2022-12-01T09:45:16.209 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef37fe700 1 -- 172.21.15.79:0/737927181 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed80035b0 con 0x7f5ef40cdbd0 2022-12-01T09:45:16.209 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef92f7700 1 -- 172.21.15.79:0/737927181 >> v1:172.21.15.182:6789/0 conn(0x7f5ef406f4c0 legacy=0x7f5ef415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:16.209 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef37fe700 1 -- 172.21.15.79:0/737927181 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346401449 0 0) 0x7f5ed80035b0 con 0x7f5ef40cdbd0 2022-12-01T09:45:16.209 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef92f7700 1 -- 172.21.15.79:0/737927181 >> v1:172.21.15.79:6789/0 conn(0x7f5ef40cdbd0 legacy=0x7f5ef40cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:16.210 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef92f7700 1 -- 172.21.15.79:0/737927181 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef415b080 con 0x7f5ef40cbb20 2022-12-01T09:45:16.210 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.201+0000 7f5ef92f7700 1 --2- 172.21.15.79:0/737927181 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 0x7f5ef40cbf60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009d90 tx=0x7f5eec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81322f7106cad9bb server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:16.210 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5ef37fe700 1 -- 172.21.15.79:0/737927181 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00e070 con 0x7f5ef40cbb20 2022-12-01T09:45:16.210 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5ef37fe700 1 -- 172.21.15.79:0/737927181 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec003a20 con 0x7f5ef40cbb20 2022-12-01T09:45:16.211 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5ef37fe700 1 -- 172.21.15.79:0/737927181 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8001670 con 0x7f5ef40cbb20 2022-12-01T09:45:16.214 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5efad5a700 1 -- 172.21.15.79:0/737927181 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 msgr2=0x7f5ef40cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:16.215 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5efad5a700 1 --2- 172.21.15.79:0/737927181 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 0x7f5ef40cbf60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009d90 tx=0x7f5eec00b330 comp rx=0 tx=0).stop 2022-12-01T09:45:16.215 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5efad5a700 1 -- 172.21.15.79:0/737927181 shutdown_connections 2022-12-01T09:45:16.215 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5efad5a700 1 --2- 172.21.15.79:0/737927181 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 0x7f5ef40cbf60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:16.215 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5efad5a700 1 -- 172.21.15.79:0/737927181 >> 172.21.15.79:0/737927181 conn(0x7f5ef406d310 msgr2=0x7f5ef406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:16.216 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5efad5a700 1 -- 172.21.15.79:0/737927181 shutdown_connections 2022-12-01T09:45:16.216 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.202+0000 7f5efad5a700 1 -- 172.21.15.79:0/737927181 wait complete. 2022-12-01T09:45:16.216 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.203+0000 7f5efad5a700 1 Processor -- start 2022-12-01T09:45:16.216 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.203+0000 7f5efad5a700 1 -- start start 2022-12-01T09:45:16.216 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.204+0000 7f5efad5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ef406f4c0 0x7f5ef40b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:16.217 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.204+0000 7f5efad5a700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 0x7f5ef415d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:16.217 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.204+0000 7f5efad5a700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5ef40cdbd0 0x7f5ef40b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:16.217 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.204+0000 7f5efad5a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40b23f0 con 0x7f5ef406f4c0 2022-12-01T09:45:16.217 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.204+0000 7f5efad5a700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40b44a0 con 0x7f5ef40cbb20 2022-12-01T09:45:16.217 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.204+0000 7f5efad5a700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40b3bb0 con 0x7f5ef40cdbd0 2022-12-01T09:45:16.218 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.204+0000 7f5ef8af6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ef406f4c0 0x7f5ef40b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:16.218 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.204+0000 7f5ef8af6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ef406f4c0 0x7f5ef40b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47012/0 (socket says 172.21.15.79:47012) 2022-12-01T09:45:16.218 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.204+0000 7f5ef8af6700 1 -- 172.21.15.79:0/3946676874 learned_addr learned my addr 172.21.15.79:0/3946676874 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:16.218 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef92f7700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5ef40cdbd0 0x7f5ef40b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:16.219 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef3fff700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 0x7f5ef415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:16.219 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef8af6700 1 -- 172.21.15.79:0/3946676874 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5ef40cdbd0 msgr2=0x7f5ef40b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:16.219 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef8af6700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5ef40cdbd0 0x7f5ef40b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:16.219 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef8af6700 1 -- 172.21.15.79:0/3946676874 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 msgr2=0x7f5ef415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:16.219 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef8af6700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 0x7f5ef415d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:16.220 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef8af6700 1 -- 172.21.15.79:0/3946676874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec009a70 con 0x7f5ef406f4c0 2022-12-01T09:45:16.220 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef3fff700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 0x7f5ef415d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:45:16.220 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef8af6700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ef406f4c0 0x7f5ef40b4930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800c550 tx=0x7f5ee800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:16.220 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef17fa700 1 -- 172.21.15.79:0/3946676874 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8004c80 con 0x7f5ef406f4c0 2022-12-01T09:45:16.220 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef17fa700 1 -- 172.21.15.79:0/3946676874 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8004e20 con 0x7f5ef406f4c0 2022-12-01T09:45:16.221 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5efad5a700 1 -- 172.21.15.79:0/3946676874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef40b2110 con 0x7f5ef406f4c0 2022-12-01T09:45:16.221 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef17fa700 1 -- 172.21.15.79:0/3946676874 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8007310 con 0x7f5ef406f4c0 2022-12-01T09:45:16.221 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5efad5a700 1 -- 172.21.15.79:0/3946676874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef40b4130 con 0x7f5ef406f4c0 2022-12-01T09:45:16.221 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef17fa700 1 -- 172.21.15.79:0/3946676874 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f5ee801a020 con 0x7f5ef406f4c0 2022-12-01T09:45:16.222 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.205+0000 7f5ef17fa700 1 -- 172.21.15.79:0/3946676874 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f5ee8013a90 con 0x7f5ef406f4c0 2022-12-01T09:45:16.222 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.206+0000 7f5efad5a700 1 -- 172.21.15.79:0/3946676874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef406ef50 con 0x7f5ef406f4c0 2022-12-01T09:45:16.222 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.208+0000 7f5ef17fa700 1 -- 172.21.15.79:0/3946676874 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f5ee8013e20 con 0x7f5ef406f4c0 2022-12-01T09:45:16.273 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:16.269+0000 7fe708a16200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-12-01T09:45:16.281 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.278+0000 7f5efad5a700 1 -- 172.21.15.79:0/3946676874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ef406d0f0 con 0x7f5ef406f4c0 2022-12-01T09:45:16.283 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.278+0000 7f5ef17fa700 1 -- 172.21.15.79:0/3946676874 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7011 (secure 0 0 0) 0x7f5ee8007620 con 0x7f5ef406f4c0 2022-12-01T09:45:16.283 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:45:16.284 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":10,"fsid":"e7b489bb-0e60-496d-af31-008ef9057b43","created":"2022-12-01T09:45:13.521007+0000","modified":"2022-12-01T09:45:15.995963+0000","last_up_change":"0.000000","last_in_change":"2022-12-01T09:45:15.995963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"f65efd56-e00f-4915-a254-99ba3bad5ca4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"51034ab5-541d-48e6-957b-d23ba4bf28d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"83191444-237f-49fc-9046-58c92f1d68f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b5c70400-233c-43e1-9dc9-436eda906f14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9acb459b-66e7-4eb2-b2cf-19eac220adfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc64787f-8edc-4941-9746-94a17af0662b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f0dee44e-bffd-4740-912f-94193d3fe5ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dae7edb0-c2ae-45c2-8103-49ba8af5267e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:45:16.286 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.279+0000 7f5efad5a700 1 -- 172.21.15.79:0/3946676874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ef406f4c0 msgr2=0x7f5ef40b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:16.286 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.279+0000 7f5efad5a700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ef406f4c0 0x7f5ef40b4930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800c550 tx=0x7f5ee800c860 comp rx=0 tx=0).stop 2022-12-01T09:45:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.279+0000 7f5efad5a700 1 -- 172.21.15.79:0/3946676874 shutdown_connections 2022-12-01T09:45:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.279+0000 7f5efad5a700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5ef40cdbd0 0x7f5ef40b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.279+0000 7f5efad5a700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ef406f4c0 0x7f5ef40b4930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.279+0000 7f5efad5a700 1 --2- 172.21.15.79:0/3946676874 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5ef40cbb20 0x7f5ef415d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.279+0000 7f5efad5a700 1 -- 172.21.15.79:0/3946676874 >> 172.21.15.79:0/3946676874 conn(0x7f5ef406d310 msgr2=0x7f5ef40cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.279+0000 7f5efad5a700 1 -- 172.21.15.79:0/3946676874 shutdown_connections 2022-12-01T09:45:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:16.279+0000 7f5efad5a700 1 -- 172.21.15.79:0/3946676874 wait complete. 2022-12-01T09:45:16.295 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-12-01T09:45:16.296 INFO:tasks.ceph:Waiting for OSDs to come up 2022-12-01T09:45:16.638 INFO:tasks.ceph.osd.3.smithi079.stderr:2022-12-01T09:45:16.634+0000 7f0ac939a5c0 -1 Falling back to public interface 2022-12-01T09:45:16.643 INFO:tasks.ceph.osd.4.smithi182.stderr:2022-12-01T09:45:16.638+0000 7fa980c5d5c0 -1 Falling back to public interface 2022-12-01T09:45:16.646 INFO:tasks.ceph.osd.0.smithi079.stderr:2022-12-01T09:45:16.642+0000 7f9d5701b5c0 -1 Falling back to public interface 2022-12-01T09:45:16.647 INFO:tasks.ceph.osd.5.smithi182.stderr:2022-12-01T09:45:16.643+0000 7f145f9005c0 -1 Falling back to public interface 2022-12-01T09:45:16.657 INFO:tasks.ceph.osd.6.smithi182.stderr:2022-12-01T09:45:16.652+0000 7f16560075c0 -1 Falling back to public interface 2022-12-01T09:45:16.657 INFO:tasks.ceph.osd.2.smithi079.stderr:2022-12-01T09:45:16.653+0000 7fe6bdcb45c0 -1 Falling back to public interface 2022-12-01T09:45:16.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2022-12-01T09:45:16.663+0000 7f1d9024d5c0 -1 Falling back to public interface 2022-12-01T09:45:16.680 INFO:tasks.ceph.osd.7.smithi182.stderr:2022-12-01T09:45:16.675+0000 7f06ec26f5c0 -1 Falling back to public interface 2022-12-01T09:45:16.858 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:16.854+0000 7fe18a763200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-12-01T09:45:16.934 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:16.931+0000 7fe18a763200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-12-01T09:45:16.950 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:16.945+0000 7fe708a16200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-12-01T09:45:17.026 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:17.022+0000 7fe708a16200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-12-01T09:45:17.072 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:17.068+0000 7fe18a763200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-12-01T09:45:17.103 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-12-01T09:45:17.162 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:17.158+0000 7fe708a16200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-12-01T09:45:17.216 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.212+0000 7f382971b700 1 Processor -- start 2022-12-01T09:45:17.216 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.212+0000 7f382971b700 1 -- start start 2022-12-01T09:45:17.219 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.213+0000 7f382971b700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f382406a890 0x7f382415ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:17.220 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.213+0000 7f382971b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38240cb9a0 0x7f38240cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:17.220 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.213+0000 7f382971b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38240cc320 con 0x7f382415ba30 2022-12-01T09:45:17.220 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.213+0000 7f382971b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382406b020 con 0x7f38240cb9a0 2022-12-01T09:45:17.221 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.213+0000 7f382971b700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382406b300 con 0x7f382406a890 2022-12-01T09:45:17.221 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.213+0000 7f38237fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38240cb9a0 0x7f38240cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:17.221 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.213+0000 7f3822ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f382415ba30 0x7f382406e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39172/0 (socket says 172.21.15.79:39172) 2022-12-01T09:45:17.222 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.213+0000 7f3822ffd700 1 -- 172.21.15.79:0/824607017 learned_addr learned my addr 172.21.15.79:0/824607017 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:17.222 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.213+0000 7f38227fc700 1 --2- 172.21.15.79:0/824607017 >> v2:172.21.15.182:3300/0 conn(0x7f382406a890 0x7f382415ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:17.223 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f38237fe700 1 -- 172.21.15.79:0/824607017 >> v2:172.21.15.182:3300/0 conn(0x7f382406a890 msgr2=0x7f382415ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:17.224 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f38237fe700 1 --2- 172.21.15.79:0/824607017 >> v2:172.21.15.182:3300/0 conn(0x7f382406a890 0x7f382415ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:17.224 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f38237fe700 1 -- 172.21.15.79:0/824607017 >> v1:172.21.15.79:6789/0 conn(0x7f382415ba30 legacy=0x7f382406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:17.224 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f38237fe700 1 -- 172.21.15.79:0/824607017 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382415f7e0 con 0x7f38240cb9a0 2022-12-01T09:45:17.225 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f3821ffb700 1 -- 172.21.15.79:0/824607017 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031367254 0 0) 0x7f38240cc320 con 0x7f382415ba30 2022-12-01T09:45:17.225 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f38237fe700 1 --2- 172.21.15.79:0/824607017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 0x7f38240cbde0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f38240ce690 tx=0x7f381c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee22214f4ced15e2 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:17.226 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f3821ffb700 1 -- 172.21.15.79:0/824607017 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00e070 con 0x7f38240cb9a0 2022-12-01T09:45:17.226 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f3821ffb700 1 -- 172.21.15.79:0/824607017 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00bb20 con 0x7f38240cb9a0 2022-12-01T09:45:17.227 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f3821ffb700 1 -- 172.21.15.79:0/824607017 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c012430 con 0x7f38240cb9a0 2022-12-01T09:45:17.229 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f382971b700 1 -- 172.21.15.79:0/824607017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 msgr2=0x7f38240cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:17.229 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.214+0000 7f382971b700 1 --2- 172.21.15.79:0/824607017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 0x7f38240cbde0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f38240ce690 tx=0x7f381c00b330 comp rx=0 tx=0).stop 2022-12-01T09:45:17.230 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.215+0000 7f382971b700 1 -- 172.21.15.79:0/824607017 shutdown_connections 2022-12-01T09:45:17.230 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.215+0000 7f382971b700 1 --2- 172.21.15.79:0/824607017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 0x7f38240cbde0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:17.230 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.215+0000 7f382971b700 1 --2- 172.21.15.79:0/824607017 >> v2:172.21.15.182:3300/0 conn(0x7f382406a890 0x7f382415ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:17.230 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.215+0000 7f382971b700 1 -- 172.21.15.79:0/824607017 >> 172.21.15.79:0/824607017 conn(0x7f382406cef0 msgr2=0x7f38240b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:17.231 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.215+0000 7f382971b700 1 -- 172.21.15.79:0/824607017 shutdown_connections 2022-12-01T09:45:17.231 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.215+0000 7f382971b700 1 -- 172.21.15.79:0/824607017 wait complete. 2022-12-01T09:45:17.231 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.216+0000 7f382971b700 1 Processor -- start 2022-12-01T09:45:17.232 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.216+0000 7f382971b700 1 -- start start 2022-12-01T09:45:17.239 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f382971b700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f382406a890 0x7f382415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:17.240 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f382971b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 0x7f38240b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:17.240 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f382971b700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f382415ba30 0x7f382415e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:17.240 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f382971b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382415f450 con 0x7f38240cb9a0 2022-12-01T09:45:17.240 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f382971b700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382415ee90 con 0x7f382406a890 2022-12-01T09:45:17.241 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f382971b700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382415f170 con 0x7f382415ba30 2022-12-01T09:45:17.241 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38227fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 0x7f38240b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:17.241 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38227fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 0x7f38240b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47026/0 (socket says 172.21.15.79:47026) 2022-12-01T09:45:17.241 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38227fc700 1 -- 172.21.15.79:0/2691569254 learned_addr learned my addr 172.21.15.79:0/2691569254 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:17.242 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38237fe700 1 --2- 172.21.15.79:0/2691569254 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f382415ba30 0x7f382415e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:17.242 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f3822ffd700 1 --2- 172.21.15.79:0/2691569254 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f382406a890 0x7f382415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:17.242 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38227fc700 1 -- 172.21.15.79:0/2691569254 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f382415ba30 msgr2=0x7f382415e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:17.242 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38227fc700 1 --2- 172.21.15.79:0/2691569254 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f382415ba30 0x7f382415e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:17.242 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38227fc700 1 -- 172.21.15.79:0/2691569254 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f382406a890 msgr2=0x7f382415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:17.243 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38227fc700 1 --2- 172.21.15.79:0/2691569254 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f382406a890 0x7f382415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:17.243 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38227fc700 1 -- 172.21.15.79:0/2691569254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c009a70 con 0x7f38240cb9a0 2022-12-01T09:45:17.243 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f38227fc700 1 --2- 172.21.15.79:0/2691569254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 0x7f38240b4a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f381800e9b0 tx=0x7f381800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:17.244 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f380b7fe700 1 -- 172.21.15.79:0/2691569254 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818009710 con 0x7f38240cb9a0 2022-12-01T09:45:17.244 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f380b7fe700 1 -- 172.21.15.79:0/2691569254 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800ee50 con 0x7f38240cb9a0 2022-12-01T09:45:17.244 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f382971b700 1 -- 172.21.15.79:0/2691569254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38241e6120 con 0x7f38240cb9a0 2022-12-01T09:45:17.244 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f380b7fe700 1 -- 172.21.15.79:0/2691569254 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800ca50 con 0x7f38240cb9a0 2022-12-01T09:45:17.244 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.217+0000 7f382971b700 1 -- 172.21.15.79:0/2691569254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38240b4f40 con 0x7f38240cb9a0 2022-12-01T09:45:17.245 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.218+0000 7f380b7fe700 1 -- 172.21.15.79:0/2691569254 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f3818019030 con 0x7f38240cb9a0 2022-12-01T09:45:17.245 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.218+0000 7f380b7fe700 1 -- 172.21.15.79:0/2691569254 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f3818006880 con 0x7f38240cb9a0 2022-12-01T09:45:17.245 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.218+0000 7f382971b700 1 -- 172.21.15.79:0/2691569254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38240669f0 con 0x7f38240cb9a0 2022-12-01T09:45:17.245 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.220+0000 7f380b7fe700 1 -- 172.21.15.79:0/2691569254 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f3818021060 con 0x7f38240cb9a0 2022-12-01T09:45:17.246 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:17.232+0000 7fe18a763200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-12-01T09:45:17.293 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.290+0000 7f382971b700 1 -- 172.21.15.79:0/2691569254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f382415fac0 con 0x7f38240cb9a0 2022-12-01T09:45:17.294 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.290+0000 7f380b7fe700 1 -- 172.21.15.79:0/2691569254 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7011 (secure 0 0 0) 0x7f3818017070 con 0x7f38240cb9a0 2022-12-01T09:45:17.295 INFO:teuthology.misc.health.smithi079.stdout: 2022-12-01T09:45:17.295 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":10,"fsid":"e7b489bb-0e60-496d-af31-008ef9057b43","created":"2022-12-01T09:45:13.521007+0000","modified":"2022-12-01T09:45:15.995963+0000","last_up_change":"0.000000","last_in_change":"2022-12-01T09:45:15.995963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"f65efd56-e00f-4915-a254-99ba3bad5ca4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"51034ab5-541d-48e6-957b-d23ba4bf28d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"83191444-237f-49fc-9046-58c92f1d68f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b5c70400-233c-43e1-9dc9-436eda906f14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9acb459b-66e7-4eb2-b2cf-19eac220adfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dc64787f-8edc-4941-9746-94a17af0662b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f0dee44e-bffd-4740-912f-94193d3fe5ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dae7edb0-c2ae-45c2-8103-49ba8af5267e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:45:17.296 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.291+0000 7f382971b700 1 -- 172.21.15.79:0/2691569254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 msgr2=0x7f38240b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:17.297 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.291+0000 7f382971b700 1 --2- 172.21.15.79:0/2691569254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 0x7f38240b4a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f381800e9b0 tx=0x7f381800ecc0 comp rx=0 tx=0).stop 2022-12-01T09:45:17.297 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.291+0000 7f382971b700 1 -- 172.21.15.79:0/2691569254 shutdown_connections 2022-12-01T09:45:17.297 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.291+0000 7f382971b700 1 --2- 172.21.15.79:0/2691569254 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f382415ba30 0x7f382415e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:17.297 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.291+0000 7f382971b700 1 --2- 172.21.15.79:0/2691569254 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f382406a890 0x7f382415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:17.297 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.291+0000 7f382971b700 1 --2- 172.21.15.79:0/2691569254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38240cb9a0 0x7f38240b4a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:17.298 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.291+0000 7f382971b700 1 -- 172.21.15.79:0/2691569254 >> 172.21.15.79:0/2691569254 conn(0x7f382406cef0 msgr2=0x7f38240b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:17.298 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.291+0000 7f382971b700 1 -- 172.21.15.79:0/2691569254 shutdown_connections 2022-12-01T09:45:17.298 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:17.291+0000 7f382971b700 1 -- 172.21.15.79:0/2691569254 wait complete. 2022-12-01T09:45:17.308 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-12-01T09:45:17.322 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:17.317+0000 7fe708a16200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-12-01T09:45:17.369 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:17.365+0000 7fe18a763200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-12-01T09:45:17.451 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:17.446+0000 7fe708a16200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-12-01T09:45:17.715 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:17.711+0000 7fe18a763200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-12-01T09:45:17.803 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:17.799+0000 7fe708a16200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-12-01T09:45:17.871 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:17.864+0000 7fe18a763200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-12-01T09:45:17.954 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:17.950+0000 7fe708a16200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-12-01T09:45:17.981 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:17.977+0000 7fe18a763200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-12-01T09:45:18.069 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:18.065+0000 7fe708a16200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-12-01T09:45:18.125 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:18.121+0000 7fe18a763200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-12-01T09:45:18.211 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:18.207+0000 7fe708a16200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-12-01T09:45:18.223 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:18.220+0000 7fe18a763200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-12-01T09:45:18.309 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:18.305+0000 7fe708a16200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-12-01T09:45:18.578 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:18.574+0000 7fe18a763200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-12-01T09:45:18.665 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:18.661+0000 7fe708a16200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-12-01T09:45:19.164 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:19.160+0000 7fe18a763200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-12-01T09:45:19.248 INFO:tasks.ceph.mgr.x.smithi182.stderr:2022-12-01T09:45:19.243+0000 7fe708a16200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-12-01T09:45:20.173 INFO:tasks.ceph.osd.5.smithi182.stderr:2022-12-01T09:45:20.169+0000 7f145f9005c0 -1 osd.5 0 log_to_monitors true 2022-12-01T09:45:20.189 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:20.185+0000 7fe142b15700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-12-01T09:45:20.193 INFO:tasks.ceph.mgr.y.smithi079.stderr:2022-12-01T09:45:20.189+0000 7fe142b15700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-12-01T09:45:20.199 INFO:tasks.ceph.osd.3.smithi079.stderr:2022-12-01T09:45:20.195+0000 7f0ac939a5c0 -1 osd.3 0 log_to_monitors true 2022-12-01T09:45:20.211 INFO:tasks.ceph.osd.2.smithi079.stderr:2022-12-01T09:45:20.207+0000 7fe6bdcb45c0 -1 osd.2 0 log_to_monitors true 2022-12-01T09:45:20.216 INFO:tasks.ceph.osd.4.smithi182.stderr:2022-12-01T09:45:20.212+0000 7fa980c5d5c0 -1 osd.4 0 log_to_monitors true 2022-12-01T09:45:20.223 INFO:tasks.ceph.osd.0.smithi079.stderr:2022-12-01T09:45:20.219+0000 7f9d5701b5c0 -1 osd.0 0 log_to_monitors true 2022-12-01T09:45:20.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2022-12-01T09:45:20.221+0000 7f1d9024d5c0 -1 osd.1 0 log_to_monitors true 2022-12-01T09:45:20.226 INFO:tasks.ceph.osd.6.smithi182.stderr:2022-12-01T09:45:20.222+0000 7f16560075c0 -1 osd.6 0 log_to_monitors true 2022-12-01T09:45:20.248 INFO:tasks.ceph.osd.7.smithi182.stderr:2022-12-01T09:45:20.243+0000 7f06ec26f5c0 -1 osd.7 0 log_to_monitors true 2022-12-01T09:45:23.305 INFO:tasks.ceph.osd.7.smithi182.stderr:2022-12-01T09:45:23.301+0000 7f06dfe26700 -1 osd.7 0 waiting for initial osdmap 2022-12-01T09:45:23.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2022-12-01T09:45:23.304+0000 7f1d83e04700 -1 osd.1 0 waiting for initial osdmap 2022-12-01T09:45:23.317 INFO:tasks.ceph.osd.0.smithi079.stderr:2022-12-01T09:45:23.313+0000 7f9d4abd2700 -1 osd.0 0 waiting for initial osdmap 2022-12-01T09:45:23.319 INFO:tasks.ceph.osd.3.smithi079.stderr:2022-12-01T09:45:23.316+0000 7f0abcf51700 -1 osd.3 0 waiting for initial osdmap 2022-12-01T09:45:23.327 INFO:tasks.ceph.osd.5.smithi182.stderr:2022-12-01T09:45:23.321+0000 7f14534b7700 -1 osd.5 0 waiting for initial osdmap 2022-12-01T09:45:23.327 INFO:tasks.ceph.osd.7.smithi182.stderr:2022-12-01T09:45:23.321+0000 7f06d8201700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:45:23.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2022-12-01T09:45:23.325+0000 7f1d7c1df700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:45:23.329 INFO:tasks.ceph.osd.3.smithi079.stderr:2022-12-01T09:45:23.325+0000 7f0ab532c700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:45:23.332 INFO:tasks.ceph.osd.0.smithi079.stderr:2022-12-01T09:45:23.329+0000 7f9d42fad700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:45:23.337 INFO:tasks.ceph.osd.4.smithi182.stderr:2022-12-01T09:45:23.333+0000 7fa974814700 -1 osd.4 0 waiting for initial osdmap 2022-12-01T09:45:23.341 INFO:tasks.ceph.osd.5.smithi182.stderr:2022-12-01T09:45:23.337+0000 7f144b892700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:45:23.350 INFO:tasks.ceph.osd.4.smithi182.stderr:2022-12-01T09:45:23.346+0000 7fa96cbef700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:45:23.353 INFO:tasks.ceph.osd.6.smithi182.stderr:2022-12-01T09:45:23.349+0000 7f1649bbe700 -1 osd.6 0 waiting for initial osdmap 2022-12-01T09:45:23.368 INFO:tasks.ceph.osd.6.smithi182.stderr:2022-12-01T09:45:23.364+0000 7f1641f99700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:45:23.388 INFO:tasks.ceph.osd.2.smithi079.stderr:2022-12-01T09:45:23.384+0000 7fe6b186b700 -1 osd.2 0 waiting for initial osdmap 2022-12-01T09:45:23.402 INFO:tasks.ceph.osd.2.smithi079.stderr:2022-12-01T09:45:23.398+0000 7fe6a9c46700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:45:24.117 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-12-01T09:45:24.251 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.237+0000 7f14a3073700 1 Processor -- start 2022-12-01T09:45:24.252 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.237+0000 7f14a3073700 1 -- start start 2022-12-01T09:45:24.252 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f14a3073700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f149c1598e0 0x7f149c06aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.253 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f14a3073700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f149c0c46d0 0x7f149c158d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.253 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f14a3073700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0cba10 0x7f149c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.253 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f14a3073700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c0c4e70 con 0x7f149c0c46d0 2022-12-01T09:45:24.253 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f14a3073700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c0ccde0 con 0x7f149c1598e0 2022-12-01T09:45:24.253 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f14a3073700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0cc3b0 con 0x7f149c0cba10 2022-12-01T09:45:24.254 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f149bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f149c0c46d0 0x7f149c158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.254 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f149bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f149c0c46d0 0x7f149c158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47128/0 (socket says 172.21.15.79:47128) 2022-12-01T09:45:24.254 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f149bfff700 1 -- 172.21.15.79:0/3841680639 learned_addr learned my addr 172.21.15.79:0/3841680639 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:24.254 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f14a1610700 1 --2- 172.21.15.79:0/3841680639 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0cba10 0x7f149c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.255 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f14a0e0f700 1 --2- 172.21.15.79:0/3841680639 >> v2:172.21.15.182:3300/0 conn(0x7f149c1598e0 0x7f149c06aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.255 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f149bfff700 1 -- 172.21.15.79:0/3841680639 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0cba10 msgr2=0x7f149c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:24.255 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f149bfff700 1 --2- 172.21.15.79:0/3841680639 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0cba10 0x7f149c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.255 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f149bfff700 1 -- 172.21.15.79:0/3841680639 >> v2:172.21.15.182:3300/0 conn(0x7f149c1598e0 msgr2=0x7f149c06aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:24.256 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f149bfff700 1 --2- 172.21.15.79:0/3841680639 >> v2:172.21.15.182:3300/0 conn(0x7f149c1598e0 0x7f149c06aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.256 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.238+0000 7f149bfff700 1 -- 172.21.15.79:0/3841680639 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c0cedd0 con 0x7f149c0c46d0 2022-12-01T09:45:24.256 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f149bfff700 1 --2- 172.21.15.79:0/3841680639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0c46d0 0x7f149c158d20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f149c0d0090 tx=0x7f1488009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5fcade8c8391ee server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:24.256 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f149b7fe700 1 -- 172.21.15.79:0/3841680639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800b870 con 0x7f149c0c46d0 2022-12-01T09:45:24.256 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f149b7fe700 1 -- 172.21.15.79:0/3841680639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800b9d0 con 0x7f149c0c46d0 2022-12-01T09:45:24.257 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f149b7fe700 1 -- 172.21.15.79:0/3841680639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800bd60 con 0x7f149c0c46d0 2022-12-01T09:45:24.257 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f14a3073700 1 -- 172.21.15.79:0/3841680639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0c46d0 msgr2=0x7f149c158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.257 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f14a3073700 1 --2- 172.21.15.79:0/3841680639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0c46d0 0x7f149c158d20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f149c0d0090 tx=0x7f1488009bd0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.257 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f14a3073700 1 -- 172.21.15.79:0/3841680639 shutdown_connections 2022-12-01T09:45:24.258 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f14a3073700 1 --2- 172.21.15.79:0/3841680639 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0cba10 0x7f149c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.258 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f14a3073700 1 --2- 172.21.15.79:0/3841680639 >> v2:172.21.15.182:3300/0 conn(0x7f149c1598e0 0x7f149c06aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.258 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f14a3073700 1 --2- 172.21.15.79:0/3841680639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0c46d0 0x7f149c158d20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.258 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f14a3073700 1 -- 172.21.15.79:0/3841680639 >> 172.21.15.79:0/3841680639 conn(0x7f149c06cef0 msgr2=0x7f149c0b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:24.259 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f14a3073700 1 -- 172.21.15.79:0/3841680639 shutdown_connections 2022-12-01T09:45:24.259 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.239+0000 7f14a3073700 1 -- 172.21.15.79:0/3841680639 wait complete. 2022-12-01T09:45:24.259 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.241+0000 7f14a3073700 1 Processor -- start 2022-12-01T09:45:24.259 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.241+0000 7f14a3073700 1 -- start start 2022-12-01T09:45:24.259 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.241+0000 7f14a3073700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0c46d0 0x7f149c150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.260 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.241+0000 7f14a3073700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0cba10 0x7f149c0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.260 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.241+0000 7f14a3073700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f149c1598e0 0x7f149c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.260 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.241+0000 7f14a3073700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c150ca0 con 0x7f149c0cba10 2022-12-01T09:45:24.260 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.241+0000 7f14a3073700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0b24b0 con 0x7f149c1598e0 2022-12-01T09:45:24.261 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.241+0000 7f14a3073700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0c7720 con 0x7f149c0c46d0 2022-12-01T09:45:24.261 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f149bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0cba10 0x7f149c0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.261 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f149bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0cba10 0x7f149c0b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47136/0 (socket says 172.21.15.79:47136) 2022-12-01T09:45:24.261 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f149bfff700 1 -- 172.21.15.79:0/4202998215 learned_addr learned my addr 172.21.15.79:0/4202998215 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:24.261 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f14a0e0f700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0c46d0 0x7f149c150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.262 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f14a1610700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f149c1598e0 0x7f149c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.262 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f149bfff700 1 -- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0c46d0 msgr2=0x7f149c150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.262 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f149bfff700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0c46d0 0x7f149c150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.262 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f149bfff700 1 -- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f149c1598e0 msgr2=0x7f149c1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.263 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f149bfff700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f149c1598e0 0x7f149c1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.263 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f149bfff700 1 -- 172.21.15.79:0/4202998215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488009550 con 0x7f149c0cba10 2022-12-01T09:45:24.263 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f14a0e0f700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0c46d0 0x7f149c150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:45:24.263 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f14a1610700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f149c1598e0 0x7f149c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:45:24.264 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f149bfff700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0cba10 0x7f149c0b1f70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1488000c00 tx=0x7f1488004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:24.264 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f14997fa700 1 -- 172.21.15.79:0/4202998215 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488004520 con 0x7f149c0cba10 2022-12-01T09:45:24.264 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f14997fa700 1 -- 172.21.15.79:0/4202998215 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148801e070 con 0x7f149c0cba10 2022-12-01T09:45:24.264 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c0b2e90 con 0x7f149c0cba10 2022-12-01T09:45:24.265 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f14997fa700 1 -- 172.21.15.79:0/4202998215 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880038c0 con 0x7f149c0cba10 2022-12-01T09:45:24.265 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.242+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c0b3450 con 0x7f149c0cba10 2022-12-01T09:45:24.265 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.243+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c071510 con 0x7f149c0cba10 2022-12-01T09:45:24.265 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.244+0000 7f14997fa700 1 -- 172.21.15.79:0/4202998215 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f148800f050 con 0x7f149c0cba10 2022-12-01T09:45:24.265 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.244+0000 7f14997fa700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f1484066540 0x7f14840689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.266 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.244+0000 7f14997fa700 1 -- 172.21.15.79:0/4202998215 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f1488020070 con 0x7f149c0cba10 2022-12-01T09:45:24.266 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.244+0000 7f14a0e0f700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f1484066540 0x7f14840689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.266 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.244+0000 7f14a0e0f700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f1484066540 0x7f14840689f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14900099f0 tx=0x7f1490008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:24.267 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.248+0000 7f14997fa700 1 -- 172.21.15.79:0/4202998215 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f1488052350 con 0x7f149c0cba10 2022-12-01T09:45:24.442 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.438+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f149c0c7890 con 0x7f149c0cba10 2022-12-01T09:45:24.443 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.439+0000 7f14997fa700 1 -- 172.21.15.79:0/4202998215 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10490 (secure 0 0 0) 0x7f1488015090 con 0x7f149c0cba10 2022-12-01T09:45:24.444 INFO:teuthology.misc.health.smithi079.stdout: 2022-12-01T09:45:24.444 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":13,"fsid":"e7b489bb-0e60-496d-af31-008ef9057b43","created":"2022-12-01T09:45:13.521007+0000","modified":"2022-12-01T09:45:24.327099+0000","last_up_change":"2022-12-01T09:45:24.327099+0000","last_in_change":"2022-12-01T09:45:15.995963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"f65efd56-e00f-4915-a254-99ba3bad5ca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":101315},{"type":"v1","addr":"172.21.15.79:6809","nonce":101315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":101315},{"type":"v1","addr":"172.21.15.79:6811","nonce":101315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":101315},{"type":"v1","addr":"172.21.15.79:6815","nonce":101315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":101315},{"type":"v1","addr":"172.21.15.79:6813","nonce":101315}]},"public_addr":"172.21.15.79:6809/101315","cluster_addr":"172.21.15.79:6811/101315","heartbeat_back_addr":"172.21.15.79:6815/101315","heartbeat_front_addr":"172.21.15.79:6813/101315","state":["exists","up"]},{"osd":1,"uuid":"51034ab5-541d-48e6-957b-d23ba4bf28d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":101318},{"type":"v1","addr":"172.21.15.79:6825","nonce":101318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":101318},{"type":"v1","addr":"172.21.15.79:6827","nonce":101318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":101318},{"type":"v1","addr":"172.21.15.79:6831","nonce":101318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":101318},{"type":"v1","addr":"172.21.15.79:6829","nonce":101318}]},"public_addr":"172.21.15.79:6825/101318","cluster_addr":"172.21.15.79:6827/101318","heartbeat_back_addr":"172.21.15.79:6831/101318","heartbeat_front_addr":"172.21.15.79:6829/101318","state":["exists","up"]},{"osd":2,"uuid":"83191444-237f-49fc-9046-58c92f1d68f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":101319},{"type":"v1","addr":"172.21.15.79:6817","nonce":101319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":101319},{"type":"v1","addr":"172.21.15.79:6819","nonce":101319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":101319},{"type":"v1","addr":"172.21.15.79:6823","nonce":101319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":101319},{"type":"v1","addr":"172.21.15.79:6821","nonce":101319}]},"public_addr":"172.21.15.79:6817/101319","cluster_addr":"172.21.15.79:6819/101319","heartbeat_back_addr":"172.21.15.79:6823/101319","heartbeat_front_addr":"172.21.15.79:6821/101319","state":["exists","up"]},{"osd":3,"uuid":"b5c70400-233c-43e1-9dc9-436eda906f14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":101317},{"type":"v1","addr":"172.21.15.79:6801","nonce":101317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":101317},{"type":"v1","addr":"172.21.15.79:6803","nonce":101317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":101317},{"type":"v1","addr":"172.21.15.79:6807","nonce":101317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":101317},{"type":"v1","addr":"172.21.15.79:6805","nonce":101317}]},"public_addr":"172.21.15.79:6801/101317","cluster_addr":"172.21.15.79:6803/101317","heartbeat_back_addr":"172.21.15.79:6807/101317","heartbeat_front_addr":"172.21.15.79:6805/101317","state":["exists","up"]},{"osd":4,"uuid":"9acb459b-66e7-4eb2-b2cf-19eac220adfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":101591},{"type":"v1","addr":"172.21.15.182:6801","nonce":101591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":101591},{"type":"v1","addr":"172.21.15.182:6803","nonce":101591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":101591},{"type":"v1","addr":"172.21.15.182:6807","nonce":101591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":101591},{"type":"v1","addr":"172.21.15.182:6805","nonce":101591}]},"public_addr":"172.21.15.182:6801/101591","cluster_addr":"172.21.15.182:6803/101591","heartbeat_back_addr":"172.21.15.182:6807/101591","heartbeat_front_addr":"172.21.15.182:6805/101591","state":["exists","up"]},{"osd":5,"uuid":"dc64787f-8edc-4941-9746-94a17af0662b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":101592},{"type":"v1","addr":"172.21.15.182:6809","nonce":101592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":101592},{"type":"v1","addr":"172.21.15.182:6811","nonce":101592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":101592},{"type":"v1","addr":"172.21.15.182:6815","nonce":101592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":101592},{"type":"v1","addr":"172.21.15.182:6813","nonce":101592}]},"public_addr":"172.21.15.182:6809/101592","cluster_addr":"172.21.15.182:6811/101592","heartbeat_back_addr":"172.21.15.182:6815/101592","heartbeat_front_addr":"172.21.15.182:6813/101592","state":["exists","up"]},{"osd":6,"uuid":"f0dee44e-bffd-4740-912f-94193d3fe5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":101593},{"type":"v1","addr":"172.21.15.182:6817","nonce":101593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6818","nonce":101593},{"type":"v1","addr":"172.21.15.182:6819","nonce":101593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6822","nonce":101593},{"type":"v1","addr":"172.21.15.182:6823","nonce":101593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":101593},{"type":"v1","addr":"172.21.15.182:6821","nonce":101593}]},"public_addr":"172.21.15.182:6817/101593","cluster_addr":"172.21.15.182:6819/101593","heartbeat_back_addr":"172.21.15.182:6823/101593","heartbeat_front_addr":"172.21.15.182:6821/101593","state":["exists","up"]},{"osd":7,"uuid":"dae7edb0-c2ae-45c2-8103-49ba8af5267e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":101636},{"type":"v1","addr":"172.21.15.182:6825","nonce":101636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":101636},{"type":"v1","addr":"172.21.15.182:6827","nonce":101636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":101636},{"type":"v1","addr":"172.21.15.182:6831","nonce":101636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6828","nonce":101636},{"type":"v1","addr":"172.21.15.182:6829","nonce":101636}]},"public_addr":"172.21.15.182:6825/101636","cluster_addr":"172.21.15.182:6827/101636","heartbeat_back_addr":"172.21.15.182:6831/101636","heartbeat_front_addr":"172.21.15.182:6829/101636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:45:24.446 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f1484066540 msgr2=0x7f14840689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.446 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f1484066540 0x7f14840689f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14900099f0 tx=0x7f1490008040 comp rx=0 tx=0).stop 2022-12-01T09:45:24.447 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0cba10 msgr2=0x7f149c0b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.447 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0cba10 0x7f149c0b1f70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1488000c00 tx=0x7f1488004750 comp rx=0 tx=0).stop 2022-12-01T09:45:24.447 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 shutdown_connections 2022-12-01T09:45:24.448 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f1484066540 0x7f14840689f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.448 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f149c1598e0 0x7f149c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.448 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f149c0c46d0 0x7f149c150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.448 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 --2- 172.21.15.79:0/4202998215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f149c0cba10 0x7f149c0b1f70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.449 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 >> 172.21.15.79:0/4202998215 conn(0x7f149c06cef0 msgr2=0x7f149c0ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:24.449 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 shutdown_connections 2022-12-01T09:45:24.449 INFO:teuthology.misc.health.smithi079.stderr:2022-12-01T09:45:24.441+0000 7f14a3073700 1 -- 172.21.15.79:0/4202998215 wait complete. 2022-12-01T09:45:24.458 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-12-01T09:45:24.458 INFO:tasks.ceph:Creating RBD pool 2022-12-01T09:45:24.459 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool create rbd 8 2022-12-01T09:45:24.580 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.576+0000 7fc3d23be700 1 Processor -- start 2022-12-01T09:45:24.580 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.576+0000 7fc3d23be700 1 -- start start 2022-12-01T09:45:24.587 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.577+0000 7fc3d23be700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc3cc0af2a0 0x7fc3cc0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.588 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.577+0000 7fc3d23be700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc0d0040 con 0x7fc3cc0ce510 2022-12-01T09:45:24.588 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.577+0000 7fc3d23be700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc0cb990 con 0x7fc3cc0aedb0 2022-12-01T09:45:24.588 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.577+0000 7fc3d23be700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc0cc610 con 0x7fc3cc0af2a0 2022-12-01T09:45:24.589 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.577+0000 7fc3cb7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc3cc0ce510 0x7fc3cc0acef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39412/0 (socket says 172.21.15.79:39412) 2022-12-01T09:45:24.589 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.577+0000 7fc3cb7fe700 1 -- 172.21.15.79:0/3154047603 learned_addr learned my addr 172.21.15.79:0/3154047603 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:24.589 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.577+0000 7fc3d095b700 1 --2- 172.21.15.79:0/3154047603 >> v2:172.21.15.182:3300/0 conn(0x7fc3cc0af2a0 0x7fc3cc0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.590 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.577+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347117345 0 0) 0x7fc3cc0d0040 con 0x7fc3cc0ce510 2022-12-01T09:45:24.590 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.577+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b80035b0 con 0x7fc3cc0ce510 2022-12-01T09:45:24.590 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1691283463 0 0) 0x7fc3b80035b0 con 0x7fc3cc0ce510 2022-12-01T09:45:24.590 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 >> v2:172.21.15.182:3300/0 conn(0x7fc3cc0af2a0 msgr2=0x7fc3cc0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:24.590 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 --2- 172.21.15.79:0/3154047603 >> v2:172.21.15.182:3300/0 conn(0x7fc3cc0af2a0 0x7fc3cc0cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.591 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 >> v1:172.21.15.182:6789/0 conn(0x7fc3cc0aedb0 legacy=0x7fc3cc0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.591 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc0cbc70 con 0x7fc3cc0ce510 2022-12-01T09:45:24.591 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 805749679 0 0) 0x7fc3bc001670 con 0x7fc3cc0ce510 2022-12-01T09:45:24.591 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 >> v1:172.21.15.79:6789/0 conn(0x7fc3cc0ce510 legacy=0x7fc3cc0acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3b8003a00 0x7fc3b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b8004850 0x7fc3b8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8005320 0x7fc3b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc0cc610 con 0x7fc3b8004850 2022-12-01T09:45:24.592 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b800c250 con 0x7fc3b8003a00 2022-12-01T09:45:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b800c410 con 0x7fc3b8005320 2022-12-01T09:45:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3cb7fe700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b8004850 0x7fc3b8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3cbfff700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3b8003a00 0x7fc3b8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.593 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3d095b700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8005320 0x7fc3b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.594 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3cb7fe700 1 -- 172.21.15.79:0/3154047603 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8005320 msgr2=0x7fc3b800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3cb7fe700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8005320 0x7fc3b800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3cb7fe700 1 -- 172.21.15.79:0/3154047603 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3b8003a00 msgr2=0x7fc3b8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3cb7fe700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3b8003a00 0x7fc3b8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.595 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3cb7fe700 1 -- 172.21.15.79:0/3154047603 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b80035b0 con 0x7fc3b8004850 2022-12-01T09:45:24.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3d095b700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8005320 0x7fc3b800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:45:24.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3d095b700 1 -- 172.21.15.79:0/3154047603 reap_dead start 2022-12-01T09:45:24.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3cb7fe700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b8004850 0x7fc3b8004cc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0ce900 tx=0x7fc3b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c63d5308af432c3 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:24.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc00cdd0 con 0x7fc3b8004850 2022-12-01T09:45:24.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc005960 con 0x7fc3b8004850 2022-12-01T09:45:24.597 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.578+0000 7fc3caffd700 1 -- 172.21.15.79:0/3154047603 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc005cd0 con 0x7fc3b8004850 2022-12-01T09:45:24.597 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.579+0000 7fc3d23be700 1 -- 172.21.15.79:0/3154047603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b8004850 msgr2=0x7fc3b8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.597 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.579+0000 7fc3d23be700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b8004850 0x7fc3b8004cc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0ce900 tx=0x7fc3b8005880 comp rx=0 tx=0).stop 2022-12-01T09:45:24.597 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.579+0000 7fc3d23be700 1 -- 172.21.15.79:0/3154047603 shutdown_connections 2022-12-01T09:45:24.598 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.579+0000 7fc3d23be700 1 --2- 172.21.15.79:0/3154047603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b8004850 0x7fc3b8004cc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.598 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.579+0000 7fc3d23be700 1 -- 172.21.15.79:0/3154047603 >> 172.21.15.79:0/3154047603 conn(0x7fc3cc08a000 msgr2=0x7fc3cc0d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:24.599 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.579+0000 7fc3d23be700 1 -- 172.21.15.79:0/3154047603 shutdown_connections 2022-12-01T09:45:24.599 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.579+0000 7fc3d23be700 1 -- 172.21.15.79:0/3154047603 wait complete. 2022-12-01T09:45:24.599 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.580+0000 7fc3d23be700 1 Processor -- start 2022-12-01T09:45:24.599 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.580+0000 7fc3d23be700 1 -- start start 2022-12-01T09:45:24.599 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3d23be700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8004850 0x7fc3cc0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.600 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3d23be700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3cc0b5b90 0x7fc3cc1e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.600 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3d23be700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3cc1e3810 0x7fc3cc149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.600 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3d23be700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1e3cb0 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.600 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3d23be700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc14e2b0 con 0x7fc3cc1e3810 2022-12-01T09:45:24.601 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3d23be700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc14ab00 con 0x7fc3b8004850 2022-12-01T09:45:24.601 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3cc0b5b90 0x7fc3cc1e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.601 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3cc0b5b90 0x7fc3cc1e32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47272/0 (socket says 172.21.15.79:47272) 2022-12-01T09:45:24.601 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cb7fe700 1 -- 172.21.15.79:0/2086556760 learned_addr learned my addr 172.21.15.79:0/2086556760 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:24.601 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cbfff700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8004850 0x7fc3cc0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.602 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3d095b700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3cc1e3810 0x7fc3cc149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.602 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cb7fe700 1 -- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8004850 msgr2=0x7fc3cc0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.602 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cb7fe700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8004850 0x7fc3cc0b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.602 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cb7fe700 1 -- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3cc1e3810 msgr2=0x7fc3cc149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:24.603 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cb7fe700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3cc1e3810 0x7fc3cc149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:24.603 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cb7fe700 1 -- 172.21.15.79:0/2086556760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc14ade0 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.603 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3cbfff700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8004850 0x7fc3cc0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-12-01T09:45:24.603 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.581+0000 7fc3d095b700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3cc1e3810 0x7fc3cc149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-12-01T09:45:24.604 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.582+0000 7fc3cb7fe700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3cc0b5b90 0x7fc3cc1e32d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc06cc90 tx=0x7fc3bc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:24.604 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.582+0000 7fc3c8ff9700 1 -- 172.21.15.79:0/2086556760 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc004a80 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.604 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.582+0000 7fc3c8ff9700 1 -- 172.21.15.79:0/2086556760 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc004c00 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.605 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.582+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc0afdf0 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.605 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.582+0000 7fc3c8ff9700 1 -- 172.21.15.79:0/2086556760 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0070d0 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.605 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.582+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc0b03b0 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.606 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.583+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc0b0540 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.606 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.583+0000 7fc3c8ff9700 1 -- 172.21.15.79:0/2086556760 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7fc3bc02c070 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.606 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.583+0000 7fc3c8ff9700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ac066540 0x7fc3ac0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:24.606 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.584+0000 7fc3c8ff9700 1 -- 172.21.15.79:0/2086556760 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fc3bc083f00 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.606 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.584+0000 7fc3cbfff700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ac066540 0x7fc3ac0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:24.607 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.584+0000 7fc3cbfff700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ac066540 0x7fc3ac0689f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007fd0 tx=0x7fc3c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:24.607 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.588+0000 7fc3c8ff9700 1 -- 172.21.15.79:0/2086556760 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7fc3bc051c90 con 0x7fc3cc0b5b90 2022-12-01T09:45:24.769 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:24.765+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fc3cc0669f0 con 0x7fc3cc0b5b90 2022-12-01T09:45:25.554 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.550+0000 7fc3c8ff9700 1 -- 172.21.15.79:0/2086556760 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fc3bc007da0 con 0x7fc3cc0b5b90 2022-12-01T09:45:25.557 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ac066540 msgr2=0x7fc3ac0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ac066540 0x7fc3ac0689f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007fd0 tx=0x7fc3c0009040 comp rx=0 tx=0).stop 2022-12-01T09:45:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3cc0b5b90 msgr2=0x7fc3cc1e32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3cc0b5b90 0x7fc3cc1e32d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc06cc90 tx=0x7fc3bc001a00 comp rx=0 tx=0).stop 2022-12-01T09:45:25.558 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 shutdown_connections 2022-12-01T09:45:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ac066540 0x7fc3ac0689f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc3cc1e3810 0x7fc3cc149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc3b8004850 0x7fc3cc0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 --2- 172.21.15.79:0/2086556760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3cc0b5b90 0x7fc3cc1e32d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:25.559 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.553+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 >> 172.21.15.79:0/2086556760 conn(0x7fc3cc08a000 msgr2=0x7fc3cc0adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.554+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 shutdown_connections 2022-12-01T09:45:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.554+0000 7fc3d23be700 1 -- 172.21.15.79:0/2086556760 wait complete. 2022-12-01T09:45:25.560 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'rbd' created 2022-12-01T09:45:25.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-12-01T09:45:25.706 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.702+0000 7f79ee7a5700 1 Processor -- start 2022-12-01T09:45:25.706 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.702+0000 7f79ee7a5700 1 -- start start 2022-12-01T09:45:25.712 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79ee7a5700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f79e815bf80 0x7f79e8069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:25.712 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79ee7a5700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e806dd80 0x7f79e80c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79ee7a5700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80cc8d0 con 0x7f79e80c94a0 2022-12-01T09:45:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79ee7a5700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e80c9920 con 0x7f79e815bf80 2022-12-01T09:45:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79ee7a5700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e806a380 con 0x7f79e806dd80 2022-12-01T09:45:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e77fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e806dd80 0x7f79e80c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e7fff700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f79e815bf80 0x7f79e8069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:25.715 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e77fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e806dd80 0x7f79e80c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.79:44506/0 (socket says 172.21.15.79:44506) 2022-12-01T09:45:25.716 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e77fe700 1 -- 172.21.15.79:0/29494963 learned_addr learned my addr 172.21.15.79:0/29494963 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:25.716 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79ecd42700 1 --1- >> v1:172.21.15.182:6789/0 conn(0x7f79e80c94a0 0x7f79e815fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.182:6789/0 says I am v1:172.21.15.79:59956/0 (socket says 172.21.15.79:59956) 2022-12-01T09:45:25.716 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e6ffd700 1 -- 172.21.15.79:0/29494963 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397498874 0 0) 0x7f79e80cc8d0 con 0x7f79e80c94a0 2022-12-01T09:45:25.716 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e6ffd700 1 -- 172.21.15.79:0/29494963 --> v1:172.21.15.182:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d40035b0 con 0x7f79e80c94a0 2022-12-01T09:45:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e7fff700 1 -- 172.21.15.79:0/29494963 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e806dd80 msgr2=0x7f79e80c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e7fff700 1 --2- 172.21.15.79:0/29494963 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e806dd80 0x7f79e80c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e7fff700 1 -- 172.21.15.79:0/29494963 >> v1:172.21.15.182:6789/0 conn(0x7f79e80c94a0 legacy=0x7f79e815fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:25.717 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e7fff700 1 -- 172.21.15.79:0/29494963 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e806a660 con 0x7f79e815bf80 2022-12-01T09:45:25.718 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.703+0000 7f79e77fe700 1 --2- 172.21.15.79:0/29494963 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e806dd80 0x7f79e80c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:25.718 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79e7fff700 1 --2- 172.21.15.79:0/29494963 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e815bf80 0x7f79e8069da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009840 tx=0x7f79dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24654582d7d887da server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:25.718 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79e6ffd700 1 -- 172.21.15.79:0/29494963 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc011830 con 0x7f79e815bf80 2022-12-01T09:45:25.718 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79e6ffd700 1 -- 172.21.15.79:0/29494963 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc011990 con 0x7f79e815bf80 2022-12-01T09:45:25.719 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79e6ffd700 1 -- 172.21.15.79:0/29494963 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc011d20 con 0x7f79e815bf80 2022-12-01T09:45:25.719 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79ee7a5700 1 -- 172.21.15.79:0/29494963 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e815bf80 msgr2=0x7f79e8069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:25.719 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79ee7a5700 1 --2- 172.21.15.79:0/29494963 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e815bf80 0x7f79e8069da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009840 tx=0x7f79dc009b50 comp rx=0 tx=0).stop 2022-12-01T09:45:25.719 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79ee7a5700 1 -- 172.21.15.79:0/29494963 shutdown_connections 2022-12-01T09:45:25.720 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79ee7a5700 1 --2- 172.21.15.79:0/29494963 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e815bf80 0x7f79e8069da0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:25.720 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79ee7a5700 1 --2- 172.21.15.79:0/29494963 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e806dd80 0x7f79e80c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:25.720 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79ee7a5700 1 -- 172.21.15.79:0/29494963 >> 172.21.15.79:0/29494963 conn(0x7f79e80cf5a0 msgr2=0x7f79e80b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:25.720 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79ee7a5700 1 -- 172.21.15.79:0/29494963 shutdown_connections 2022-12-01T09:45:25.720 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.704+0000 7f79ee7a5700 1 -- 172.21.15.79:0/29494963 wait complete. 2022-12-01T09:45:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.706+0000 7f79ee7a5700 1 Processor -- start 2022-12-01T09:45:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.706+0000 7f79ee7a5700 1 -- start start 2022-12-01T09:45:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.706+0000 7f79ee7a5700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e806dd80 0x7f79e815fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.706+0000 7f79ee7a5700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e80c94a0 0x7f79e815c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.706+0000 7f79ee7a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e815bf80 0x7f79e814bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:25.722 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.706+0000 7f79ee7a5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e815fad0 con 0x7f79e815bf80 2022-12-01T09:45:25.722 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.706+0000 7f79ee7a5700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8160430 con 0x7f79e806dd80 2022-12-01T09:45:25.722 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.706+0000 7f79ee7a5700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e815ee50 con 0x7f79e80c94a0 2022-12-01T09:45:25.722 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ecd42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e815bf80 0x7f79e814bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:25.722 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ecd42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e815bf80 0x7f79e814bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47332/0 (socket says 172.21.15.79:47332) 2022-12-01T09:45:25.723 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ecd42700 1 -- 172.21.15.79:0/1347356524 learned_addr learned my addr 172.21.15.79:0/1347356524 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:25.723 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79e7fff700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e806dd80 0x7f79e815fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:25.724 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79e77fe700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e80c94a0 0x7f79e815c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:25.725 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ecd42700 1 -- 172.21.15.79:0/1347356524 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e80c94a0 msgr2=0x7f79e815c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:25.725 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ecd42700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e80c94a0 0x7f79e815c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:25.726 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ecd42700 1 -- 172.21.15.79:0/1347356524 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e806dd80 msgr2=0x7f79e815fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:25.726 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ecd42700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e806dd80 0x7f79e815fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:25.726 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ecd42700 1 -- 172.21.15.79:0/1347356524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8009550 con 0x7f79e815bf80 2022-12-01T09:45:25.727 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79e7fff700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e806dd80 0x7f79e815fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:45:25.727 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ecd42700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e815bf80 0x7f79e814bd10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79e000cc80 tx=0x7f79e000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:25.727 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79e4ff9700 1 -- 172.21.15.79:0/1347356524 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000ada0 con 0x7f79e815bf80 2022-12-01T09:45:25.728 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79e4ff9700 1 -- 172.21.15.79:0/1347356524 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000ce80 con 0x7f79e815bf80 2022-12-01T09:45:25.728 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc0094a0 con 0x7f79e815bf80 2022-12-01T09:45:25.729 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79e4ff9700 1 -- 172.21.15.79:0/1347356524 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0007290 con 0x7f79e815bf80 2022-12-01T09:45:25.729 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.707+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e815f410 con 0x7f79e815bf80 2022-12-01T09:45:25.729 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.708+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e815fc10 con 0x7f79e815bf80 2022-12-01T09:45:25.729 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.709+0000 7f79e4ff9700 1 -- 172.21.15.79:0/1347356524 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f79e0019030 con 0x7f79e815bf80 2022-12-01T09:45:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.709+0000 7f79e4ff9700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f79c8066540 0x7f79c80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.709+0000 7f79e7fff700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f79c8066540 0x7f79c80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.709+0000 7f79e4ff9700 1 -- 172.21.15.79:0/1347356524 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f79e0083190 con 0x7f79e815bf80 2022-12-01T09:45:25.731 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.709+0000 7f79e7fff700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f79c8066540 0x7f79c80689f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009fd0 tx=0x7f79dc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:25.732 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.713+0000 7f79e4ff9700 1 -- 172.21.15.79:0/1347356524 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f79e815fc10 con 0x7f79e815bf80 2022-12-01T09:45:25.898 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:25.894+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79e815fc10 con 0x7f79e815bf80 2022-12-01T09:45:26.559 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.555+0000 7f79e4ff9700 1 -- 172.21.15.79:0/1347356524 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f79e815fc10 con 0x7f79e815bf80 2022-12-01T09:45:26.562 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f79c8066540 msgr2=0x7f79c80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:26.562 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f79c8066540 0x7f79c80689f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009fd0 tx=0x7f79dc008030 comp rx=0 tx=0).stop 2022-12-01T09:45:26.563 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e815bf80 msgr2=0x7f79e814bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:26.563 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e815bf80 0x7f79e814bd10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79e000cc80 tx=0x7f79e000a340 comp rx=0 tx=0).stop 2022-12-01T09:45:26.563 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 shutdown_connections 2022-12-01T09:45:26.564 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f79c8066540 0x7f79c80689f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.564 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e815bf80 0x7f79e814bd10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.564 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f79e806dd80 0x7f79e815fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.565 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 --2- 172.21.15.79:0/1347356524 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f79e80c94a0 0x7f79e815c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.565 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 >> 172.21.15.79:0/1347356524 conn(0x7f79e80cf5a0 msgr2=0x7f79e80ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:26.565 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 shutdown_connections 2022-12-01T09:45:26.565 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.558+0000 7f79ee7a5700 1 -- 172.21.15.79:0/1347356524 wait complete. 2022-12-01T09:45:26.566 INFO:teuthology.orchestra.run.smithi079.stderr:enabled application 'rbd' on pool 'rbd' 2022-12-01T09:45:26.580 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-12-01T09:45:26.581 INFO:tasks.ceph.mds.a:Restarting daemon 2022-12-01T09:45:26.582 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-12-01T09:45:26.585 INFO:tasks.ceph.mds.a:Started 2022-12-01T09:45:26.586 INFO:tasks.ceph.mds.c:Restarting daemon 2022-12-01T09:45:26.586 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-12-01T09:45:26.588 INFO:tasks.ceph.mds.c:Started 2022-12-01T09:45:26.589 INFO:tasks.ceph.mds.b:Restarting daemon 2022-12-01T09:45:26.589 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-12-01T09:45:26.592 INFO:tasks.ceph.mds.b:Started 2022-12-01T09:45:26.592 INFO:tasks.ceph.mds.d:Restarting daemon 2022-12-01T09:45:26.593 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-12-01T09:45:26.595 INFO:tasks.ceph.mds.d:Started 2022-12-01T09:45:26.596 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-12-01T09:45:26.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-12-01T09:45:26.683 INFO:tasks.ceph.mds.b.smithi182.stdout:starting mds.b at 2022-12-01T09:45:26.684 INFO:tasks.ceph.mds.d.smithi182.stdout:starting mds.d at 2022-12-01T09:45:26.686 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2022-12-01T09:45:26.690 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2022-12-01T09:45:26.742 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.738+0000 7f76e7d46700 1 Processor -- start 2022-12-01T09:45:26.743 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.739+0000 7f76e7d46700 1 -- start start 2022-12-01T09:45:26.749 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.739+0000 7f76e7d46700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f76e0069600 0x7f76e00ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:26.749 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.739+0000 7f76e7d46700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76e00699d0 0x7f76e00ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:26.750 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.739+0000 7f76e7d46700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e00ccdd0 con 0x7f76e00cec90 2022-12-01T09:45:26.750 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.739+0000 7f76e7d46700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e00cd0b0 con 0x7f76e00699d0 2022-12-01T09:45:26.750 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.739+0000 7f76e7d46700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e00cd390 con 0x7f76e0069600 2022-12-01T09:45:26.750 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.739+0000 7f76e62e3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76e00699d0 0x7f76e00ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e62e3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76e00699d0 0x7f76e00ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47392/0 (socket says 172.21.15.79:47392) 2022-12-01T09:45:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e62e3700 1 -- 172.21.15.79:0/1738972098 learned_addr learned my addr 172.21.15.79:0/1738972098 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e5ae2700 1 --2- 172.21.15.79:0/1738972098 >> v2:172.21.15.182:3300/0 conn(0x7f76e0069600 0x7f76e00ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e62e3700 1 -- 172.21.15.79:0/1738972098 >> v2:172.21.15.182:3300/0 conn(0x7f76e0069600 msgr2=0x7f76e00ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:26.752 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e62e3700 1 --2- 172.21.15.79:0/1738972098 >> v2:172.21.15.182:3300/0 conn(0x7f76e0069600 0x7f76e00ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.752 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e62e3700 1 -- 172.21.15.79:0/1738972098 >> v1:172.21.15.182:6789/0 conn(0x7f76e00cec90 legacy=0x7f76e00addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:26.752 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e62e3700 1 -- 172.21.15.79:0/1738972098 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00cd670 con 0x7f76e00699d0 2022-12-01T09:45:26.753 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e62e3700 1 --2- 172.21.15.79:0/1738972098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e00699d0 0x7f76e00ae4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76e00b1c60 tx=0x7f76d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d448985c835b93 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:26.753 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e4ae0700 1 -- 172.21.15.79:0/1738972098 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d800e070 con 0x7f76e00699d0 2022-12-01T09:45:26.753 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e4ae0700 1 -- 172.21.15.79:0/1738972098 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d8003a20 con 0x7f76e00699d0 2022-12-01T09:45:26.753 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.740+0000 7f76e4ae0700 1 -- 172.21.15.79:0/1738972098 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d8003dd0 con 0x7f76e00699d0 2022-12-01T09:45:26.754 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.741+0000 7f76e7d46700 1 -- 172.21.15.79:0/1738972098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e00699d0 msgr2=0x7f76e00ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:26.754 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.741+0000 7f76e7d46700 1 --2- 172.21.15.79:0/1738972098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e00699d0 0x7f76e00ae4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76e00b1c60 tx=0x7f76d800b330 comp rx=0 tx=0).stop 2022-12-01T09:45:26.754 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.741+0000 7f76e7d46700 1 -- 172.21.15.79:0/1738972098 shutdown_connections 2022-12-01T09:45:26.754 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.741+0000 7f76e7d46700 1 --2- 172.21.15.79:0/1738972098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e00699d0 0x7f76e00ae4e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.755 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.741+0000 7f76e7d46700 1 --2- 172.21.15.79:0/1738972098 >> v2:172.21.15.182:3300/0 conn(0x7f76e0069600 0x7f76e00ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.755 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.741+0000 7f76e7d46700 1 -- 172.21.15.79:0/1738972098 >> 172.21.15.79:0/1738972098 conn(0x7f76e00cbb50 msgr2=0x7f76e00cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:26.755 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.741+0000 7f76e7d46700 1 -- 172.21.15.79:0/1738972098 shutdown_connections 2022-12-01T09:45:26.756 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.741+0000 7f76e7d46700 1 -- 172.21.15.79:0/1738972098 wait complete. 2022-12-01T09:45:26.756 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.742+0000 7f76e7d46700 1 Processor -- start 2022-12-01T09:45:26.756 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.742+0000 7f76e7d46700 1 -- start start 2022-12-01T09:45:26.756 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e7d46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e0069600 0x7f76e00acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e7d46700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76e00699d0 0x7f76e0158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e7d46700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76e00cec90 0x7f76e01f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e7d46700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0159e30 con 0x7f76e0069600 2022-12-01T09:45:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e7d46700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0158d90 con 0x7f76e00cec90 2022-12-01T09:45:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e7d46700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0159070 con 0x7f76e00699d0 2022-12-01T09:45:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e5ae2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e0069600 0x7f76e00acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e5ae2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e0069600 0x7f76e00acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47394/0 (socket says 172.21.15.79:47394) 2022-12-01T09:45:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e5ae2700 1 -- 172.21.15.79:0/2379896451 learned_addr learned my addr 172.21.15.79:0/2379896451 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e5ae2700 1 -- 172.21.15.79:0/2379896451 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76e00699d0 msgr2=0x7f76e0158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e5ae2700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76e00699d0 0x7f76e0158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e62e3700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76e00cec90 0x7f76e01f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e5ae2700 1 -- 172.21.15.79:0/2379896451 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76e00cec90 msgr2=0x7f76e01f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e5ae2700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76e00cec90 0x7f76e01f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e5ae2700 1 -- 172.21.15.79:0/2379896451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8009b30 con 0x7f76e0069600 2022-12-01T09:45:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e5ae2700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e0069600 0x7f76e00acc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00e810 tx=0x7f76dc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76ce7fc700 1 -- 172.21.15.79:0/2379896451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc013610 con 0x7f76e0069600 2022-12-01T09:45:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76ce7fc700 1 -- 172.21.15.79:0/2379896451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc013770 con 0x7f76e0069600 2022-12-01T09:45:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e0159350 con 0x7f76e0069600 2022-12-01T09:45:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76ce7fc700 1 -- 172.21.15.79:0/2379896451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc013b20 con 0x7f76e0069600 2022-12-01T09:45:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.743+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e0159910 con 0x7f76e0069600 2022-12-01T09:45:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.744+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e0070a00 con 0x7f76e0069600 2022-12-01T09:45:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.745+0000 7f76ce7fc700 1 -- 172.21.15.79:0/2379896451 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f76dc023070 con 0x7f76e0069600 2022-12-01T09:45:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.745+0000 7f76ce7fc700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f76c0066540 0x7f76c00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.745+0000 7f76ce7fc700 1 -- 172.21.15.79:0/2379896451 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f76dc0830a0 con 0x7f76e0069600 2022-12-01T09:45:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.745+0000 7f76e52e1700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f76c0066540 0x7f76c00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.745+0000 7f76e52e1700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f76c0066540 0x7f76c00689f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76e00ae260 tx=0x7f76d0006c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:26.764 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.749+0000 7f76ce7fc700 1 -- 172.21.15.79:0/2379896451 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f76dc050ad0 con 0x7f76e0069600 2022-12-01T09:45:26.953 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.949+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76e00706f0 con 0x7f76e0069600 2022-12-01T09:45:26.954 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.950+0000 7f76ce7fc700 1 -- 172.21.15.79:0/2379896451 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13768 (secure 0 0 0) 0x7f76dc07be60 con 0x7f76e0069600 2022-12-01T09:45:26.954 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:45:26.954 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":15,"fsid":"e7b489bb-0e60-496d-af31-008ef9057b43","created":"2022-12-01T09:45:13.521007+0000","modified":"2022-12-01T09:45:26.549471+0000","last_up_change":"2022-12-01T09:45:24.327099+0000","last_in_change":"2022-12-01T09:45:15.995963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-12-01T09:45:24.783893+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-12-01T09:45:25.222303+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f65efd56-e00f-4915-a254-99ba3bad5ca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":101315},{"type":"v1","addr":"172.21.15.79:6809","nonce":101315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":101315},{"type":"v1","addr":"172.21.15.79:6811","nonce":101315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":101315},{"type":"v1","addr":"172.21.15.79:6815","nonce":101315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":101315},{"type":"v1","addr":"172.21.15.79:6813","nonce":101315}]},"public_addr":"172.21.15.79:6809/101315","cluster_addr":"172.21.15.79:6811/101315","heartbeat_back_addr":"172.21.15.79:6815/101315","heartbeat_front_addr":"172.21.15.79:6813/101315","state":["exists","up"]},{"osd":1,"uuid":"51034ab5-541d-48e6-957b-d23ba4bf28d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":101318},{"type":"v1","addr":"172.21.15.79:6825","nonce":101318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":101318},{"type":"v1","addr":"172.21.15.79:6827","nonce":101318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":101318},{"type":"v1","addr":"172.21.15.79:6831","nonce":101318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":101318},{"type":"v1","addr":"172.21.15.79:6829","nonce":101318}]},"public_addr":"172.21.15.79:6825/101318","cluster_addr":"172.21.15.79:6827/101318","heartbeat_back_addr":"172.21.15.79:6831/101318","heartbeat_front_addr":"172.21.15.79:6829/101318","state":["exists","up"]},{"osd":2,"uuid":"83191444-237f-49fc-9046-58c92f1d68f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":101319},{"type":"v1","addr":"172.21.15.79:6817","nonce":101319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":101319},{"type":"v1","addr":"172.21.15.79:6819","nonce":101319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":101319},{"type":"v1","addr":"172.21.15.79:6823","nonce":101319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":101319},{"type":"v1","addr":"172.21.15.79:6821","nonce":101319}]},"public_addr":"172.21.15.79:6817/101319","cluster_addr":"172.21.15.79:6819/101319","heartbeat_back_addr":"172.21.15.79:6823/101319","heartbeat_front_addr":"172.21.15.79:6821/101319","state":["exists","up"]},{"osd":3,"uuid":"b5c70400-233c-43e1-9dc9-436eda906f14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":101317},{"type":"v1","addr":"172.21.15.79:6801","nonce":101317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":101317},{"type":"v1","addr":"172.21.15.79:6803","nonce":101317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":101317},{"type":"v1","addr":"172.21.15.79:6807","nonce":101317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":101317},{"type":"v1","addr":"172.21.15.79:6805","nonce":101317}]},"public_addr":"172.21.15.79:6801/101317","cluster_addr":"172.21.15.79:6803/101317","heartbeat_back_addr":"172.21.15.79:6807/101317","heartbeat_front_addr":"172.21.15.79:6805/101317","state":["exists","up"]},{"osd":4,"uuid":"9acb459b-66e7-4eb2-b2cf-19eac220adfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":101591},{"type":"v1","addr":"172.21.15.182:6801","nonce":101591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":101591},{"type":"v1","addr":"172.21.15.182:6803","nonce":101591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":101591},{"type":"v1","addr":"172.21.15.182:6807","nonce":101591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":101591},{"type":"v1","addr":"172.21.15.182:6805","nonce":101591}]},"public_addr":"172.21.15.182:6801/101591","cluster_addr":"172.21.15.182:6803/101591","heartbeat_back_addr":"172.21.15.182:6807/101591","heartbeat_front_addr":"172.21.15.182:6805/101591","state":["exists","up"]},{"osd":5,"uuid":"dc64787f-8edc-4941-9746-94a17af0662b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":101592},{"type":"v1","addr":"172.21.15.182:6809","nonce":101592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":101592},{"type":"v1","addr":"172.21.15.182:6811","nonce":101592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":101592},{"type":"v1","addr":"172.21.15.182:6815","nonce":101592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":101592},{"type":"v1","addr":"172.21.15.182:6813","nonce":101592}]},"public_addr":"172.21.15.182:6809/101592","cluster_addr":"172.21.15.182:6811/101592","heartbeat_back_addr":"172.21.15.182:6815/101592","heartbeat_front_addr":"172.21.15.182:6813/101592","state":["exists","up"]},{"osd":6,"uuid":"f0dee44e-bffd-4740-912f-94193d3fe5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":101593},{"type":"v1","addr":"172.21.15.182:6817","nonce":101593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6818","nonce":101593},{"type":"v1","addr":"172.21.15.182:6819","nonce":101593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6822","nonce":101593},{"type":"v1","addr":"172.21.15.182:6823","nonce":101593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":101593},{"type":"v1","addr":"172.21.15.182:6821","nonce":101593}]},"public_addr":"172.21.15.182:6817/101593","cluster_addr":"172.21.15.182:6819/101593","heartbeat_back_addr":"172.21.15.182:6823/101593","heartbeat_front_addr":"172.21.15.182:6821/101593","state":["exists","up"]},{"osd":7,"uuid":"dae7edb0-c2ae-45c2-8103-49ba8af5267e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":101636},{"type":"v1","addr":"172.21.15.182:6825","nonce":101636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":101636},{"type":"v1","addr":"172.21.15.182:6827","nonce":101636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":101636},{"type":"v1","addr":"172.21.15.182:6831","nonce":101636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6828","nonce":101636},{"type":"v1","addr":"172.21.15.182:6829","nonce":101636}]},"public_addr":"172.21.15.182:6825/101636","cluster_addr":"172.21.15.182:6827/101636","heartbeat_back_addr":"172.21.15.182:6831/101636","heartbeat_front_addr":"172.21.15.182:6829/101636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.260123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.184586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.221041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.189293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.166735+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.215218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.228323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.219368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:45:26.956 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f76c0066540 msgr2=0x7f76c00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:26.956 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f76c0066540 0x7f76c00689f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76e00ae260 tx=0x7f76d0006c50 comp rx=0 tx=0).stop 2022-12-01T09:45:26.956 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e0069600 msgr2=0x7f76e00acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:26.957 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e0069600 0x7f76e00acc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00e810 tx=0x7f76dc00ebd0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.957 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 shutdown_connections 2022-12-01T09:45:26.957 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f76c0066540 0x7f76c00689f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.957 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76e00cec90 0x7f76e01f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.958 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76e0069600 0x7f76e00acc90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.958 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 --2- 172.21.15.79:0/2379896451 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76e00699d0 0x7f76e0158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:26.958 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 >> 172.21.15.79:0/2379896451 conn(0x7f76e00cbb50 msgr2=0x7f76e015bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:26.958 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 shutdown_connections 2022-12-01T09:45:26.958 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:26.952+0000 7f76e7d46700 1 -- 172.21.15.79:0/2379896451 wait complete. 2022-12-01T09:45:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-12-01T09:45:24.783893+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2022-12-01T09:45:25.222303+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-12-01T09:45:26.970 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-12-01T09:45:27.093 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.089+0000 7f1854479700 1 Processor -- start 2022-12-01T09:45:27.093 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.089+0000 7f1854479700 1 -- start start 2022-12-01T09:45:27.096 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1854479700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f184c0aedb0 0x7f184c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.096 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1854479700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 0x7f184c0acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1854479700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184c0d0040 con 0x7f184c0af2a0 2022-12-01T09:45:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1854479700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c0cc610 con 0x7f184c0aedb0 2022-12-01T09:45:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1854479700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c15a0a0 con 0x7f184c0ce510 2022-12-01T09:45:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1852215700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f184c0aedb0 0x7f184c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.097 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1851a14700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f184c0af2a0 0x7f184c0cde00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39566/0 (socket says 172.21.15.79:39566) 2022-12-01T09:45:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1851a14700 1 -- 172.21.15.79:0/1098858877 learned_addr learned my addr 172.21.15.79:0/1098858877 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1852a16700 1 --2- 172.21.15.79:0/1098858877 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 0x7f184c0acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1852215700 1 -- 172.21.15.79:0/1098858877 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 msgr2=0x7f184c0acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:27.098 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1852215700 1 --2- 172.21.15.79:0/1098858877 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 0x7f184c0acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1852215700 1 -- 172.21.15.79:0/1098858877 >> v1:172.21.15.79:6789/0 conn(0x7f184c0af2a0 legacy=0x7f184c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1852215700 1 -- 172.21.15.79:0/1098858877 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c0cb990 con 0x7f184c0aedb0 2022-12-01T09:45:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1851213700 1 -- 172.21.15.79:0/1098858877 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323740835 0 0) 0x7f184c0d0040 con 0x7f184c0af2a0 2022-12-01T09:45:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1852a16700 1 --2- 172.21.15.79:0/1098858877 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 0x7f184c0acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:45:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.090+0000 7f1852215700 1 --2- 172.21.15.79:0/1098858877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 0x7f184c0cb290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1848009870 tx=0x7f1848009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6077cf2031a0ea72 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1851213700 1 -- 172.21.15.79:0/1098858877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848011830 con 0x7f184c0aedb0 2022-12-01T09:45:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1851213700 1 -- 172.21.15.79:0/1098858877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1848011990 con 0x7f184c0aedb0 2022-12-01T09:45:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1851213700 1 -- 172.21.15.79:0/1098858877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848011d20 con 0x7f184c0aedb0 2022-12-01T09:45:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1854479700 1 -- 172.21.15.79:0/1098858877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 msgr2=0x7f184c0cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.100 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1854479700 1 --2- 172.21.15.79:0/1098858877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 0x7f184c0cb290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1848009870 tx=0x7f1848009b80 comp rx=0 tx=0).stop 2022-12-01T09:45:27.101 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1854479700 1 -- 172.21.15.79:0/1098858877 shutdown_connections 2022-12-01T09:45:27.101 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1854479700 1 --2- 172.21.15.79:0/1098858877 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 0x7f184c0acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.101 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1854479700 1 --2- 172.21.15.79:0/1098858877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 0x7f184c0cb290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.101 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1854479700 1 -- 172.21.15.79:0/1098858877 >> 172.21.15.79:0/1098858877 conn(0x7f184c08a000 msgr2=0x7f184c0d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:27.102 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1854479700 1 -- 172.21.15.79:0/1098858877 shutdown_connections 2022-12-01T09:45:27.102 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.091+0000 7f1854479700 1 -- 172.21.15.79:0/1098858877 wait complete. 2022-12-01T09:45:27.102 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.093+0000 7f1854479700 1 Processor -- start 2022-12-01T09:45:27.102 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.093+0000 7f1854479700 1 -- start start 2022-12-01T09:45:27.105 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1854479700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 0x7f184c1f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.105 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1854479700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f184c0af2a0 0x7f184c06b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.105 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1854479700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 0x7f184c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.105 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1854479700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c1f4300 con 0x7f184c0aedb0 2022-12-01T09:45:27.106 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1854479700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c06b1e0 con 0x7f184c0af2a0 2022-12-01T09:45:27.106 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1854479700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c06c470 con 0x7f184c0ce510 2022-12-01T09:45:27.106 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852215700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 0x7f184c1f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.106 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852215700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 0x7f184c1f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47416/0 (socket says 172.21.15.79:47416) 2022-12-01T09:45:27.107 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852215700 1 -- 172.21.15.79:0/3249615497 learned_addr learned my addr 172.21.15.79:0/3249615497 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:27.107 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1851a14700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f184c0af2a0 0x7f184c06b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.108 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852a16700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 0x7f184c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.108 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852215700 1 -- 172.21.15.79:0/3249615497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 msgr2=0x7f184c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.109 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852215700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 0x7f184c0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.109 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852215700 1 -- 172.21.15.79:0/3249615497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f184c0af2a0 msgr2=0x7f184c06b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.109 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852215700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f184c0af2a0 0x7f184c06b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.110 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852215700 1 -- 172.21.15.79:0/3249615497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480094a0 con 0x7f184c0aedb0 2022-12-01T09:45:27.110 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1852215700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 0x7f184c1f3dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18480090b0 tx=0x7f1848004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:27.110 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f183affd700 1 -- 172.21.15.79:0/3249615497 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18480036a0 con 0x7f184c0aedb0 2022-12-01T09:45:27.110 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f183affd700 1 -- 172.21.15.79:0/3249615497 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184801e070 con 0x7f184c0aedb0 2022-12-01T09:45:27.111 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.094+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c06a5d0 con 0x7f184c0aedb0 2022-12-01T09:45:27.111 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.095+0000 7f183affd700 1 -- 172.21.15.79:0/3249615497 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848003a40 con 0x7f184c0aedb0 2022-12-01T09:45:27.111 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.095+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c06ab90 con 0x7f184c0aedb0 2022-12-01T09:45:27.111 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.096+0000 7f183affd700 1 -- 172.21.15.79:0/3249615497 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f184800f050 con 0x7f184c0aedb0 2022-12-01T09:45:27.112 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.096+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c0669f0 con 0x7f184c0aedb0 2022-12-01T09:45:27.112 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.096+0000 7f183affd700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f182c066540 0x7f182c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.112 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.096+0000 7f183affd700 1 -- 172.21.15.79:0/3249615497 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f18480843a0 con 0x7f184c0aedb0 2022-12-01T09:45:27.113 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.102+0000 7f1851a14700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f182c066540 0x7f182c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.113 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.102+0000 7f183affd700 1 -- 172.21.15.79:0/3249615497 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f1848051e50 con 0x7f184c0aedb0 2022-12-01T09:45:27.113 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.102+0000 7f1851a14700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f182c066540 0x7f182c0689f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f184c1e0750 tx=0x7f183c007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:27.286 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.282+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f184c1e42f0 con 0x7f184c0aedb0 2022-12-01T09:45:27.287 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.283+0000 7f183affd700 1 -- 172.21.15.79:0/3249615497 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1848020020 con 0x7f184c0aedb0 2022-12-01T09:45:27.287 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2022-12-01T09:45:27.289 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f182c066540 msgr2=0x7f182c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.289 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f182c066540 0x7f182c0689f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f184c1e0750 tx=0x7f183c007e70 comp rx=0 tx=0).stop 2022-12-01T09:45:27.289 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 msgr2=0x7f184c1f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.289 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 0x7f184c1f3dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18480090b0 tx=0x7f1848004750 comp rx=0 tx=0).stop 2022-12-01T09:45:27.290 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 shutdown_connections 2022-12-01T09:45:27.290 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f182c066540 0x7f182c0689f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.290 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f184c0ce510 0x7f184c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.290 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f184c0aedb0 0x7f184c1f3dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.290 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 --2- 172.21.15.79:0/3249615497 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f184c0af2a0 0x7f184c06b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.291 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 >> 172.21.15.79:0/3249615497 conn(0x7f184c08a000 msgr2=0x7f184c1e08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:27.291 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 shutdown_connections 2022-12-01T09:45:27.291 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.285+0000 7f1854479700 1 -- 172.21.15.79:0/3249615497 wait complete. 2022-12-01T09:45:27.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-12-01T09:45:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.423+0000 7f2d2029c700 1 Processor -- start 2022-12-01T09:45:27.428 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.423+0000 7f2d2029c700 1 -- start start 2022-12-01T09:45:27.441 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.424+0000 7f2d2029c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d180b19a0 0x7f2d1815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.441 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.424+0000 7f2d2029c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1815d270 con 0x7f2d180b0de0 2022-12-01T09:45:27.442 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.424+0000 7f2d2029c700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d18070300 con 0x7f2d180b11b0 2022-12-01T09:45:27.442 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.424+0000 7f2d2029c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1815c910 con 0x7f2d180b19a0 2022-12-01T09:45:27.442 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1d837700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d180b19a0 0x7f2d1815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.442 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1e038700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2d180b0de0 0x7f2d18160240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39588/0 (socket says 172.21.15.79:39588) 2022-12-01T09:45:27.442 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1e038700 1 -- 172.21.15.79:0/220490849 learned_addr learned my addr 172.21.15.79:0/220490849 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:27.443 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1d837700 1 -- 172.21.15.79:0/220490849 >> v1:172.21.15.182:6789/0 conn(0x7f2d180b11b0 legacy=0x7f2d180cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:27.443 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1d837700 1 -- 172.21.15.79:0/220490849 >> v1:172.21.15.79:6789/0 conn(0x7f2d180b0de0 legacy=0x7f2d18160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.443 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1d837700 1 -- 172.21.15.79:0/220490849 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180705e0 con 0x7f2d180b19a0 2022-12-01T09:45:27.443 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1d036700 1 -- 172.21.15.79:0/220490849 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276485477 0 0) 0x7f2d1815d270 con 0x7f2d180b0de0 2022-12-01T09:45:27.444 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1d837700 1 --2- 172.21.15.79:0/220490849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 0x7f2d1815cd30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009820 tx=0x7f2d14009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1362ad41192ead53 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:27.444 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1d036700 1 -- 172.21.15.79:0/220490849 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14005e30 con 0x7f2d180b19a0 2022-12-01T09:45:27.444 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1d036700 1 -- 172.21.15.79:0/220490849 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14004030 con 0x7f2d180b19a0 2022-12-01T09:45:27.444 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.425+0000 7f2d1d036700 1 -- 172.21.15.79:0/220490849 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d140043c0 con 0x7f2d180b19a0 2022-12-01T09:45:27.445 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.426+0000 7f2d2029c700 1 -- 172.21.15.79:0/220490849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 msgr2=0x7f2d1815cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.445 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.426+0000 7f2d2029c700 1 --2- 172.21.15.79:0/220490849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 0x7f2d1815cd30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009820 tx=0x7f2d14009b30 comp rx=0 tx=0).stop 2022-12-01T09:45:27.445 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.426+0000 7f2d2029c700 1 -- 172.21.15.79:0/220490849 shutdown_connections 2022-12-01T09:45:27.445 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.426+0000 7f2d2029c700 1 --2- 172.21.15.79:0/220490849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 0x7f2d1815cd30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.445 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.426+0000 7f2d2029c700 1 -- 172.21.15.79:0/220490849 >> 172.21.15.79:0/220490849 conn(0x7f2d1806c530 msgr2=0x7f2d1806c930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:27.446 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.426+0000 7f2d2029c700 1 -- 172.21.15.79:0/220490849 shutdown_connections 2022-12-01T09:45:27.446 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.426+0000 7f2d2029c700 1 -- 172.21.15.79:0/220490849 wait complete. 2022-12-01T09:45:27.446 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.427+0000 7f2d2029c700 1 Processor -- start 2022-12-01T09:45:27.446 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.427+0000 7f2d2029c700 1 -- start start 2022-12-01T09:45:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d2029c700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2d180b0de0 0x7f2d180b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d2029c700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2d180b11b0 0x7f2d18145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d2029c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 0x7f2d180b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d2029c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d181e6ce0 con 0x7f2d180b19a0 2022-12-01T09:45:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d2029c700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d181e66f0 con 0x7f2d180b11b0 2022-12-01T09:45:27.448 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d2029c700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18146450 con 0x7f2d180b0de0 2022-12-01T09:45:27.448 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e839700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 0x7f2d180b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.448 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e839700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 0x7f2d180b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47444/0 (socket says 172.21.15.79:47444) 2022-12-01T09:45:27.448 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e038700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2d180b0de0 0x7f2d180b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.449 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e839700 1 -- 172.21.15.79:0/362326410 learned_addr learned my addr 172.21.15.79:0/362326410 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:27.449 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1d837700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2d180b11b0 0x7f2d18145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.449 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e839700 1 -- 172.21.15.79:0/362326410 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2d180b0de0 msgr2=0x7f2d180b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.449 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e839700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2d180b0de0 0x7f2d180b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.449 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e839700 1 -- 172.21.15.79:0/362326410 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2d180b11b0 msgr2=0x7f2d18145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.450 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e839700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2d180b11b0 0x7f2d18145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.450 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e839700 1 -- 172.21.15.79:0/362326410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d14009430 con 0x7f2d180b19a0 2022-12-01T09:45:27.450 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d1e839700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 0x7f2d180b2270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000b970 tx=0x7f2d1000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:27.450 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d06ffd700 1 -- 172.21.15.79:0/362326410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000d860 con 0x7f2d180b19a0 2022-12-01T09:45:27.451 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d06ffd700 1 -- 172.21.15.79:0/362326410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1000d9c0 con 0x7f2d180b19a0 2022-12-01T09:45:27.451 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d18146730 con 0x7f2d180b19a0 2022-12-01T09:45:27.451 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.428+0000 7f2d06ffd700 1 -- 172.21.15.79:0/362326410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000dd70 con 0x7f2d180b19a0 2022-12-01T09:45:27.451 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.429+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d18156bb0 con 0x7f2d180b19a0 2022-12-01T09:45:27.452 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.429+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d181e6e20 con 0x7f2d180b19a0 2022-12-01T09:45:27.452 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.430+0000 7f2d06ffd700 1 -- 172.21.15.79:0/362326410 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f2d1000e430 con 0x7f2d180b19a0 2022-12-01T09:45:27.452 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.430+0000 7f2d06ffd700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f2cf8066540 0x7f2cf80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.452 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.430+0000 7f2d06ffd700 1 -- 172.21.15.79:0/362326410 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2d10083630 con 0x7f2d180b19a0 2022-12-01T09:45:27.453 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.430+0000 7f2d1e038700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f2cf8066540 0x7f2cf80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.453 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.431+0000 7f2d1e038700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f2cf8066540 0x7f2cf80689f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d08000f60 tx=0x7f2d08007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:27.453 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.435+0000 7f2d06ffd700 1 -- 172.21.15.79:0/362326410 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f2d181e6e20 con 0x7f2d180b19a0 2022-12-01T09:45:27.623 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.618+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d181e6e20 con 0x7f2d180b19a0 2022-12-01T09:45:27.623 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.619+0000 7f2d06ffd700 1 -- 172.21.15.79:0/362326410 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d181e6e20 con 0x7f2d180b19a0 2022-12-01T09:45:27.624 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2022-12-01T09:45:27.626 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f2cf8066540 msgr2=0x7f2cf80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.627 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f2cf8066540 0x7f2cf80689f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d08000f60 tx=0x7f2d08007e70 comp rx=0 tx=0).stop 2022-12-01T09:45:27.627 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 msgr2=0x7f2d180b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.628 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 0x7f2d180b2270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000b970 tx=0x7f2d1000bc80 comp rx=0 tx=0).stop 2022-12-01T09:45:27.628 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 shutdown_connections 2022-12-01T09:45:27.629 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f2cf8066540 0x7f2cf80689f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.629 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d180b19a0 0x7f2d180b2270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.629 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2d180b0de0 0x7f2d180b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.630 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 --2- 172.21.15.79:0/362326410 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2d180b11b0 0x7f2d18145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.630 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 >> 172.21.15.79:0/362326410 conn(0x7f2d1806c530 msgr2=0x7f2d1806c900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:27.631 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 shutdown_connections 2022-12-01T09:45:27.631 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.621+0000 7f2d2029c700 1 -- 172.21.15.79:0/362326410 wait complete. 2022-12-01T09:45:27.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-12-01T09:45:27.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.757+0000 7f473bce6700 1 Processor -- start 2022-12-01T09:45:27.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.757+0000 7f473bce6700 1 -- start start 2022-12-01T09:45:27.771 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f473bce6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f473415efd0 0x7f47340ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.772 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f473bce6700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f473415f3a0 0x7f47340b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.772 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f473bce6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340cec70 con 0x7f47340d1ee0 2022-12-01T09:45:27.772 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f473bce6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47340ce900 con 0x7f473415efd0 2022-12-01T09:45:27.772 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f473bce6700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47340cf760 con 0x7f473415f3a0 2022-12-01T09:45:27.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f4739a82700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f473415efd0 0x7f47340ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f4739281700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f47340d1ee0 0x7f47340cff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39614/0 (socket says 172.21.15.79:39614) 2022-12-01T09:45:27.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f4739281700 1 -- 172.21.15.79:0/7518985 learned_addr learned my addr 172.21.15.79:0/7518985 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:27.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f473a283700 1 --2- 172.21.15.79:0/7518985 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f473415f3a0 0x7f47340b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.774 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f4739a82700 1 -- 172.21.15.79:0/7518985 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f473415f3a0 msgr2=0x7f47340b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:27.774 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f4739a82700 1 --2- 172.21.15.79:0/7518985 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f473415f3a0 0x7f47340b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.774 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f4739a82700 1 -- 172.21.15.79:0/7518985 >> v1:172.21.15.79:6789/0 conn(0x7f47340d1ee0 legacy=0x7f47340cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.774 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f4739a82700 1 -- 172.21.15.79:0/7518985 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340ceec0 con 0x7f473415efd0 2022-12-01T09:45:27.774 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f4738a80700 1 -- 172.21.15.79:0/7518985 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941784979 0 0) 0x7f47340cec70 con 0x7f47340d1ee0 2022-12-01T09:45:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.758+0000 7f4739a82700 1 --2- 172.21.15.79:0/7518985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415efd0 0x7f47340ce3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4730009840 tx=0x7f4730009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29ce4c26a6c6c20 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f4738a80700 1 -- 172.21.15.79:0/7518985 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011830 con 0x7f473415efd0 2022-12-01T09:45:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f4738a80700 1 -- 172.21.15.79:0/7518985 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730011990 con 0x7f473415efd0 2022-12-01T09:45:27.775 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f4738a80700 1 -- 172.21.15.79:0/7518985 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011d20 con 0x7f473415efd0 2022-12-01T09:45:27.776 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f473bce6700 1 -- 172.21.15.79:0/7518985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415efd0 msgr2=0x7f47340ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.776 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f473bce6700 1 --2- 172.21.15.79:0/7518985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415efd0 0x7f47340ce3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4730009840 tx=0x7f4730009b50 comp rx=0 tx=0).stop 2022-12-01T09:45:27.776 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f473bce6700 1 -- 172.21.15.79:0/7518985 shutdown_connections 2022-12-01T09:45:27.776 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f473bce6700 1 --2- 172.21.15.79:0/7518985 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f473415f3a0 0x7f47340b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.776 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f473bce6700 1 --2- 172.21.15.79:0/7518985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415efd0 0x7f47340ce3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f473bce6700 1 -- 172.21.15.79:0/7518985 >> 172.21.15.79:0/7518985 conn(0x7f473409b620 msgr2=0x7f47340d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f473bce6700 1 -- 172.21.15.79:0/7518985 shutdown_connections 2022-12-01T09:45:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.759+0000 7f473bce6700 1 -- 172.21.15.79:0/7518985 wait complete. 2022-12-01T09:45:27.777 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.760+0000 7f473bce6700 1 Processor -- start 2022-12-01T09:45:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.760+0000 7f473bce6700 1 -- start start 2022-12-01T09:45:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473bce6700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47340d1ee0 0x7f47341f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473bce6700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f473415efd0 0x7f47341f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473bce6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415f3a0 0x7f47341f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.778 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473bce6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47341f18c0 con 0x7f473415f3a0 2022-12-01T09:45:27.779 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473bce6700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4734155cf0 con 0x7f473415efd0 2022-12-01T09:45:27.779 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473bce6700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47341550e0 con 0x7f47340d1ee0 2022-12-01T09:45:27.779 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473a283700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415f3a0 0x7f47341f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.779 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f4739a82700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47340d1ee0 0x7f47341f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.780 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473a283700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415f3a0 0x7f47341f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47468/0 (socket says 172.21.15.79:47468) 2022-12-01T09:45:27.780 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473a283700 1 -- 172.21.15.79:0/3586276466 learned_addr learned my addr 172.21.15.79:0/3586276466 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:27.780 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f4739281700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f473415efd0 0x7f47341f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.780 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473a283700 1 -- 172.21.15.79:0/3586276466 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47340d1ee0 msgr2=0x7f47341f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.780 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473a283700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47340d1ee0 0x7f47341f0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473a283700 1 -- 172.21.15.79:0/3586276466 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f473415efd0 msgr2=0x7f47341f1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.761+0000 7f473a283700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f473415efd0 0x7f47341f1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.762+0000 7f473a283700 1 -- 172.21.15.79:0/3586276466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300094a0 con 0x7f473415f3a0 2022-12-01T09:45:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.762+0000 7f473a283700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415f3a0 0x7f47341f4b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f472c007e40 tx=0x7f472c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:27.781 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.762+0000 7f47227fc700 1 -- 172.21.15.79:0/3586276466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00ed30 con 0x7f473415f3a0 2022-12-01T09:45:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.762+0000 7f47227fc700 1 -- 172.21.15.79:0/3586276466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c014420 con 0x7f473415f3a0 2022-12-01T09:45:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.762+0000 7f47227fc700 1 -- 172.21.15.79:0/3586276466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c0147d0 con 0x7f473415f3a0 2022-12-01T09:45:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.762+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47341553c0 con 0x7f473415f3a0 2022-12-01T09:45:27.782 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.762+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4734155980 con 0x7f473415f3a0 2022-12-01T09:45:27.783 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.763+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4734155e80 con 0x7f473415f3a0 2022-12-01T09:45:27.783 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.763+0000 7f47227fc700 1 -- 172.21.15.79:0/3586276466 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f472c012050 con 0x7f473415f3a0 2022-12-01T09:45:27.783 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.763+0000 7f47227fc700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f4714066540 0x7f47140689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:27.783 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.764+0000 7f4739a82700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f4714066540 0x7f47140689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:27.784 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.764+0000 7f47227fc700 1 -- 172.21.15.79:0/3586276466 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f472c0839a0 con 0x7f473415f3a0 2022-12-01T09:45:27.784 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.764+0000 7f4739a82700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f4714066540 0x7f47140689f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f47300090b0 tx=0x7f4730008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:27.784 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.768+0000 7f47227fc700 1 -- 172.21.15.79:0/3586276466 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f472c051450 con 0x7f473415f3a0 2022-12-01T09:45:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.992+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47340669f0 con 0x7f473415f3a0 2022-12-01T09:45:27.996 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.992+0000 7f47227fc700 1 -- 172.21.15.79:0/3586276466 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f472c054a70 con 0x7f473415f3a0 2022-12-01T09:45:27.997 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:45:27.997 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6834/3261390248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6832","nonce":3261390248},{"type":"v1","addr":"172.21.15.182:6834","nonce":3261390248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.182:6835/4152966632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6833","nonce":4152966632},{"type":"v1","addr":"172.21.15.182:6835","nonce":4152966632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1126569580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1126569580},{"type":"v1","addr":"172.21.15.79:6835","nonce":1126569580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2832834523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2832834523},{"type":"v1","addr":"172.21.15.79:6837","nonce":2832834523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-12-01T09:45:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f4714066540 msgr2=0x7f47140689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f4714066540 0x7f47140689f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f47300090b0 tx=0x7f4730008030 comp rx=0 tx=0).stop 2022-12-01T09:45:27.999 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415f3a0 msgr2=0x7f47341f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415f3a0 0x7f47341f4b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f472c007e40 tx=0x7f472c00e3c0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 shutdown_connections 2022-12-01T09:45:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f4714066540 0x7f47140689f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473415f3a0 0x7f47341f4b40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.000 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f47340d1ee0 0x7f47341f0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 --2- 172.21.15.79:0/3586276466 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f473415efd0 0x7f47341f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 >> 172.21.15.79:0/3586276466 conn(0x7f473409b620 msgr2=0x7f4734154510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 shutdown_connections 2022-12-01T09:45:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:27.994+0000 7f473bce6700 1 -- 172.21.15.79:0/3586276466 wait complete. 2022-12-01T09:45:28.001 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 3 2022-12-01T09:45:28.011 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-12-01T09:45:28.133 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.129+0000 7f7668499700 1 Processor -- start 2022-12-01T09:45:28.133 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.129+0000 7f7668499700 1 -- start start 2022-12-01T09:45:28.136 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.130+0000 7f7668499700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600ae5a0 0x7f76600c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.136 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.130+0000 7f7668499700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f766006c930 0x7f766015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.130+0000 7f7668499700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766015d4f0 con 0x7f76600b0b50 2022-12-01T09:45:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.130+0000 7f7668499700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600ae970 con 0x7f766006c930 2022-12-01T09:45:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.130+0000 7f7668499700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7660158ed0 con 0x7f76600ae5a0 2022-12-01T09:45:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.130+0000 7f7665a34700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f766006c930 0x7f766015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.130+0000 7f7665a34700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f766006c930 0x7f766015cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47478/0 (socket says 172.21.15.79:47478) 2022-12-01T09:45:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.130+0000 7f7665a34700 1 -- 172.21.15.79:0/1294733120 learned_addr learned my addr 172.21.15.79:0/1294733120 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:28.138 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.131+0000 7f7666235700 1 --2- 172.21.15.79:0/1294733120 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600ae5a0 0x7f76600c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.139 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.131+0000 7f7665a34700 1 -- 172.21.15.79:0/1294733120 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600ae5a0 msgr2=0x7f76600c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:28.139 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.131+0000 7f7665a34700 1 --2- 172.21.15.79:0/1294733120 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600ae5a0 0x7f76600c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.139 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.131+0000 7f7665a34700 1 -- 172.21.15.79:0/1294733120 >> v1:172.21.15.182:6789/0 conn(0x7f76600b0b50 legacy=0x7f76600701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.139 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.131+0000 7f7665a34700 1 -- 172.21.15.79:0/1294733120 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600cdad0 con 0x7f766006c930 2022-12-01T09:45:28.140 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.131+0000 7f7665a34700 1 --2- 172.21.15.79:0/1294733120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 0x7f766015cfb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f765c0098f0 tx=0x7f765c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9519634a1727f5df server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:28.140 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.131+0000 7f7665233700 1 -- 172.21.15.79:0/1294733120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c011830 con 0x7f766006c930 2022-12-01T09:45:28.140 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.131+0000 7f7665233700 1 -- 172.21.15.79:0/1294733120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c011990 con 0x7f766006c930 2022-12-01T09:45:28.140 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.131+0000 7f7665233700 1 -- 172.21.15.79:0/1294733120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c011d20 con 0x7f766006c930 2022-12-01T09:45:28.140 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.132+0000 7f7668499700 1 -- 172.21.15.79:0/1294733120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 msgr2=0x7f766015cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.132+0000 7f7668499700 1 --2- 172.21.15.79:0/1294733120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 0x7f766015cfb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f765c0098f0 tx=0x7f765c009c00 comp rx=0 tx=0).stop 2022-12-01T09:45:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.132+0000 7f7668499700 1 -- 172.21.15.79:0/1294733120 shutdown_connections 2022-12-01T09:45:28.141 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.132+0000 7f7668499700 1 --2- 172.21.15.79:0/1294733120 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600ae5a0 0x7f76600c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.132+0000 7f7668499700 1 --2- 172.21.15.79:0/1294733120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 0x7f766015cfb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.132+0000 7f7668499700 1 -- 172.21.15.79:0/1294733120 >> 172.21.15.79:0/1294733120 conn(0x7f76600cbb50 msgr2=0x7f76600cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.132+0000 7f7668499700 1 -- 172.21.15.79:0/1294733120 shutdown_connections 2022-12-01T09:45:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.132+0000 7f7668499700 1 -- 172.21.15.79:0/1294733120 wait complete. 2022-12-01T09:45:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.133+0000 7f7668499700 1 Processor -- start 2022-12-01T09:45:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.133+0000 7f7668499700 1 -- start start 2022-12-01T09:45:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7668499700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 0x7f766015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.150 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7668499700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76600ae5a0 0x7f76600c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.150 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7668499700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600b0b50 0x7f76600c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.150 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7668499700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76601ef1f0 con 0x7f766006c930 2022-12-01T09:45:28.151 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7668499700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76601ef4d0 con 0x7f76600ae5a0 2022-12-01T09:45:28.151 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7668499700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76601ef7b0 con 0x7f76600b0b50 2022-12-01T09:45:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666235700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 0x7f766015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666235700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 0x7f766015bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47484/0 (socket says 172.21.15.79:47484) 2022-12-01T09:45:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666235700 1 -- 172.21.15.79:0/3159617251 learned_addr learned my addr 172.21.15.79:0/3159617251 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7665a34700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76600ae5a0 0x7f76600c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666a36700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600b0b50 0x7f76600c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666235700 1 -- 172.21.15.79:0/3159617251 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600b0b50 msgr2=0x7f76600c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666235700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600b0b50 0x7f76600c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.154 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666235700 1 -- 172.21.15.79:0/3159617251 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76600ae5a0 msgr2=0x7f76600c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.154 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666235700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76600ae5a0 0x7f76600c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.154 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666235700 1 -- 172.21.15.79:0/3159617251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c009550 con 0x7f766006c930 2022-12-01T09:45:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666a36700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600b0b50 0x7f76600c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:45:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7666235700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 0x7f766015bad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9b0 tx=0x7f765000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f764effd700 1 -- 172.21.15.79:0/3159617251 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650009710 con 0x7f766006c930 2022-12-01T09:45:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f764effd700 1 -- 172.21.15.79:0/3159617251 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765000c850 con 0x7f766006c930 2022-12-01T09:45:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76601efa90 con 0x7f766006c930 2022-12-01T09:45:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f764effd700 1 -- 172.21.15.79:0/3159617251 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000cbc0 con 0x7f766006c930 2022-12-01T09:45:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.134+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76601efd70 con 0x7f766006c930 2022-12-01T09:45:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.135+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76600b5050 con 0x7f766006c930 2022-12-01T09:45:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.136+0000 7f764effd700 1 -- 172.21.15.79:0/3159617251 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f7650019030 con 0x7f766006c930 2022-12-01T09:45:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.136+0000 7f764effd700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7640066590 0x7f7640068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.136+0000 7f7665a34700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7640066590 0x7f7640068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.136+0000 7f764effd700 1 -- 172.21.15.79:0/3159617251 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7650083380 con 0x7f766006c930 2022-12-01T09:45:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.136+0000 7f7665a34700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7640066590 0x7f7640068a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f766006cd80 tx=0x7f765c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:28.158 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.140+0000 7f764effd700 1 -- 172.21.15.79:0/3159617251 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f7650050de0 con 0x7f766006c930 2022-12-01T09:45:28.325 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.321+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76600cc990 con 0x7f766006c930 2022-12-01T09:45:28.326 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.322+0000 7f764effd700 1 -- 172.21.15.79:0/3159617251 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13742 (secure 0 0 0) 0x7f7650054400 con 0x7f766006c930 2022-12-01T09:45:28.327 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:45:28.327 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"fsid":"e7b489bb-0e60-496d-af31-008ef9057b43","created":"2022-12-01T09:45:13.521007+0000","modified":"2022-12-01T09:45:27.560952+0000","last_up_change":"2022-12-01T09:45:24.327099+0000","last_in_change":"2022-12-01T09:45:15.995963+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-12-01T09:45:24.783893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-12-01T09:45:25.222303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f65efd56-e00f-4915-a254-99ba3bad5ca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":101315},{"type":"v1","addr":"172.21.15.79:6809","nonce":101315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":101315},{"type":"v1","addr":"172.21.15.79:6811","nonce":101315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":101315},{"type":"v1","addr":"172.21.15.79:6815","nonce":101315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":101315},{"type":"v1","addr":"172.21.15.79:6813","nonce":101315}]},"public_addr":"172.21.15.79:6809/101315","cluster_addr":"172.21.15.79:6811/101315","heartbeat_back_addr":"172.21.15.79:6815/101315","heartbeat_front_addr":"172.21.15.79:6813/101315","state":["exists","up"]},{"osd":1,"uuid":"51034ab5-541d-48e6-957b-d23ba4bf28d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":101318},{"type":"v1","addr":"172.21.15.79:6825","nonce":101318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":101318},{"type":"v1","addr":"172.21.15.79:6827","nonce":101318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":101318},{"type":"v1","addr":"172.21.15.79:6831","nonce":101318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":101318},{"type":"v1","addr":"172.21.15.79:6829","nonce":101318}]},"public_addr":"172.21.15.79:6825/101318","cluster_addr":"172.21.15.79:6827/101318","heartbeat_back_addr":"172.21.15.79:6831/101318","heartbeat_front_addr":"172.21.15.79:6829/101318","state":["exists","up"]},{"osd":2,"uuid":"83191444-237f-49fc-9046-58c92f1d68f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":101319},{"type":"v1","addr":"172.21.15.79:6817","nonce":101319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":101319},{"type":"v1","addr":"172.21.15.79:6819","nonce":101319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":101319},{"type":"v1","addr":"172.21.15.79:6823","nonce":101319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":101319},{"type":"v1","addr":"172.21.15.79:6821","nonce":101319}]},"public_addr":"172.21.15.79:6817/101319","cluster_addr":"172.21.15.79:6819/101319","heartbeat_back_addr":"172.21.15.79:6823/101319","heartbeat_front_addr":"172.21.15.79:6821/101319","state":["exists","up"]},{"osd":3,"uuid":"b5c70400-233c-43e1-9dc9-436eda906f14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":101317},{"type":"v1","addr":"172.21.15.79:6801","nonce":101317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":101317},{"type":"v1","addr":"172.21.15.79:6803","nonce":101317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":101317},{"type":"v1","addr":"172.21.15.79:6807","nonce":101317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":101317},{"type":"v1","addr":"172.21.15.79:6805","nonce":101317}]},"public_addr":"172.21.15.79:6801/101317","cluster_addr":"172.21.15.79:6803/101317","heartbeat_back_addr":"172.21.15.79:6807/101317","heartbeat_front_addr":"172.21.15.79:6805/101317","state":["exists","up"]},{"osd":4,"uuid":"9acb459b-66e7-4eb2-b2cf-19eac220adfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":101591},{"type":"v1","addr":"172.21.15.182:6801","nonce":101591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":101591},{"type":"v1","addr":"172.21.15.182:6803","nonce":101591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":101591},{"type":"v1","addr":"172.21.15.182:6807","nonce":101591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":101591},{"type":"v1","addr":"172.21.15.182:6805","nonce":101591}]},"public_addr":"172.21.15.182:6801/101591","cluster_addr":"172.21.15.182:6803/101591","heartbeat_back_addr":"172.21.15.182:6807/101591","heartbeat_front_addr":"172.21.15.182:6805/101591","state":["exists","up"]},{"osd":5,"uuid":"dc64787f-8edc-4941-9746-94a17af0662b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":101592},{"type":"v1","addr":"172.21.15.182:6809","nonce":101592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":101592},{"type":"v1","addr":"172.21.15.182:6811","nonce":101592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":101592},{"type":"v1","addr":"172.21.15.182:6815","nonce":101592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":101592},{"type":"v1","addr":"172.21.15.182:6813","nonce":101592}]},"public_addr":"172.21.15.182:6809/101592","cluster_addr":"172.21.15.182:6811/101592","heartbeat_back_addr":"172.21.15.182:6815/101592","heartbeat_front_addr":"172.21.15.182:6813/101592","state":["exists","up"]},{"osd":6,"uuid":"f0dee44e-bffd-4740-912f-94193d3fe5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":101593},{"type":"v1","addr":"172.21.15.182:6817","nonce":101593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6818","nonce":101593},{"type":"v1","addr":"172.21.15.182:6819","nonce":101593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6822","nonce":101593},{"type":"v1","addr":"172.21.15.182:6823","nonce":101593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":101593},{"type":"v1","addr":"172.21.15.182:6821","nonce":101593}]},"public_addr":"172.21.15.182:6817/101593","cluster_addr":"172.21.15.182:6819/101593","heartbeat_back_addr":"172.21.15.182:6823/101593","heartbeat_front_addr":"172.21.15.182:6821/101593","state":["exists","up"]},{"osd":7,"uuid":"dae7edb0-c2ae-45c2-8103-49ba8af5267e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":101636},{"type":"v1","addr":"172.21.15.182:6825","nonce":101636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":101636},{"type":"v1","addr":"172.21.15.182:6827","nonce":101636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":101636},{"type":"v1","addr":"172.21.15.182:6831","nonce":101636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6828","nonce":101636},{"type":"v1","addr":"172.21.15.182:6829","nonce":101636}]},"public_addr":"172.21.15.182:6825/101636","cluster_addr":"172.21.15.182:6827/101636","heartbeat_back_addr":"172.21.15.182:6831/101636","heartbeat_front_addr":"172.21.15.182:6829/101636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.260123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.184586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.221041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.189293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.166735+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.215218+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.228323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:45:21.219368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:45:28.328 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7640066590 msgr2=0x7f7640068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.329 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7640066590 0x7f7640068a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f766006cd80 tx=0x7f765c008030 comp rx=0 tx=0).stop 2022-12-01T09:45:28.329 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 msgr2=0x7f766015bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.329 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 0x7f766015bad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9b0 tx=0x7f765000ecc0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.329 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 shutdown_connections 2022-12-01T09:45:28.330 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7640066590 0x7f7640068a40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.330 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f76600b0b50 0x7f76600c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.330 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f766006c930 0x7f766015bad0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.330 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 --2- 172.21.15.79:0/3159617251 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f76600ae5a0 0x7f76600c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.331 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 >> 172.21.15.79:0/3159617251 conn(0x7f76600cbb50 msgr2=0x7f76601582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:28.331 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 shutdown_connections 2022-12-01T09:45:28.331 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.324+0000 7f7668499700 1 -- 172.21.15.79:0/3159617251 wait complete. 2022-12-01T09:45:28.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-12-01T09:45:24.783893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2022-12-01T09:45:25.222303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-12-01T09:45:28.341 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-12-01T09:45:28.464 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.460+0000 7fc414458700 1 Processor -- start 2022-12-01T09:45:28.464 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.460+0000 7fc414458700 1 -- start start 2022-12-01T09:45:28.467 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc414458700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc40c15be80 0x7fc40c0ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.467 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc414458700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c15c250 0x7fc40c0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.468 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc414458700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c0cd550 con 0x7fc40c0cd040 2022-12-01T09:45:28.468 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc414458700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0cd830 con 0x7fc40c15be80 2022-12-01T09:45:28.468 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc414458700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0cdb10 con 0x7fc40c15c250 2022-12-01T09:45:28.468 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4119f3700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c15c250 0x7fc40c0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.469 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4121f4700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc40c15be80 0x7fc40c0ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.469 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4119f3700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c15c250 0x7fc40c0ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3301/0 says I am v2:172.21.15.79:44672/0 (socket says 172.21.15.79:44672) 2022-12-01T09:45:28.469 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4119f3700 1 -- 172.21.15.79:0/2972015561 learned_addr learned my addr 172.21.15.79:0/2972015561 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:28.469 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4121f4700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fc40c15be80 0x7fc40c0ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.79:36402/0 (socket says 172.21.15.79:36402) 2022-12-01T09:45:28.470 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4121f4700 1 -- 172.21.15.79:0/2972015561 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c15c250 msgr2=0x7fc40c0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:28.470 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4121f4700 1 --2- 172.21.15.79:0/2972015561 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c15c250 0x7fc40c0ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.470 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4121f4700 1 -- 172.21.15.79:0/2972015561 >> v1:172.21.15.182:6789/0 conn(0x7fc40c0cd040 legacy=0x7fc40c0d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.470 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4111f2700 1 -- 172.21.15.79:0/2972015561 <== mon.1 v1:172.21.15.182:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466386265 0 0) 0x7fc40c0cd550 con 0x7fc40c0cd040 2022-12-01T09:45:28.471 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4121f4700 1 -- 172.21.15.79:0/2972015561 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c0cddf0 con 0x7fc40c15be80 2022-12-01T09:45:28.471 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4119f3700 1 --2- 172.21.15.79:0/2972015561 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c15c250 0x7fc40c0ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:28.471 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.461+0000 7fc4121f4700 1 --2- 172.21.15.79:0/2972015561 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 0x7fc40c0ce5f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc408009820 tx=0x7fc408009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8a3291f5d61574 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:28.471 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc4111f2700 1 -- 172.21.15.79:0/2972015561 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408005e30 con 0x7fc40c15be80 2022-12-01T09:45:28.472 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc4111f2700 1 -- 172.21.15.79:0/2972015561 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc408006030 con 0x7fc40c15be80 2022-12-01T09:45:28.472 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc4111f2700 1 -- 172.21.15.79:0/2972015561 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4080063c0 con 0x7fc40c15be80 2022-12-01T09:45:28.472 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc414458700 1 -- 172.21.15.79:0/2972015561 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 msgr2=0x7fc40c0ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.472 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc414458700 1 --2- 172.21.15.79:0/2972015561 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 0x7fc40c0ce5f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc408009820 tx=0x7fc408009b30 comp rx=0 tx=0).stop 2022-12-01T09:45:28.472 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc414458700 1 -- 172.21.15.79:0/2972015561 shutdown_connections 2022-12-01T09:45:28.473 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc414458700 1 --2- 172.21.15.79:0/2972015561 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 0x7fc40c0ce5f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.473 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc414458700 1 --2- 172.21.15.79:0/2972015561 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c15c250 0x7fc40c0ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.473 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc414458700 1 -- 172.21.15.79:0/2972015561 >> 172.21.15.79:0/2972015561 conn(0x7fc40c0713e0 msgr2=0x7fc40c09b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:28.473 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc414458700 1 -- 172.21.15.79:0/2972015561 shutdown_connections 2022-12-01T09:45:28.474 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.462+0000 7fc414458700 1 -- 172.21.15.79:0/2972015561 wait complete. 2022-12-01T09:45:28.474 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.463+0000 7fc414458700 1 Processor -- start 2022-12-01T09:45:28.474 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.463+0000 7fc414458700 1 -- start start 2022-12-01T09:45:28.477 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc414458700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c0cd040 0x7fc40c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.477 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc414458700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 0x7fc40c15c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.477 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc414458700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c15c250 0x7fc40c15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc414458700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0b4440 con 0x7fc40c15c250 2022-12-01T09:45:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc414458700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c15e830 con 0x7fc40c15be80 2022-12-01T09:45:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc414458700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c15eb10 con 0x7fc40c0cd040 2022-12-01T09:45:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4129f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c15c250 0x7fc40c15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4119f3700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 0x7fc40c15c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4121f4700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c0cd040 0x7fc40c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4129f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c15c250 0x7fc40c15cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47502/0 (socket says 172.21.15.79:47502) 2022-12-01T09:45:28.479 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4129f5700 1 -- 172.21.15.79:0/2681820914 learned_addr learned my addr 172.21.15.79:0/2681820914 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:28.480 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4121f4700 1 -- 172.21.15.79:0/2681820914 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 msgr2=0x7fc40c15c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.480 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4121f4700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 0x7fc40c15c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.480 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4121f4700 1 -- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c15c250 msgr2=0x7fc40c15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4121f4700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c15c250 0x7fc40c15cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4121f4700 1 -- 172.21.15.79:0/2681820914 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc009550 con 0x7fc40c0cd040 2022-12-01T09:45:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4119f3700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 0x7fc40c15c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.464+0000 7fc4129f5700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c15c250 0x7fc40c15cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.465+0000 7fc4121f4700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c0cd040 0x7fc40c0b39e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc408015000 tx=0x7fc408004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.465+0000 7fc3faffd700 1 -- 172.21.15.79:0/2681820914 <== mon.2 v2:172.21.15.182:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4080063a0 con 0x7fc40c0cd040 2022-12-01T09:45:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.465+0000 7fc3faffd700 1 -- 172.21.15.79:0/2681820914 <== mon.2 v2:172.21.15.182:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc408006500 con 0x7fc40c0cd040 2022-12-01T09:45:28.482 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.465+0000 7fc3faffd700 1 -- 172.21.15.79:0/2681820914 <== mon.2 v2:172.21.15.182:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408006890 con 0x7fc40c0cd040 2022-12-01T09:45:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.465+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc408009430 con 0x7fc40c0cd040 2022-12-01T09:45:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.465+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c0b1cf0 con 0x7fc40c0cd040 2022-12-01T09:45:28.483 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.466+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c0d3360 con 0x7fc40c0cd040 2022-12-01T09:45:28.484 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.466+0000 7fc3faffd700 1 -- 172.21.15.79:0/2681820914 <== mon.2 v2:172.21.15.182:3301/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fc40800f050 con 0x7fc40c0cd040 2022-12-01T09:45:28.484 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.466+0000 7fc3faffd700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ec066590 0x7fc3ec068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.484 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.467+0000 7fc3faffd700 1 -- 172.21.15.79:0/2681820914 <== mon.2 v2:172.21.15.182:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc408084db0 con 0x7fc40c0cd040 2022-12-01T09:45:28.484 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.467+0000 7fc4119f3700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ec066590 0x7fc3ec068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.484 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.467+0000 7fc4119f3700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ec066590 0x7fc3ec068a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc40c1f5aa0 tx=0x7fc3fc0092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:28.485 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.471+0000 7fc3faffd700 1 -- 172.21.15.79:0/2681820914 <== mon.2 v2:172.21.15.182:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7fc408052730 con 0x7fc40c0cd040 2022-12-01T09:45:28.653 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.649+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc40c0b1870 con 0x7fc40c0cd040 2022-12-01T09:45:28.653 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.649+0000 7fc3faffd700 1 -- 172.21.15.79:0/2681820914 <== mon.2 v2:172.21.15.182:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc40c0b1870 con 0x7fc40c0cd040 2022-12-01T09:45:28.654 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2022-12-01T09:45:28.656 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ec066590 msgr2=0x7fc3ec068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.656 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ec066590 0x7fc3ec068a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc40c1f5aa0 tx=0x7fc3fc0092c0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.656 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c0cd040 msgr2=0x7fc40c0b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.656 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c0cd040 0x7fc40c0b39e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc408015000 tx=0x7fc408004750 comp rx=0 tx=0).stop 2022-12-01T09:45:28.657 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 shutdown_connections 2022-12-01T09:45:28.657 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fc3ec066590 0x7fc3ec068a40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.657 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c15c250 0x7fc40c15cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.658 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fc40c0cd040 0x7fc40c0b39e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.658 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 --2- 172.21.15.79:0/2681820914 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fc40c15be80 0x7fc40c15c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.658 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 >> 172.21.15.79:0/2681820914 conn(0x7fc40c0713e0 msgr2=0x7fc40c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:28.658 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 shutdown_connections 2022-12-01T09:45:28.659 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.651+0000 7fc414458700 1 -- 172.21.15.79:0/2681820914 wait complete. 2022-12-01T09:45:28.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-12-01T09:45:28.790 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.786+0000 7f5c854dd700 1 Processor -- start 2022-12-01T09:45:28.790 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.786+0000 7f5c854dd700 1 -- start start 2022-12-01T09:45:28.793 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c854dd700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f5c800d2a50 0x7f5c800cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.793 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c854dd700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800cffe0 0x7f5c800d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.794 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c854dd700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8015c4d0 con 0x7f5c8015cb70 2022-12-01T09:45:28.794 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c854dd700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c800cedd0 con 0x7f5c800d2a50 2022-12-01T09:45:28.794 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c854dd700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800d2f60 con 0x7f5c800cffe0 2022-12-01T09:45:28.794 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7e7fc700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f5c800d2a50 0x7f5c800cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.795 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7f7fe700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800cffe0 0x7f5c800d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.795 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7e7fc700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f5c800d2a50 0x7f5c800cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.182:3300/0 says I am v2:172.21.15.79:36418/0 (socket says 172.21.15.79:36418) 2022-12-01T09:45:28.795 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7e7fc700 1 -- 172.21.15.79:0/1461175451 learned_addr learned my addr 172.21.15.79:0/1461175451 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:28.796 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7e7fc700 1 -- 172.21.15.79:0/1461175451 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800cffe0 msgr2=0x7f5c800d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:28.796 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7e7fc700 1 --2- 172.21.15.79:0/1461175451 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800cffe0 0x7f5c800d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.796 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7e7fc700 1 -- 172.21.15.79:0/1461175451 >> v1:172.21.15.182:6789/0 conn(0x7f5c8015cb70 legacy=0x7f5c800d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.796 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7e7fc700 1 -- 172.21.15.79:0/1461175451 --> v2:172.21.15.182:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800cf3e0 con 0x7f5c800d2a50 2022-12-01T09:45:28.796 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7f7fe700 1 --2- 172.21.15.79:0/1461175451 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800cffe0 0x7f5c800d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:45:28.797 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.787+0000 7f5c7e7fc700 1 --2- 172.21.15.79:0/1461175451 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5c800d2a50 0x7f5c800cf870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c700098f0 tx=0x7f5c70009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d72fc31da4adc50 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:28.797 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c7dffb700 1 -- 172.21.15.79:0/1461175451 <== mon.1 v2:172.21.15.182:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70011830 con 0x7f5c800d2a50 2022-12-01T09:45:28.797 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c7dffb700 1 -- 172.21.15.79:0/1461175451 <== mon.1 v2:172.21.15.182:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70011990 con 0x7f5c800d2a50 2022-12-01T09:45:28.797 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c7dffb700 1 -- 172.21.15.79:0/1461175451 <== mon.1 v2:172.21.15.182:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70011d20 con 0x7f5c800d2a50 2022-12-01T09:45:28.798 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c854dd700 1 -- 172.21.15.79:0/1461175451 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5c800d2a50 msgr2=0x7f5c800cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.798 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c854dd700 1 --2- 172.21.15.79:0/1461175451 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5c800d2a50 0x7f5c800cf870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c700098f0 tx=0x7f5c70009c00 comp rx=0 tx=0).stop 2022-12-01T09:45:28.799 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c854dd700 1 -- 172.21.15.79:0/1461175451 shutdown_connections 2022-12-01T09:45:28.799 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c854dd700 1 --2- 172.21.15.79:0/1461175451 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800cffe0 0x7f5c800d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c854dd700 1 --2- 172.21.15.79:0/1461175451 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5c800d2a50 0x7f5c800cf870 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c854dd700 1 -- 172.21.15.79:0/1461175451 >> 172.21.15.79:0/1461175451 conn(0x7f5c800713e0 msgr2=0x7f5c8009b780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c854dd700 1 -- 172.21.15.79:0/1461175451 shutdown_connections 2022-12-01T09:45:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.788+0000 7f5c854dd700 1 -- 172.21.15.79:0/1461175451 wait complete. 2022-12-01T09:45:28.802 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.790+0000 7f5c854dd700 1 Processor -- start 2022-12-01T09:45:28.802 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.790+0000 7f5c854dd700 1 -- start start 2022-12-01T09:45:28.806 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.790+0000 7f5c854dd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c800cffe0 0x7f5c801f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.807 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.790+0000 7f5c854dd700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800d2a50 0x7f5c80150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.807 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.790+0000 7f5c854dd700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5c8015cb70 0x7f5c80150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.807 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.790+0000 7f5c854dd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c801f4990 con 0x7f5c800cffe0 2022-12-01T09:45:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.790+0000 7f5c854dd700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c801f4c70 con 0x7f5c8015cb70 2022-12-01T09:45:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.790+0000 7f5c854dd700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c801f4f50 con 0x7f5c800d2a50 2022-12-01T09:45:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c800cffe0 0x7f5c801f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c800cffe0 0x7f5c801f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47516/0 (socket says 172.21.15.79:47516) 2022-12-01T09:45:28.808 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7effd700 1 -- 172.21.15.79:0/3561175099 learned_addr learned my addr 172.21.15.79:0/3561175099 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7f7fe700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5c8015cb70 0x7f5c80150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7e7fc700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800d2a50 0x7f5c80150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7effd700 1 -- 172.21.15.79:0/3561175099 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800d2a50 msgr2=0x7f5c80150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7effd700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800d2a50 0x7f5c80150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7effd700 1 -- 172.21.15.79:0/3561175099 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5c8015cb70 msgr2=0x7f5c80150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7effd700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5c8015cb70 0x7f5c80150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7effd700 1 -- 172.21.15.79:0/3561175099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78009a70 con 0x7f5c800cffe0 2022-12-01T09:45:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c7effd700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c800cffe0 0x7f5c801f40d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400c450 tx=0x7f5c7400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:28.811 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c677fe700 1 -- 172.21.15.79:0/3561175099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740052d0 con 0x7f5c800cffe0 2022-12-01T09:45:28.811 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c677fe700 1 -- 172.21.15.79:0/3561175099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74005430 con 0x7f5c800cffe0 2022-12-01T09:45:28.811 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c70009550 con 0x7f5c800cffe0 2022-12-01T09:45:28.811 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c677fe700 1 -- 172.21.15.79:0/3561175099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740038c0 con 0x7f5c800cffe0 2022-12-01T09:45:28.812 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.791+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c801f5510 con 0x7f5c800cffe0 2022-12-01T09:45:28.812 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.792+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c800661c0 con 0x7f5c800cffe0 2022-12-01T09:45:28.812 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.793+0000 7f5c677fe700 1 -- 172.21.15.79:0/3561175099 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f5c74019030 con 0x7f5c800cffe0 2022-12-01T09:45:28.812 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.793+0000 7f5c677fe700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f5c60066590 0x7f5c60068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:28.813 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.793+0000 7f5c677fe700 1 -- 172.21.15.79:0/3561175099 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5c740826c0 con 0x7f5c800cffe0 2022-12-01T09:45:28.813 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.793+0000 7f5c7e7fc700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f5c60066590 0x7f5c60068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:28.813 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.793+0000 7f5c7e7fc700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f5c60066590 0x7f5c60068a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009c40 tx=0x7f5c70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:28.813 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.797+0000 7f5c677fe700 1 -- 172.21.15.79:0/3561175099 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f5c740500c0 con 0x7f5c800cffe0 2022-12-01T09:45:28.981 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.977+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c800669f0 con 0x7f5c800cffe0 2022-12-01T09:45:28.981 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.977+0000 7f5c677fe700 1 -- 172.21.15.79:0/3561175099 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c740536e0 con 0x7f5c800cffe0 2022-12-01T09:45:28.982 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2022-12-01T09:45:28.983 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f5c60066590 msgr2=0x7f5c60068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.983 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f5c60066590 0x7f5c60068a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009c40 tx=0x7f5c70008030 comp rx=0 tx=0).stop 2022-12-01T09:45:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c800cffe0 msgr2=0x7f5c801f40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c800cffe0 0x7f5c801f40d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400c450 tx=0x7f5c7400c810 comp rx=0 tx=0).stop 2022-12-01T09:45:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 shutdown_connections 2022-12-01T09:45:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f5c60066590 0x7f5c60068a40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.984 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f5c8015cb70 0x7f5c80150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.985 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c800cffe0 0x7f5c801f40d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.985 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 --2- 172.21.15.79:0/3561175099 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f5c800d2a50 0x7f5c80150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:28.985 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 >> 172.21.15.79:0/3561175099 conn(0x7f5c800713e0 msgr2=0x7f5c800af280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:28.985 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 shutdown_connections 2022-12-01T09:45:28.986 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:28.979+0000 7f5c854dd700 1 -- 172.21.15.79:0/3561175099 wait complete. 2022-12-01T09:45:28.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-12-01T09:45:29.114 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.110+0000 7f7a7e511700 1 Processor -- start 2022-12-01T09:45:29.115 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.110+0000 7f7a7e511700 1 -- start start 2022-12-01T09:45:29.117 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a7e511700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a780cb270 0x7f7a780c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.118 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a7e511700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7a780cb640 0x7f7a7815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.118 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a7e511700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7815e3e0 con 0x7f7a78071210 2022-12-01T09:45:29.118 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a7e511700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7815af30 con 0x7f7a780cb640 2022-12-01T09:45:29.118 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a7e511700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7815d560 con 0x7f7a780cb270 2022-12-01T09:45:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a777fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7a780cb640 0x7f7a7815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a7caae700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7a78071210 0x7f7a78069390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39676/0 (socket says 172.21.15.79:39676) 2022-12-01T09:45:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a7caae700 1 -- 172.21.15.79:0/2670813037 learned_addr learned my addr 172.21.15.79:0/2670813037 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:29.119 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a77fff700 1 --2- 172.21.15.79:0/2670813037 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a780cb270 0x7f7a780c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:29.120 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a777fe700 1 -- 172.21.15.79:0/2670813037 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a780cb270 msgr2=0x7f7a780c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:29.120 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.111+0000 7f7a777fe700 1 --2- 172.21.15.79:0/2670813037 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a780cb270 0x7f7a780c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.120 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a777fe700 1 -- 172.21.15.79:0/2670813037 >> v1:172.21.15.79:6789/0 conn(0x7f7a78071210 legacy=0x7f7a78069390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.120 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a777fe700 1 -- 172.21.15.79:0/2670813037 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7815d7d0 con 0x7f7a780cb640 2022-12-01T09:45:29.121 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a76ffd700 1 -- 172.21.15.79:0/2670813037 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812124617 0 0) 0x7f7a7815e3e0 con 0x7f7a78071210 2022-12-01T09:45:29.121 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a777fe700 1 --2- 172.21.15.79:0/2670813037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a780cb640 0x7f7a7815a9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009840 tx=0x7f7a68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1b4908c24583b1 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:29.121 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a76ffd700 1 -- 172.21.15.79:0/2670813037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68011830 con 0x7f7a780cb640 2022-12-01T09:45:29.121 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a76ffd700 1 -- 172.21.15.79:0/2670813037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a68011990 con 0x7f7a780cb640 2022-12-01T09:45:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a76ffd700 1 -- 172.21.15.79:0/2670813037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68011d20 con 0x7f7a780cb640 2022-12-01T09:45:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a7e511700 1 -- 172.21.15.79:0/2670813037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a780cb640 msgr2=0x7f7a7815a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a7e511700 1 --2- 172.21.15.79:0/2670813037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a780cb640 0x7f7a7815a9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009840 tx=0x7f7a68009b50 comp rx=0 tx=0).stop 2022-12-01T09:45:29.122 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a7e511700 1 -- 172.21.15.79:0/2670813037 shutdown_connections 2022-12-01T09:45:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a7e511700 1 --2- 172.21.15.79:0/2670813037 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a780cb270 0x7f7a780c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a7e511700 1 --2- 172.21.15.79:0/2670813037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a780cb640 0x7f7a7815a9f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a7e511700 1 -- 172.21.15.79:0/2670813037 >> 172.21.15.79:0/2670813037 conn(0x7f7a780cbb50 msgr2=0x7f7a780cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:29.123 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a7e511700 1 -- 172.21.15.79:0/2670813037 shutdown_connections 2022-12-01T09:45:29.124 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.112+0000 7f7a7e511700 1 -- 172.21.15.79:0/2670813037 wait complete. 2022-12-01T09:45:29.124 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.113+0000 7f7a7e511700 1 Processor -- start 2022-12-01T09:45:29.124 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.114+0000 7f7a7e511700 1 -- start start 2022-12-01T09:45:29.127 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.114+0000 7f7a7e511700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a78071210 0x7f7a781558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.127 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.114+0000 7f7a7e511700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a780cb270 0x7f7a780ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.127 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.114+0000 7f7a7e511700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a780cb640 0x7f7a78156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.128 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.114+0000 7f7a7e511700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780cd530 con 0x7f7a78071210 2022-12-01T09:45:29.128 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.114+0000 7f7a7e511700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780cd810 con 0x7f7a780cb270 2022-12-01T09:45:29.128 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.114+0000 7f7a7e511700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780cdaf0 con 0x7f7a780cb640 2022-12-01T09:45:29.128 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a77fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a78071210 0x7f7a781558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:29.129 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a77fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a78071210 0x7f7a781558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47526/0 (socket says 172.21.15.79:47526) 2022-12-01T09:45:29.129 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a77fff700 1 -- 172.21.15.79:0/1790721236 learned_addr learned my addr 172.21.15.79:0/1790721236 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:29.129 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a77fff700 1 -- 172.21.15.79:0/1790721236 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a780cb640 msgr2=0x7f7a78156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.129 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a77fff700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a780cb640 0x7f7a78156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.129 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a77fff700 1 -- 172.21.15.79:0/1790721236 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a780cb270 msgr2=0x7f7a780ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.130 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a77fff700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a780cb270 0x7f7a780ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.130 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a77fff700 1 -- 172.21.15.79:0/1790721236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a680094a0 con 0x7f7a78071210 2022-12-01T09:45:29.130 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a77fff700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a78071210 0x7f7a781558f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c7f0 tx=0x7f7a6c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:29.130 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a74ff9700 1 -- 172.21.15.79:0/1790721236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c011800 con 0x7f7a78071210 2022-12-01T09:45:29.131 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a74ff9700 1 -- 172.21.15.79:0/1790721236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c011960 con 0x7f7a78071210 2022-12-01T09:45:29.131 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a74ff9700 1 -- 172.21.15.79:0/1790721236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c011d10 con 0x7f7a78071210 2022-12-01T09:45:29.131 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a780cddd0 con 0x7f7a78071210 2022-12-01T09:45:29.131 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.115+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a78155e30 con 0x7f7a78071210 2022-12-01T09:45:29.131 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.116+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a780ce2f0 con 0x7f7a78071210 2022-12-01T09:45:29.132 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.116+0000 7f7a74ff9700 1 -- 172.21.15.79:0/1790721236 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f7a6c021070 con 0x7f7a78071210 2022-12-01T09:45:29.132 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.117+0000 7f7a74ff9700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7a58066590 0x7f7a58068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.132 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.117+0000 7f7a74ff9700 1 -- 172.21.15.79:0/1790721236 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7a6c083380 con 0x7f7a78071210 2022-12-01T09:45:29.132 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.117+0000 7f7a777fe700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7a58066590 0x7f7a58068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:29.132 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.117+0000 7f7a777fe700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7a58066590 0x7f7a58068a40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a780cba30 tx=0x7f7a68010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:29.133 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.121+0000 7f7a74ff9700 1 -- 172.21.15.79:0/1790721236 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f7a780ce2f0 con 0x7f7a78071210 2022-12-01T09:45:29.309 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.305+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7a780ce2f0 con 0x7f7a78071210 2022-12-01T09:45:29.309 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.305+0000 7f7a74ff9700 1 -- 172.21.15.79:0/1790721236 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7a6c01f090 con 0x7f7a78071210 2022-12-01T09:45:29.310 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-12-01T09:45:29.310 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2022-12-01T09:45:29.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2022-12-01T09:45:29.311 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2022-12-01T09:45:29.311 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2022-12-01T09:45:29.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2022-12-01T09:45:29.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2022-12-01T09:45:29.312 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 2, 2022-12-01T09:45:29.312 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2022-12-01T09:45:29.312 INFO:teuthology.orchestra.run.smithi079.stdout: } 2022-12-01T09:45:29.312 INFO:teuthology.orchestra.run.smithi079.stdout:] 2022-12-01T09:45:29.314 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7a58066590 msgr2=0x7f7a58068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.314 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7a58066590 0x7f7a58068a40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a780cba30 tx=0x7f7a68010000 comp rx=0 tx=0).stop 2022-12-01T09:45:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a78071210 msgr2=0x7f7a781558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a78071210 0x7f7a781558f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c7f0 tx=0x7f7a6c00cbb0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 shutdown_connections 2022-12-01T09:45:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7f7a58066590 0x7f7a58068a40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.316 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f7a780cb640 0x7f7a78156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.316 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a78071210 0x7f7a781558f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.316 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 --2- 172.21.15.79:0/1790721236 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f7a780cb270 0x7f7a780ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.316 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 >> 172.21.15.79:0/1790721236 conn(0x7f7a780cbb50 msgr2=0x7f7a7815c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:29.317 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 shutdown_connections 2022-12-01T09:45:29.317 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.307+0000 7f7a7e511700 1 -- 172.21.15.79:0/1790721236 wait complete. 2022-12-01T09:45:29.323 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-12-01T09:45:29.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-12-01T09:45:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.445+0000 7fa3004f7700 1 Processor -- start 2022-12-01T09:45:29.449 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.445+0000 7fa3004f7700 1 -- start start 2022-12-01T09:45:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa3004f7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2f806b120 0x7fa2f80ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa3004f7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f815c550 con 0x7fa2f815c180 2022-12-01T09:45:29.452 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa3004f7700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f806f8f0 con 0x7fa2f806bda0 2022-12-01T09:45:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa3004f7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f806c540 con 0x7fa2f806b120 2022-12-01T09:45:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa2fea94700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2f806b120 0x7fa2f80ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa2fe293700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa2f815c180 0x7fa2f80cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39688/0 (socket says 172.21.15.79:39688) 2022-12-01T09:45:29.453 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa2fe293700 1 -- 172.21.15.79:0/1695105590 learned_addr learned my addr 172.21.15.79:0/1695105590 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:29.454 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa2fea94700 1 -- 172.21.15.79:0/1695105590 >> v1:172.21.15.182:6789/0 conn(0x7fa2f806bda0 legacy=0x7fa2f815fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:29.454 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa2fea94700 1 -- 172.21.15.79:0/1695105590 >> v1:172.21.15.79:6789/0 conn(0x7fa2f815c180 legacy=0x7fa2f80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.454 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa2fea94700 1 -- 172.21.15.79:0/1695105590 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f806c260 con 0x7fa2f806b120 2022-12-01T09:45:29.455 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa2fd291700 1 -- 172.21.15.79:0/1695105590 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442405679 0 0) 0x7fa2f815c550 con 0x7fa2f815c180 2022-12-01T09:45:29.455 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa2fea94700 1 --2- 172.21.15.79:0/1695105590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f806b120 0x7fa2f80ccfc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009d90 tx=0x7fa2f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172964ebe09c49a1 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:29.455 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.446+0000 7fa2fd291700 1 -- 172.21.15.79:0/1695105590 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000e070 con 0x7fa2f806b120 2022-12-01T09:45:29.455 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.447+0000 7fa2fd291700 1 -- 172.21.15.79:0/1695105590 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000bb90 con 0x7fa2f806b120 2022-12-01T09:45:29.456 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.447+0000 7fa2fd291700 1 -- 172.21.15.79:0/1695105590 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0003a20 con 0x7fa2f806b120 2022-12-01T09:45:29.456 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.447+0000 7fa3004f7700 1 -- 172.21.15.79:0/1695105590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f806b120 msgr2=0x7fa2f80ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.456 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.447+0000 7fa3004f7700 1 --2- 172.21.15.79:0/1695105590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f806b120 0x7fa2f80ccfc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009d90 tx=0x7fa2f000b330 comp rx=0 tx=0).stop 2022-12-01T09:45:29.456 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.447+0000 7fa3004f7700 1 -- 172.21.15.79:0/1695105590 shutdown_connections 2022-12-01T09:45:29.457 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.447+0000 7fa3004f7700 1 --2- 172.21.15.79:0/1695105590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f806b120 0x7fa2f80ccfc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.457 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.447+0000 7fa3004f7700 1 -- 172.21.15.79:0/1695105590 >> 172.21.15.79:0/1695105590 conn(0x7fa2f806d310 msgr2=0x7fa2f806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:29.457 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.447+0000 7fa3004f7700 1 -- 172.21.15.79:0/1695105590 shutdown_connections 2022-12-01T09:45:29.457 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.447+0000 7fa3004f7700 1 -- 172.21.15.79:0/1695105590 wait complete. 2022-12-01T09:45:29.458 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.448+0000 7fa3004f7700 1 Processor -- start 2022-12-01T09:45:29.458 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.448+0000 7fa3004f7700 1 -- start start 2022-12-01T09:45:29.461 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa3004f7700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa2f806b120 0x7fa2f81f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.461 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa3004f7700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa2f806bda0 0x7fa2f81f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.461 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa3004f7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f815c180 0x7fa2f815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.461 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa3004f7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80cd500 con 0x7fa2f815c180 2022-12-01T09:45:29.462 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa3004f7700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f8149e30 con 0x7fa2f806bda0 2022-12-01T09:45:29.462 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa3004f7700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81f19a0 con 0x7fa2f806b120 2022-12-01T09:45:29.462 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fea94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f815c180 0x7fa2f815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:29.462 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fea94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f815c180 0x7fa2f815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47544/0 (socket says 172.21.15.79:47544) 2022-12-01T09:45:29.463 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fea94700 1 -- 172.21.15.79:0/327431258 learned_addr learned my addr 172.21.15.79:0/327431258 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:29.463 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fe293700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa2f806b120 0x7fa2f81f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:29.463 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fda92700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa2f806bda0 0x7fa2f81f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:29.463 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fea94700 1 -- 172.21.15.79:0/327431258 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa2f806b120 msgr2=0x7fa2f81f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.464 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fea94700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa2f806b120 0x7fa2f81f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.464 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fea94700 1 -- 172.21.15.79:0/327431258 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa2f806bda0 msgr2=0x7fa2f81f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:29.464 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fea94700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa2f806bda0 0x7fa2f81f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:29.465 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.449+0000 7fa2fea94700 1 -- 172.21.15.79:0/327431258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0009a70 con 0x7fa2f815c180 2022-12-01T09:45:29.465 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.450+0000 7fa2fea94700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f815c180 0x7fa2f815d5d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000b730 tx=0x7fa2f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:29.465 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.450+0000 7fa2e6ffd700 1 -- 172.21.15.79:0/327431258 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0012840 con 0x7fa2f815c180 2022-12-01T09:45:29.465 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.450+0000 7fa2e6ffd700 1 -- 172.21.15.79:0/327431258 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f00129a0 con 0x7fa2f815c180 2022-12-01T09:45:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.450+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f8147b40 con 0x7fa2f815c180 2022-12-01T09:45:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.450+0000 7fa2e6ffd700 1 -- 172.21.15.79:0/327431258 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0012d50 con 0x7fa2f815c180 2022-12-01T09:45:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.450+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f8148100 con 0x7fa2f815c180 2022-12-01T09:45:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.451+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f806a640 con 0x7fa2f815c180 2022-12-01T09:45:29.466 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.451+0000 7fa2e6ffd700 1 -- 172.21.15.79:0/327431258 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fa2f001d420 con 0x7fa2f815c180 2022-12-01T09:45:29.467 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.452+0000 7fa2e6ffd700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa2d8066590 0x7fa2d8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:29.467 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.452+0000 7fa2fe293700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa2d8066590 0x7fa2d8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:29.468 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.452+0000 7fa2e6ffd700 1 -- 172.21.15.79:0/327431258 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa2f0085ab0 con 0x7fa2f815c180 2022-12-01T09:45:29.468 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.452+0000 7fa2fe293700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa2d8066590 0x7fa2d8068a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4000f60 tx=0x7fa2f4007d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:29.468 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.456+0000 7fa2e6ffd700 1 -- 172.21.15.79:0/327431258 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7fa2f00534b0 con 0x7fa2f815c180 2022-12-01T09:45:29.640 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:29.636+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa2f806d0f0 con 0x7fa2f815c180 2022-12-01T09:45:30.590 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.586+0000 7fa2e6ffd700 1 -- 172.21.15.79:0/327431258 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa2f0056ad0 con 0x7fa2f815c180 2022-12-01T09:45:30.595 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa2d8066590 msgr2=0x7fa2d8068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:30.595 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa2d8066590 0x7fa2d8068a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4000f60 tx=0x7fa2f4007d90 comp rx=0 tx=0).stop 2022-12-01T09:45:30.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f815c180 msgr2=0x7fa2f815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:30.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f815c180 0x7fa2f815d5d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000b730 tx=0x7fa2f0004ad0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 shutdown_connections 2022-12-01T09:45:30.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa2d8066590 0x7fa2d8068a40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.596 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2f815c180 0x7fa2f815d5d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.597 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa2f806b120 0x7fa2f81f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.597 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 --2- 172.21.15.79:0/327431258 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa2f806bda0 0x7fa2f81f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.597 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 >> 172.21.15.79:0/327431258 conn(0x7fa2f806d310 msgr2=0x7fa2f80b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:30.598 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 shutdown_connections 2022-12-01T09:45:30.598 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.591+0000 7fa3004f7700 1 -- 172.21.15.79:0/327431258 wait complete. 2022-12-01T09:45:30.599 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2022-12-01T09:45:30.611 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2022-12-01T09:45:30.746 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.742+0000 7fa6a43d0700 1 Processor -- start 2022-12-01T09:45:30.747 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.742+0000 7fa6a43d0700 1 -- start start 2022-12-01T09:45:30.755 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.743+0000 7fa6a43d0700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7fa69c06c9d0 0x7fa69c0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:30.755 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.743+0000 7fa6a43d0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c06d1a0 con 0x7fa69c06a780 2022-12-01T09:45:30.756 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.743+0000 7fa6a43d0700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c069390 con 0x7fa69c06f9d0 2022-12-01T09:45:30.756 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.743+0000 7fa6a43d0700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69c06a4f0 con 0x7fa69c06c9d0 2022-12-01T09:45:30.756 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.743+0000 7fa6a196b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa69c06a780 0x7fa69c069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39702/0 (socket says 172.21.15.79:39702) 2022-12-01T09:45:30.756 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.743+0000 7fa6a196b700 1 -- 172.21.15.79:0/1337950377 learned_addr learned my addr 172.21.15.79:0/1337950377 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:30.757 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a216c700 1 --2- 172.21.15.79:0/1337950377 >> v2:172.21.15.182:3300/0 conn(0x7fa69c06c9d0 0x7fa69c0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:30.757 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179733673 0 0) 0x7fa69c06d1a0 con 0x7fa69c06a780 2022-12-01T09:45:30.757 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6840035b0 con 0x7fa69c06a780 2022-12-01T09:45:30.757 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048652033 0 0) 0x7fa6840035b0 con 0x7fa69c06a780 2022-12-01T09:45:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 >> v2:172.21.15.182:3300/0 conn(0x7fa69c06c9d0 msgr2=0x7fa69c0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 --2- 172.21.15.79:0/1337950377 >> v2:172.21.15.182:3300/0 conn(0x7fa69c06c9d0 0x7fa69c0cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 >> v1:172.21.15.182:6789/0 conn(0x7fa69c06f9d0 legacy=0x7fa69c06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c06d3f0 con 0x7fa69c06a780 2022-12-01T09:45:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 805749679 0 0) 0x7fa698001670 con 0x7fa69c06a780 2022-12-01T09:45:30.759 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 >> v1:172.21.15.79:6789/0 conn(0x7fa69c06a780 legacy=0x7fa69c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:30.759 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa684003a00 0x7fa684003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:30.759 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa684004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:30.759 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa684005200 0x7fa68400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:30.760 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c06a4f0 con 0x7fa684004850 2022-12-01T09:45:30.760 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68400c080 con 0x7fa684005200 2022-12-01T09:45:30.760 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68400c240 con 0x7fa684003a00 2022-12-01T09:45:30.760 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a196b700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa684004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:30.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a296d700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa684005200 0x7fa68400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:30.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a216c700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa684003a00 0x7fa684003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:30.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a196b700 1 -- 172.21.15.79:0/1337950377 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa684003a00 msgr2=0x7fa684003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:30.761 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a196b700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa684003a00 0x7fa684003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a196b700 1 -- 172.21.15.79:0/1337950377 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa684005200 msgr2=0x7fa68400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a196b700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa684005200 0x7fa68400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a296d700 1 -- 172.21.15.79:0/1337950377 reap_dead start 2022-12-01T09:45:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a196b700 1 -- 172.21.15.79:0/1337950377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6840035b0 con 0x7fa684004850 2022-12-01T09:45:30.762 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.744+0000 7fa6a216c700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa684003a00 0x7fa684003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:45:30.763 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a196b700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa684004cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c240 tx=0x7fa684005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf46cb1a2468689e server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:30.763 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698007c10 con 0x7fa684004850 2022-12-01T09:45:30.763 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69800cde0 con 0x7fa684004850 2022-12-01T09:45:30.763 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a116a700 1 -- 172.21.15.79:0/1337950377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698005ba0 con 0x7fa684004850 2022-12-01T09:45:30.764 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a43d0700 1 -- 172.21.15.79:0/1337950377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 msgr2=0x7fa684004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:30.764 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a43d0700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa684004cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c240 tx=0x7fa684005880 comp rx=0 tx=0).stop 2022-12-01T09:45:30.764 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a43d0700 1 -- 172.21.15.79:0/1337950377 shutdown_connections 2022-12-01T09:45:30.764 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a43d0700 1 --2- 172.21.15.79:0/1337950377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa684004cc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.765 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a43d0700 1 -- 172.21.15.79:0/1337950377 >> 172.21.15.79:0/1337950377 conn(0x7fa69c0ce920 msgr2=0x7fa69c0cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:30.765 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a43d0700 1 -- 172.21.15.79:0/1337950377 shutdown_connections 2022-12-01T09:45:30.765 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.745+0000 7fa6a43d0700 1 -- 172.21.15.79:0/1337950377 wait complete. 2022-12-01T09:45:30.765 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.746+0000 7fa6a43d0700 1 Processor -- start 2022-12-01T09:45:30.765 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.746+0000 7fa6a43d0700 1 -- start start 2022-12-01T09:45:30.766 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a43d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa69c14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:30.766 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a43d0700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa69c1f1630 0x7fa69c0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:30.766 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a43d0700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69c0c8a80 0x7fa69c0c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:30.766 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a43d0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0b2be0 con 0x7fa684004850 2022-12-01T09:45:30.766 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a43d0700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0b2ec0 con 0x7fa69c1f1630 2022-12-01T09:45:30.767 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a43d0700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0b31a0 con 0x7fa69c0c8a80 2022-12-01T09:45:30.767 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a216c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa69c14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a216c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa69c14fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47560/0 (socket says 172.21.15.79:47560) 2022-12-01T09:45:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a216c700 1 -- 172.21.15.79:0/4162780770 learned_addr learned my addr 172.21.15.79:0/4162780770 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a196b700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa69c1f1630 0x7fa69c0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.747+0000 7fa6a296d700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69c0c8a80 0x7fa69c0c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa6a216c700 1 -- 172.21.15.79:0/4162780770 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69c0c8a80 msgr2=0x7fa69c0c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa6a216c700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69c0c8a80 0x7fa69c0c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa6a216c700 1 -- 172.21.15.79:0/4162780770 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa69c1f1630 msgr2=0x7fa69c0c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa6a216c700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa69c1f1630 0x7fa69c0c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa6a216c700 1 -- 172.21.15.79:0/4162780770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c0b3480 con 0x7fa684004850 2022-12-01T09:45:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa6a216c700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa69c14fa10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa68c011590 tx=0x7fa68c0118a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:30.771 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa68affd700 1 -- 172.21.15.79:0/4162780770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c004220 con 0x7fa684004850 2022-12-01T09:45:30.771 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa68affd700 1 -- 172.21.15.79:0/4162780770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c004380 con 0x7fa684004850 2022-12-01T09:45:30.771 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69c0b3760 con 0x7fa684004850 2022-12-01T09:45:30.772 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa68affd700 1 -- 172.21.15.79:0/4162780770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0036a0 con 0x7fa684004850 2022-12-01T09:45:30.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.748+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69c1f1aa0 con 0x7fa684004850 2022-12-01T09:45:30.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.749+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69c0b3ad0 con 0x7fa684004850 2022-12-01T09:45:30.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.749+0000 7fa68affd700 1 -- 172.21.15.79:0/4162780770 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fa68c024070 con 0x7fa684004850 2022-12-01T09:45:30.774 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.750+0000 7fa68affd700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa67c0665e0 0x7fa67c068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:30.774 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.750+0000 7fa6a196b700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa67c0665e0 0x7fa67c068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:30.775 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.750+0000 7fa68affd700 1 -- 172.21.15.79:0/4162780770 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fa68c083710 con 0x7fa684004850 2022-12-01T09:45:30.775 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.750+0000 7fa6a196b700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa67c0665e0 0x7fa67c068a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa698001930 tx=0x7fa698007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:30.776 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.754+0000 7fa68affd700 1 -- 172.21.15.79:0/4162780770 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7fa68c0510a0 con 0x7fa684004850 2022-12-01T09:45:30.939 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:30.935+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa69c0669f0 con 0x7fa684004850 2022-12-01T09:45:31.597 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.593+0000 7fa68affd700 1 -- 172.21.15.79:0/4162780770 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa68c0546c0 con 0x7fa684004850 2022-12-01T09:45:31.608 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.604+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa67c0665e0 msgr2=0x7fa67c068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:31.608 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.604+0000 7fa6a43d0700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa67c0665e0 0x7fa67c068a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa698001930 tx=0x7fa698007000 comp rx=0 tx=0).stop 2022-12-01T09:45:31.609 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.604+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 msgr2=0x7fa69c14fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:31.609 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.604+0000 7fa6a43d0700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa69c14fa10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa68c011590 tx=0x7fa68c0118a0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.609+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 shutdown_connections 2022-12-01T09:45:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.609+0000 7fa6a43d0700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7fa67c0665e0 0x7fa67c068a90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.609+0000 7fa6a43d0700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7fa69c0c8a80 0x7fa69c0c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.609+0000 7fa6a43d0700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa684004850 0x7fa69c14fa10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.609+0000 7fa6a43d0700 1 --2- 172.21.15.79:0/4162780770 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7fa69c1f1630 0x7fa69c0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.609+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 >> 172.21.15.79:0/4162780770 conn(0x7fa69c0ce920 msgr2=0x7fa69c06fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.610+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 shutdown_connections 2022-12-01T09:45:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.610+0000 7fa6a43d0700 1 -- 172.21.15.79:0/4162780770 wait complete. 2022-12-01T09:45:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2022-12-01T09:45:31.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-12-01T09:45:31.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.754+0000 7ff0e5423700 1 Processor -- start 2022-12-01T09:45:31.758 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.754+0000 7ff0e5423700 1 -- start start 2022-12-01T09:45:31.772 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0e5423700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0e00d2a50 0x7ff0e00cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:31.772 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0e5423700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e015c4d0 con 0x7ff0e015cb70 2022-12-01T09:45:31.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0e5423700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e00cf3e0 con 0x7ff0e00cffe0 2022-12-01T09:45:31.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0e5423700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00cedd0 con 0x7ff0e00d2a50 2022-12-01T09:45:31.773 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0deffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff0e015cb70 0x7ff0e00d2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39722/0 (socket says 172.21.15.79:39722) 2022-12-01T09:45:31.774 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0deffd700 1 -- 172.21.15.79:0/533065570 learned_addr learned my addr 172.21.15.79:0/533065570 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:31.774 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058260801 0 0) 0x7ff0e015c4d0 con 0x7ff0e015cb70 2022-12-01T09:45:31.775 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0cc0035b0 con 0x7ff0e015cb70 2022-12-01T09:45:31.775 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0de7fc700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0e00d2a50 0x7ff0e00cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:31.776 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1343778837 0 0) 0x7ff0cc0035b0 con 0x7ff0e015cb70 2022-12-01T09:45:31.776 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0e00d2a50 msgr2=0x7ff0e00cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:31.776 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0e00d2a50 0x7ff0e00cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.777 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 >> v1:172.21.15.182:6789/0 conn(0x7ff0e00cffe0 legacy=0x7ff0e00d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:31.777 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e00d2f60 con 0x7ff0e015cb70 2022-12-01T09:45:31.778 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 805749679 0 0) 0x7ff0d4001670 con 0x7ff0e015cb70 2022-12-01T09:45:31.778 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 >> v1:172.21.15.79:6789/0 conn(0x7ff0e015cb70 legacy=0x7ff0e00d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:31.778 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc003a30 0x7ff0cc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:31.778 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0e00d2a50 0x7ff0cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff0cc004d90 0x7ff0cc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00cedd0 con 0x7ff0cc003a30 2022-12-01T09:45:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc00bac0 con 0x7ff0cc004d90 2022-12-01T09:45:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.755+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc00bc50 con 0x7ff0e00d2a50 2022-12-01T09:45:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0deffd700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc003a30 0x7ff0cc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:31.780 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0de7fc700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0e00d2a50 0x7ff0cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:31.780 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0df7fe700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff0cc004d90 0x7ff0cc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:31.780 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0deffd700 1 -- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0e00d2a50 msgr2=0x7ff0cc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:31.781 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0deffd700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0e00d2a50 0x7ff0cc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.781 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0deffd700 1 -- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff0cc004d90 msgr2=0x7ff0cc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:31.781 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0deffd700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff0cc004d90 0x7ff0cc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.781 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0deffd700 1 -- 172.21.15.79:0/533065570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc0035b0 con 0x7ff0cc003a30 2022-12-01T09:45:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0deffd700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc003a30 0x7ff0cc003e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400c240 tx=0x7ff0cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d2d0b89dc007ec server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4007c10 con 0x7ff0cc003a30 2022-12-01T09:45:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400cde0 con 0x7ff0cc003a30 2022-12-01T09:45:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.756+0000 7ff0ddffb700 1 -- 172.21.15.79:0/533065570 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4005ba0 con 0x7ff0cc003a30 2022-12-01T09:45:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.757+0000 7ff0e5423700 1 -- 172.21.15.79:0/533065570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc003a30 msgr2=0x7ff0cc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:31.783 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.757+0000 7ff0e5423700 1 --2- 172.21.15.79:0/533065570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc003a30 0x7ff0cc003e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400c240 tx=0x7ff0cc005880 comp rx=0 tx=0).stop 2022-12-01T09:45:31.783 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.757+0000 7ff0df7fe700 1 -- 172.21.15.79:0/533065570 reap_dead start 2022-12-01T09:45:31.783 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.757+0000 7ff0e5423700 1 -- 172.21.15.79:0/533065570 shutdown_connections 2022-12-01T09:45:31.783 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.757+0000 7ff0e5423700 1 -- 172.21.15.79:0/533065570 >> 172.21.15.79:0/533065570 conn(0x7ff0e00713e0 msgr2=0x7ff0e009b780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:31.784 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.757+0000 7ff0e5423700 1 -- 172.21.15.79:0/533065570 shutdown_connections 2022-12-01T09:45:31.784 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.757+0000 7ff0e5423700 1 -- 172.21.15.79:0/533065570 wait complete. 2022-12-01T09:45:31.784 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.758+0000 7ff0e5423700 1 Processor -- start 2022-12-01T09:45:31.784 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.758+0000 7ff0e5423700 1 -- start start 2022-12-01T09:45:31.784 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0e5423700 1 --2- >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0cc003a30 0x7ff0e00c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0e5423700 1 --2- >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff0e00cbcd0 0x7ff0e00c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0e5423700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e00cc140 0x7ff0e00b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0e5423700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00b5be0 con 0x7ff0e00cc140 2022-12-01T09:45:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0e5423700 1 -- --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00b61a0 con 0x7ff0e00cbcd0 2022-12-01T09:45:31.786 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0e5423700 1 -- --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00b5240 con 0x7ff0cc003a30 2022-12-01T09:45:31.786 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0df7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e00cc140 0x7ff0e00b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:31.786 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0df7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e00cc140 0x7ff0e00b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47584/0 (socket says 172.21.15.79:47584) 2022-12-01T09:45:31.786 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0df7fe700 1 -- 172.21.15.79:0/557741007 learned_addr learned my addr 172.21.15.79:0/557741007 (peer_addr_for_me v2:172.21.15.79:0/0) 2022-12-01T09:45:31.786 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0de7fc700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff0e00cbcd0 0x7ff0e00c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:31.787 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0deffd700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0cc003a30 0x7ff0e00c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:31.787 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0df7fe700 1 -- 172.21.15.79:0/557741007 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0cc003a30 msgr2=0x7ff0e00c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:31.787 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0df7fe700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0cc003a30 0x7ff0e00c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.788 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0df7fe700 1 -- 172.21.15.79:0/557741007 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff0e00cbcd0 msgr2=0x7ff0e00c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:31.788 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0df7fe700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff0e00cbcd0 0x7ff0e00c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:31.788 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0df7fe700 1 -- 172.21.15.79:0/557741007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e00b5520 con 0x7ff0e00cc140 2022-12-01T09:45:31.788 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0df7fe700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e00cc140 0x7ff0e00b7850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00cff60 tx=0x7ff0d800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:31.789 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0c77fe700 1 -- 172.21.15.79:0/557741007 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8003c10 con 0x7ff0e00cc140 2022-12-01T09:45:31.789 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0c77fe700 1 -- 172.21.15.79:0/557741007 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d8003d90 con 0x7ff0e00cc140 2022-12-01T09:45:31.789 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e00b5800 con 0x7ff0e00cc140 2022-12-01T09:45:31.789 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0c77fe700 1 -- 172.21.15.79:0/557741007 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800dbd0 con 0x7ff0e00cc140 2022-12-01T09:45:31.790 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.759+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e0151e40 con 0x7ff0e00cc140 2022-12-01T09:45:31.790 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.760+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e00669f0 con 0x7ff0e00cc140 2022-12-01T09:45:31.790 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.761+0000 7ff0c77fe700 1 -- 172.21.15.79:0/557741007 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7ff0d800dd30 con 0x7ff0e00cc140 2022-12-01T09:45:31.790 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.761+0000 7ff0c77fe700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7ff0c0066590 0x7ff0c0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:31.790 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.761+0000 7ff0deffd700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7ff0c0066590 0x7ff0c0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:31.791 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.761+0000 7ff0c77fe700 1 -- 172.21.15.79:0/557741007 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5958+0+0 (secure 0 0 0) 0x7ff0d8083b30 con 0x7ff0e00cc140 2022-12-01T09:45:31.791 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.762+0000 7ff0deffd700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7ff0c0066590 0x7ff0c0068a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4001930 tx=0x7ff0d4007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:31.791 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.766+0000 7ff0c77fe700 1 -- 172.21.15.79:0/557741007 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7ff0d80512a0 con 0x7ff0e00cc140 2022-12-01T09:45:31.995 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.991+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff0e00cf070 con 0x7ff0e00cc140 2022-12-01T09:45:32.001 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:31.997+0000 7ff0c77fe700 1 -- 172.21.15.79:0/557741007 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff0d80548c0 con 0x7ff0e00cc140 2022-12-01T09:45:32.005 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.001+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7ff0c0066590 msgr2=0x7ff0c0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:32.005 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.001+0000 7ff0e5423700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7ff0c0066590 0x7ff0c0068a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4001930 tx=0x7ff0d4007000 comp rx=0 tx=0).stop 2022-12-01T09:45:32.005 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.001+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e00cc140 msgr2=0x7ff0e00b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:32.006 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.001+0000 7ff0e5423700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e00cc140 0x7ff0e00b7850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00cff60 tx=0x7ff0d800d430 comp rx=0 tx=0).stop 2022-12-01T09:45:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.006+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 shutdown_connections 2022-12-01T09:45:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.006+0000 7ff0e5423700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:6832/101048,v1:172.21.15.79:6833/101048] conn(0x7ff0c0066590 0x7ff0c0068a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.006+0000 7ff0e5423700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e00cc140 0x7ff0e00b7850 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.006+0000 7ff0e5423700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7ff0cc003a30 0x7ff0e00c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.006+0000 7ff0e5423700 1 --2- 172.21.15.79:0/557741007 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7ff0e00cbcd0 0x7ff0e00c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:32.011 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.006+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 >> 172.21.15.79:0/557741007 conn(0x7ff0e00713e0 msgr2=0x7ff0e00aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:45:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.008+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 shutdown_connections 2022-12-01T09:45:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.009+0000 7ff0e5423700 1 -- 172.21.15.79:0/557741007 wait complete. 2022-12-01T09:45:32.017 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 3 and data pool 4 2022-12-01T09:45:32.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-12-01T09:45:32.164 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.147+0000 7f2b8df72700 1 Processor -- start 2022-12-01T09:45:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.148+0000 7f2b8df72700 1 -- start start 2022-12-01T09:45:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.148+0000 7f2b8df72700 1 --2- >> v2:172.21.15.182:3300/0 conn(0x7f2b880cbb20 0x7f2b880cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:32.165 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.148+0000 7f2b8df72700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8815b360 con 0x7f2b880cdbd0 2022-12-01T09:45:32.166 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.148+0000 7f2b8df72700 1 -- --> v1:172.21.15.182:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8815aac0 con 0x7f2b8806f4c0 2022-12-01T09:45:32.166 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.148+0000 7f2b8df72700 1 -- --> v2:172.21.15.182:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8815ada0 con 0x7f2b880cbb20 2022-12-01T09:45:32.166 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.148+0000 7f2b877fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2b880cdbd0 0x7f2b880cdfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39754/0 (socket says 172.21.15.79:39754) 2022-12-01T09:45:32.166 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.148+0000 7f2b877fe700 1 -- 172.21.15.79:0/3933337736 learned_addr learned my addr 172.21.15.79:0/3933337736 (peer_addr_for_me v1:172.21.15.79:0/0) 2022-12-01T09:45:32.166 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613776416 0 0) 0x7f2b8815b360 con 0x7f2b880cdbd0 2022-12-01T09:45:32.167 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b740035b0 con 0x7f2b880cdbd0 2022-12-01T09:45:32.167 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b87fff700 1 --2- 172.21.15.79:0/3933337736 >> v2:172.21.15.182:3300/0 conn(0x7f2b880cbb20 0x7f2b880cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:32.167 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 421303666 0 0) 0x7f2b740035b0 con 0x7f2b880cdbd0 2022-12-01T09:45:32.167 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 >> v2:172.21.15.182:3300/0 conn(0x7f2b880cbb20 msgr2=0x7f2b880cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:32.168 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 --2- 172.21.15.79:0/3933337736 >> v2:172.21.15.182:3300/0 conn(0x7f2b880cbb20 0x7f2b880cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:32.168 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 >> v1:172.21.15.182:6789/0 conn(0x7f2b8806f4c0 legacy=0x7f2b8815a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:32.168 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8815b080 con 0x7f2b880cdbd0 2022-12-01T09:45:32.168 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 805749679 0 0) 0x7f2b78001670 con 0x7f2b880cdbd0 2022-12-01T09:45:32.169 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 >> v1:172.21.15.79:6789/0 conn(0x7f2b880cdbd0 legacy=0x7f2b880cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:45:32.169 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 --2- 172.21.15.79:0/3933337736 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2b74003a00 0x7f2b74003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:32.169 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 --2- 172.21.15.79:0/3933337736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b74004850 0x7f2b74004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:32.169 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 --2- 172.21.15.79:0/3933337736 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2b74005200 0x7f2b7400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:45:32.169 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8815ada0 con 0x7f2b74004850 2022-12-01T09:45:32.170 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 --> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7400c110 con 0x7f2b74003a00 2022-12-01T09:45:32.170 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 --> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7400c2d0 con 0x7f2b74005200 2022-12-01T09:45:32.170 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b86ffd700 1 --2- 172.21.15.79:0/3933337736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b74004850 0x7f2b74004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:32.170 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b877fe700 1 --2- 172.21.15.79:0/3933337736 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2b74003a00 0x7f2b74003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:32.170 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b87fff700 1 --2- 172.21.15.79:0/3933337736 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2b74005200 0x7f2b7400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:45:32.171 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b86ffd700 1 -- 172.21.15.79:0/3933337736 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2b74005200 msgr2=0x7f2b7400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:32.171 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b86ffd700 1 --2- 172.21.15.79:0/3933337736 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x7f2b74005200 0x7f2b7400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:32.171 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b86ffd700 1 -- 172.21.15.79:0/3933337736 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2b74003a00 msgr2=0x7f2b74003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:45:32.171 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b86ffd700 1 --2- 172.21.15.79:0/3933337736 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x7f2b74003a00 0x7f2b74003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:45:32.172 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b86ffd700 1 -- 172.21.15.79:0/3933337736 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740035b0 con 0x7f2b74004850 2022-12-01T09:45:32.172 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.149+0000 7f2b87fff700 1 -- 172.21.15.79:0/3933337736 reap_dead start 2022-12-01T09:45:32.172 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.150+0000 7f2b86ffd700 1 --2- 172.21.15.79:0/3933337736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b74004850 0x7f2b74004cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0017c0 tx=0x7f2b74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2eddaea4fc9b9f4 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:45:32.172 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.150+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c0052d0 con 0x7f2b74004850 2022-12-01T09:45:32.173 INFO:teuthology.orchestra.run.smithi079.stderr:2022-12-01T09:45:32.150+0000 7f2b867fc700 1 -- 172.21.15.79:0/3933337736 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c005430 con 0x7f2b74004850 2022-1