2022-12-01T09:32:32.107 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf 2022-12-01T09:32:32.109 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_khiremat@teuthology --name khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi --verbose --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} --archive /home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090976 -- /home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090976/orig.config.yaml 2022-12-01T09:32:32.161 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-12-01T09:32:32.253 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090976 branch: wip-khiremat-47893-test-mgr-finisher-thread-5 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} email: null first_in_suite: false job_id: '7090976' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-khiremat-47893-test-mgr-finisher-thread-5 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-khiremat-47893-test-mgr-finisher-thread-5 sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 owner: scheduled_khiremat@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 sleep_before_teardown: 0 suite: fs:volumes suite_branch: wip-khiremat-47893-test-mgr-finisher-thread-5 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f6922ca21f63dad2b198f92826f75d268f12fc97/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi033.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCU5K+iSOct0/GpdgNFOLbMw2Md3rElP+7vCBZqJCUnY1qOE2O0Esus38MorvaP0+V+BYms3Of/1rzQ6FV63twPbuU8FI8E3LSIGKwLpDYHlmpWdJ1cBQ6MLYI+yHYkDKGY3Uy3WKN6J/DrREE7wb0HgWQ8rdg+BnfeWToIIkY7JYcZfjN9tFSrXuvqMW6JmAL3sIxlmSZzTIt0REBru8oM5hFpAmEy2t42gnJTN5mvXDe5E8BMn4+IAy2cOXkVxAMYG8qIIoeYjZ4MRDvR1kNA+z5KHKXoqmfWSxEu6vhR6Uwfx96MW0vKYYF7YXtSbHUQg3Kd0eSPZGR9L2jjmn+i4oyHo+mXqS45GFbxq98n7Q1UK5r05k6hQZA00lVR4lhQZg4OXIVGCSPx6d2oZIHV4/F3Wm1ZQ26shv6QXBhnoGykJVQ2maqp84OJLe05KSPRCMPqeCAuM/b5f1eaYRtT3BRVnoBVz1SAiatcQh2nIkH34/ZJjU3cOy3qaggwc58= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSSHHPRSNTRUwZpIdve/83WPpP0Z/Iatvpm23NM8z85EaPQFmgKwfIdTKYCz0TJ4BcOvVMu7XNQlTmXBTcHUgA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots - tasks.cephfs.test_volumes.TestSubvolumeSnapshots teuthology_branch: main teuthology_sha1: 4da97cf64e542f347ec47b7bdbe5eca99759f9b7 timestamp: 2022-11-24_05:02:42 tube: smithi user: khiremat verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23126 2022-12-01T09:32:32.253 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f6922ca21f63dad2b198f92826f75d268f12fc97/qa; will attempt to use it 2022-12-01T09:32:32.254 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f6922ca21f63dad2b198f92826f75d268f12fc97/qa/tasks 2022-12-01T09:32:32.255 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-12-01T09:32:32.257 INFO:teuthology.task.internal:Checking packages... 2022-12-01T09:32:32.283 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f6922ca21f63dad2b198f92826f75d268f12fc97' 2022-12-01T09:32:32.283 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-12-01T09:32:32.284 INFO:teuthology.packaging:ref: None 2022-12-01T09:32:32.284 INFO:teuthology.packaging:tag: None 2022-12-01T09:32:32.285 INFO:teuthology.packaging:branch: wip-khiremat-47893-test-mgr-finisher-thread-5 2022-12-01T09:32:32.285 INFO:teuthology.packaging:sha1: f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:32:32.285 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-khiremat-47893-test-mgr-finisher-thread-5 2022-12-01T09:32:32.609 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-676.gf6922ca2 2022-12-01T09:32:32.610 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-12-01T09:32:32.616 INFO:teuthology.task.internal:no buildpackages task found 2022-12-01T09:32:32.617 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-12-01T09:32:32.624 INFO:teuthology.task.internal:Saving configuration 2022-12-01T09:32:32.642 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-12-01T09:32:32.649 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-12-01T09:32:32.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090976', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-12-01 09:27:26.102109', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCCPPQDOcmsjP5Cqt67W5BTJ3WcM+/AlakyBgEeH4TpzqrvHHcwBZ3M8QXRTQGMSN5KnAyGDeWY39LjhKaHcdGo='} 2022-12-01T09:32:32.700 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090976', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-12-01 09:27:26.103944', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSSHHPRSNTRUwZpIdve/83WPpP0Z/Iatvpm23NM8z85EaPQFmgKwfIdTKYCz0TJ4BcOvVMu7XNQlTmXBTcHUgA='} 2022-12-01T09:32:32.700 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-12-01T09:32:32.707 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-12-01T09:32:32.708 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-12-01T09:32:32.708 INFO:teuthology.run_tasks:Running task console_log... 2022-12-01T09:32:32.799 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f058d0068c8>, signals=[15]) 2022-12-01T09:32:32.801 INFO:teuthology.run_tasks:Running task internal.connect... 2022-12-01T09:32:32.807 INFO:teuthology.task.internal:Opening connections... 2022-12-01T09:32:32.808 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2022-12-01T09:32:32.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-12-01T09:32:32.899 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2022-12-01T09:32:32.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-12-01T09:32:32.975 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-12-01T09:32:32.982 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2022-12-01T09:32:33.006 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2022-12-01T09:32:33.007 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2022-12-01T09:32:33.069 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2022-12-01T09:32:33.070 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2022-12-01T09:32:33.070 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2022-12-01T09:32:33.070 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2022-12-01T09:32:33.071 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2022-12-01T09:32:33.071 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2022-12-01T09:32:33.071 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2022-12-01T09:32:33.072 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2022-12-01T09:32:33.072 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-12-01T09:32:33.072 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2022-12-01T09:32:33.072 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-01T09:32:33.073 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-01T09:32:33.073 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-12-01T09:32:33.074 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2022-12-01T09:32:33.097 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2022-12-01T09:32:33.116 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2022-12-01T09:32:33.116 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2022-12-01T09:32:33.174 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2022-12-01T09:32:33.175 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2022-12-01T09:32:33.175 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2022-12-01T09:32:33.175 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2022-12-01T09:32:33.175 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2022-12-01T09:32:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2022-12-01T09:32:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2022-12-01T09:32:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2022-12-01T09:32:33.177 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-12-01T09:32:33.177 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2022-12-01T09:32:33.177 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-01T09:32:33.178 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-01T09:32:33.178 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-12-01T09:32:33.179 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-12-01T09:32:33.202 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-12-01T09:32:33.212 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-12-01T09:32:33.218 INFO:teuthology.task.internal:Checking for old test directory... 2022-12-01T09:32:33.218 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2022-12-01T09:32:33.221 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2022-12-01T09:32:33.239 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-12-01T09:32:33.246 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-12-01T09:32:33.247 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2022-12-01T09:32:33.281 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2022-12-01T09:32:33.310 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-12-01T09:32:33.380 INFO:teuthology.run_tasks:Running task kernel... 2022-12-01T09:32:33.396 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-12-01T09:32:33.397 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-12-01T09:32:33.398 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2022-12-01T09:32:33.399 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2022-12-01T09:32:33.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-12-01T09:32:33.417 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2022-12-01T09:32:33.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-12-01T09:32:33.420 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2022-12-01T09:32:33.475 INFO:teuthology.orchestra.run.smithi156.stdout:4.18.0-408.el8.x86_64 2022-12-01T09:32:33.476 INFO:teuthology.task.kernel:Running kernel on smithi156: 4.18.0-408.el8.x86_64 2022-12-01T09:32:33.476 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum install -y kernel 2022-12-01T09:32:33.481 INFO:teuthology.orchestra.run.smithi033.stdout:4.18.0-408.el8.x86_64 2022-12-01T09:32:33.482 INFO:teuthology.task.kernel:Running kernel on smithi033: 4.18.0-408.el8.x86_64 2022-12-01T09:32:33.482 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2022-12-01T09:32:36.642 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-8 - AppStream 34 MB/s | 26 MB 00:00 2022-12-01T09:32:36.791 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - AppStream 32 MB/s | 26 MB 00:00 2022-12-01T09:32:41.759 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-8 - BaseOS 46 MB/s | 26 MB 00:00 2022-12-01T09:32:42.349 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - BaseOS 38 MB/s | 26 MB 00:00 2022-12-01T09:32:45.766 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-8 - Extras 155 kB/s | 18 kB 00:00 2022-12-01T09:32:46.152 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-8 - PowerTools 20 MB/s | 5.3 MB 00:00 2022-12-01T09:32:46.664 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - Extras 139 kB/s | 18 kB 00:00 2022-12-01T09:32:47.041 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - PowerTools 21 MB/s | 5.3 MB 00:00 2022-12-01T09:32:48.943 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 2.0 kB/s | 3.5 kB 00:01 2022-12-01T09:32:49.424 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 2.7 kB/s | 3.5 kB 00:01 2022-12-01T09:32:54.126 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 2.6 MB/s | 13 MB 00:05 2022-12-01T09:32:57.418 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 445 kB/s | 24 kB 00:00 2022-12-01T09:32:59.706 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 13 MB 00:10 2022-12-01T09:33:00.374 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2022-12-01T09:33:00.375 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-12-01T09:33:00.501 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2022-12-01T09:33:00.502 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2022-12-01T09:33:00.503 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2022-12-01T09:33:00.604 DEBUG:teuthology.orchestra.run.smithi156:> echo no | sudo yum reinstall kernel || true 2022-12-01T09:33:01.189 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:00:04 ago on Thu 01 Dec 2022 09:32:57 AM UTC. 2022-12-01T09:33:02.280 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2022-12-01T09:33:02.281 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2022-12-01T09:33:02.281 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2022-12-01T09:33:02.281 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2022-12-01T09:33:02.282 INFO:teuthology.orchestra.run.smithi156.stdout:Reinstalling: 2022-12-01T09:33:02.282 INFO:teuthology.orchestra.run.smithi156.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-12-01T09:33:02.282 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:33:02.282 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2022-12-01T09:33:02.283 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2022-12-01T09:33:02.283 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:33:02.283 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 8.5 M 2022-12-01T09:33:02.283 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 0 2022-12-01T09:33:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:Operation aborted. 2022-12-01T09:33:02.373 INFO:teuthology.orchestra.run.smithi156.stdout:Is this ok [y/N]: 2022-12-01T09:33:02.373 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum reinstall -y kernel || true 2022-12-01T09:33:02.955 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:00:05 ago on Thu 01 Dec 2022 09:32:57 AM UTC. 2022-12-01T09:33:03.081 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 651 kB/s | 24 kB 00:00 2022-12-01T09:33:04.022 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2022-12-01T09:33:04.023 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2022-12-01T09:33:04.024 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2022-12-01T09:33:04.024 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2022-12-01T09:33:04.024 INFO:teuthology.orchestra.run.smithi156.stdout:Reinstalling: 2022-12-01T09:33:04.024 INFO:teuthology.orchestra.run.smithi156.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-12-01T09:33:04.025 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:33:04.025 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2022-12-01T09:33:04.025 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2022-12-01T09:33:04.025 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:33:04.026 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 8.5 M 2022-12-01T09:33:04.026 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 0 2022-12-01T09:33:04.026 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2022-12-01T09:33:04.227 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-4.18.0-408.el8.x86_64.rpm 42 MB/s | 8.5 MB 00:00 2022-12-01T09:33:04.228 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2022-12-01T09:33:04.229 INFO:teuthology.orchestra.run.smithi156.stdout:Total 42 MB/s | 8.5 MB 00:00 2022-12-01T09:33:04.323 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2022-12-01T09:33:04.731 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2022-12-01T09:33:04.732 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2022-12-01T09:33:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2022-12-01T09:33:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2022-12-01T09:33:05.265 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2022-12-01T09:33:05.456 INFO:teuthology.orchestra.run.smithi156.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2022-12-01T09:33:05.456 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2022-12-01T09:33:05.867 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2022-12-01T09:33:05.867 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2022-12-01T09:33:06.171 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2022-12-01T09:33:06.171 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-12-01T09:33:06.317 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-12-01T09:33:06.318 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-12-01T09:33:06.319 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-12-01T09:33:06.364 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2022-12-01T09:33:06.365 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:33:06.365 INFO:teuthology.orchestra.run.smithi156.stdout:Reinstalled: 2022-12-01T09:33:06.366 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-4.18.0-408.el8.x86_64 2022-12-01T09:33:06.366 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:33:06.366 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2022-12-01T09:33:06.433 DEBUG:teuthology.orchestra.run.smithi033:> echo no | sudo yum reinstall kernel || true 2022-12-01T09:33:06.486 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q kernel --last | head -n 1 2022-12-01T09:33:06.623 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-4.18.0-408.el8.x86_64 Thu 01 Dec 2022 09:33:05 AM UTC 2022-12-01T09:33:06.625 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2022-12-01T09:33:06.625 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-12-01T09:33:06.626 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2022-12-01T09:33:06.626 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-12-01T09:33:06.663 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2022-12-01T09:33:06.685 DEBUG:teuthology.parallel:result is None 2022-12-01T09:33:07.045 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:04 ago on Thu 01 Dec 2022 09:33:03 AM UTC. 2022-12-01T09:33:08.211 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-12-01T09:33:08.213 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-12-01T09:33:08.213 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-12-01T09:33:08.213 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-12-01T09:33:08.214 INFO:teuthology.orchestra.run.smithi033.stdout:Reinstalling: 2022-12-01T09:33:08.214 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-12-01T09:33:08.214 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:33:08.214 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-12-01T09:33:08.215 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-12-01T09:33:08.215 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:33:08.215 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 8.5 M 2022-12-01T09:33:08.215 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 0 2022-12-01T09:33:08.216 INFO:teuthology.orchestra.run.smithi033.stderr:Operation aborted. 2022-12-01T09:33:08.298 INFO:teuthology.orchestra.run.smithi033.stdout:Is this ok [y/N]: 2022-12-01T09:33:08.299 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum reinstall -y kernel || true 2022-12-01T09:33:08.910 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:05 ago on Thu 01 Dec 2022 09:33:03 AM UTC. 2022-12-01T09:33:10.061 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-12-01T09:33:10.062 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-12-01T09:33:10.063 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-12-01T09:33:10.063 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-12-01T09:33:10.063 INFO:teuthology.orchestra.run.smithi033.stdout:Reinstalling: 2022-12-01T09:33:10.063 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-12-01T09:33:10.063 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:33:10.064 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-12-01T09:33:10.064 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-12-01T09:33:10.064 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:33:10.064 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 8.5 M 2022-12-01T09:33:10.065 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 0 2022-12-01T09:33:10.065 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-12-01T09:33:10.283 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-408.el8.x86_64.rpm 39 MB/s | 8.5 MB 00:00 2022-12-01T09:33:10.284 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-12-01T09:33:10.284 INFO:teuthology.orchestra.run.smithi033.stdout:Total 39 MB/s | 8.5 MB 00:00 2022-12-01T09:33:10.383 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-12-01T09:33:10.816 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-12-01T09:33:10.817 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-12-01T09:33:11.001 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-12-01T09:33:11.034 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-12-01T09:33:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-12-01T09:33:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2022-12-01T09:33:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2022-12-01T09:33:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2022-12-01T09:33:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2022-12-01T09:33:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2022-12-01T09:33:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:33:12.653 INFO:teuthology.orchestra.run.smithi033.stdout:Reinstalled: 2022-12-01T09:33:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-4.18.0-408.el8.x86_64 2022-12-01T09:33:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:33:12.653 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-12-01T09:33:12.790 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel --last | head -n 1 2022-12-01T09:33:12.967 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-408.el8.x86_64 Thu 01 Dec 2022 09:33:11 AM UTC 2022-12-01T09:33:12.968 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2022-12-01T09:33:12.969 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-12-01T09:33:12.969 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2022-12-01T09:33:12.969 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-12-01T09:33:13.001 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2022-12-01T09:33:13.014 DEBUG:teuthology.parallel:result is None 2022-12-01T09:33:13.015 INFO:teuthology.run_tasks:Running task internal.base... 2022-12-01T09:33:13.026 INFO:teuthology.task.internal:Creating test directory... 2022-12-01T09:33:13.027 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-12-01T09:33:13.057 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-12-01T09:33:13.077 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-12-01T09:33:13.084 INFO:teuthology.run_tasks:Running task internal.archive... 2022-12-01T09:33:13.092 INFO:teuthology.task.internal:Creating archive directory... 2022-12-01T09:33:13.093 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-12-01T09:33:13.116 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-12-01T09:33:13.155 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-12-01T09:33:13.162 INFO:teuthology.task.internal:Enabling coredump saving... 2022-12-01T09:33:13.162 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-12-01T09:33:13.188 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-12-01T09:33:13.217 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-12-01T09:33:13.226 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-12-01T09:33:13.227 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-12-01T09:33:13.237 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-12-01T09:33:13.238 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-12-01T09:33:13.246 INFO:teuthology.task.internal:Configuring sudo... 2022-12-01T09:33:13.246 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-12-01T09:33:13.272 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-12-01T09:33:13.308 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-12-01T09:33:13.318 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-12-01T09:33:13.318 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-12-01T09:33:13.339 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-12-01T09:33:13.367 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-12-01T09:33:13.443 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-12-01T09:33:13.494 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-12-01T09:33:13.578 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-12-01T09:33:13.623 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:33:13.624 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-12-01T09:33:13.691 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-12-01T09:33:13.736 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-12-01T09:33:13.787 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-12-01T09:33:13.871 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-12-01T09:33:13.916 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:33:13.916 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-12-01T09:33:13.983 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2022-12-01T09:33:13.986 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2022-12-01T09:33:14.044 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-12-01T09:33:14.093 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-12-01T09:33:14.316 INFO:teuthology.run_tasks:Running task internal.timer... 2022-12-01T09:33:14.325 INFO:teuthology.task.internal:Starting timer... 2022-12-01T09:33:14.325 INFO:teuthology.run_tasks:Running task pcp... 2022-12-01T09:33:14.337 INFO:teuthology.run_tasks:Running task selinux... 2022-12-01T09:33:14.346 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-12-01T09:33:14.346 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2022-12-01T09:33:14.409 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2022-12-01T09:33:14.411 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2022-12-01T09:33:14.520 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2022-12-01T09:33:14.521 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-12-01T09:33:14.522 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2022-12-01T09:33:14.550 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2022-12-01T09:33:14.550 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2022-12-01T09:33:14.583 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2022-12-01T09:33:14.584 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive'} 2022-12-01T09:33:14.585 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-12-01T09:33:14.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-12-01T09:33:14.620 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-12-01T09:33:14.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-12-01T09:33:14.652 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-12-01T09:33:14.652 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2022-12-01T09:33:14.697 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2022-12-01T09:33:14.734 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-12-01T09:33:14.744 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2022-12-01T09:33:14.752 INFO:teuthology.repo_utils:Fetching main from origin 2022-12-01T09:33:14.882 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2022-12-01T09:33:14.904 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-12-01T09:33:14.906 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2022-12-01T09:40:12.433 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2022-12-01T09:40:12.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-12-01T09:40:12.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-12-01T09:40:12.522 DEBUG:teuthology.orchestra.run.smithi033:> true 2022-12-01T09:40:12.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2022-12-01T09:40:12.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-12-01T09:40:12.666 DEBUG:teuthology.orchestra.run.smithi156:> true 2022-12-01T09:40:12.737 INFO:teuthology.run_tasks:Running task clock... 2022-12-01T09:40:12.754 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-12-01T09:40:12.755 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-12-01T09:40:12.758 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-12-01T09:40:12.760 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-12-01T09:40:12.761 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-12-01T09:40:12.793 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-12-01T09:40:12.808 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-12-01T09:40:12.809 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-12-01T09:40:12.822 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-12-01T09:40:12.876 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2022-12-01T09:40:12.888 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2022-12-01T09:40:12.893 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2022-12-01T09:40:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-12-01T09:40:12.904 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2022-12-01T09:40:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-12-01T09:40:12.918 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-12-01T09:40:12.931 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-12-01T09:40:12.986 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2022-12-01T09:40:12.989 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-12-01T09:40:12.989 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2022-12-01T09:40:12.990 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:40:12.990 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:40:12.990 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:40:12.990 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:40:12.997 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2022-12-01T09:40:13.000 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-12-01T09:40:13.001 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2022-12-01T09:40:13.001 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:40:13.001 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:40:13.002 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:40:13.002 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-12-01T09:40:13.003 INFO:teuthology.run_tasks:Running task install... 2022-12-01T09:40:13.014 DEBUG:teuthology.task.install:project ceph 2022-12-01T09:40:13.015 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}} 2022-12-01T09:40:13.016 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'} 2022-12-01T09:40:13.016 INFO:teuthology.task.install:Using flavor: default 2022-12-01T09:40:13.024 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-12-01T09:40:13.025 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-12-01T09:40:13.026 DEBUG:teuthology.orchestra.run.smithi033:> sudo lsb_release -is 2022-12-01T09:40:13.069 INFO:teuthology.orchestra.run.smithi033.stdout:CentOSStream 2022-12-01T09:40:13.070 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-12-01T09:40:13.071 DEBUG:teuthology.orchestra.run.smithi156:> sudo lsb_release -is 2022-12-01T09:40:13.071 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97', 'tag': None, 'wait_for_package': False} 2022-12-01T09:40:13.072 DEBUG:teuthology.orchestra.run.smithi033:> sudo lsb_release -is 2022-12-01T09:40:13.110 INFO:teuthology.orchestra.run.smithi156.stdout:CentOSStream 2022-12-01T09:40:13.111 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-12-01T09:40:13.111 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97', 'tag': None, 'wait_for_package': False} 2022-12-01T09:40:13.112 DEBUG:teuthology.orchestra.run.smithi156:> sudo lsb_release -is 2022-12-01T09:40:13.149 INFO:teuthology.orchestra.run.smithi033.stdout:CentOSStream 2022-12-01T09:40:13.150 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-12-01T09:40:13.151 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:40:13.192 INFO:teuthology.orchestra.run.smithi156.stdout:CentOSStream 2022-12-01T09:40:13.203 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-12-01T09:40:13.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:40:13.435 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/ 2022-12-01T09:40:13.436 INFO:teuthology.task.install.rpm:Package version is 18.0.0-676.gf6922ca2 2022-12-01T09:40:13.484 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/ 2022-12-01T09:40:13.484 INFO:teuthology.task.install.rpm:Package version is 18.0.0-676.gf6922ca2 2022-12-01T09:40:13.618 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-12-01T09:40:13.619 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:40:13.619 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-12-01T09:40:13.649 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-12-01T09:40:13.649 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f6922ca21f63dad2b198f92826f75d268f12fc97/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-12-01T09:40:13.720 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-12-01T09:40:13.726 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-khiremat-47893-test-mgr-finisher-thread-5/f6922ca21f63dad2b198f92826f75d268f12fc97/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-12-01T09:40:13.726 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:40:13.727 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-12-01T09:40:13.755 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-12-01T09:40:13.756 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f6922ca21f63dad2b198f92826f75d268f12fc97/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-12-01T09:40:13.800 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-12-01T09:40:13.824 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-12-01T09:40:13.868 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2022-12-01T09:40:13.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2022-12-01T09:40:13.901 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-12-01T09:40:13.967 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2022-12-01T09:40:13.969 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2022-12-01T09:40:14.138 INFO:teuthology.orchestra.run.smithi033.stdout:64 files removed 2022-12-01T09:40:14.168 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-12-01T09:40:14.229 INFO:teuthology.orchestra.run.smithi156.stdout:64 files removed 2022-12-01T09:40:14.257 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-12-01T09:40:15.265 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 114 kB/s | 81 kB 00:00 2022-12-01T09:40:15.540 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 88 kB/s | 81 kB 00:00 2022-12-01T09:40:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2022-12-01T09:40:15.857 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2022-12-01T09:40:15.933 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 6.1 kB/s | 1.5 kB 00:00 2022-12-01T09:40:16.132 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2022-12-01T09:40:16.619 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - AppStream 39 MB/s | 26 MB 00:00 2022-12-01T09:40:16.851 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-8 - AppStream 37 MB/s | 26 MB 00:00 2022-12-01T09:40:22.102 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-8 - BaseOS 43 MB/s | 26 MB 00:00 2022-12-01T09:40:22.420 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - BaseOS 34 MB/s | 26 MB 00:00 2022-12-01T09:40:26.033 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-8 - Extras 182 kB/s | 18 kB 00:00 2022-12-01T09:40:26.428 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-8 - PowerTools 19 MB/s | 5.3 MB 00:00 2022-12-01T09:40:26.618 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - Extras 152 kB/s | 18 kB 00:00 2022-12-01T09:40:27.004 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - PowerTools 20 MB/s | 5.3 MB 00:00 2022-12-01T09:40:28.868 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 2.4 kB/s | 3.5 kB 00:01 2022-12-01T09:40:29.212 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 3.1 kB/s | 3.5 kB 00:01 2022-12-01T09:40:37.120 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 1.7 MB/s | 13 MB 00:07 2022-12-01T09:40:37.710 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 1.5 MB/s | 13 MB 00:08 2022-12-01T09:40:40.444 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 469 kB/s | 24 kB 00:00 2022-12-01T09:40:40.893 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 390 kB/s | 24 kB 00:00 2022-12-01T09:40:43.725 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-12-01T09:40:43.725 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-12-01T09:40:43.737 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-1:1.40.0-1.el8.x86_64 is already installed. 2022-12-01T09:40:43.737 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-initscripts-updown-1:1.40.0-1.el8.noarch is already installed. 2022-12-01T09:40:43.738 INFO:teuthology.orchestra.run.smithi033.stdout:Package iproute-5.18.0-1.el8.x86_64 is already installed. 2022-12-01T09:40:43.739 INFO:teuthology.orchestra.run.smithi033.stdout:Package util-linux-2.32.1-38.el8.x86_64 is already installed. 2022-12-01T09:40:43.740 INFO:teuthology.orchestra.run.smithi033.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-12-01T09:40:43.741 INFO:teuthology.orchestra.run.smithi033.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-12-01T09:40:43.744 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-12-01T09:40:43.745 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-12-01T09:40:43.870 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-12-01T09:40:43.883 INFO:teuthology.orchestra.run.smithi033.stdout:========================================================================================================= 2022-12-01T09:40:43.884 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2022-12-01T09:40:43.884 INFO:teuthology.orchestra.run.smithi033.stdout:========================================================================================================= 2022-12-01T09:40:43.884 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-12-01T09:40:43.884 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-12-01T09:40:43.885 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 6.4 k 2022-12-01T09:40:43.885 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 5.2 M 2022-12-01T09:40:43.885 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 845 k 2022-12-01T09:40:43.886 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 165 k 2022-12-01T09:40:43.886 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 1.5 M 2022-12-01T09:40:43.886 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 118 k 2022-12-01T09:40:43.886 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 1.7 M 2022-12-01T09:40:43.887 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 7.4 M 2022-12-01T09:40:43.887 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 47 k 2022-12-01T09:40:43.887 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 18 M 2022-12-01T09:40:43.887 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 55 M 2022-12-01T09:40:43.888 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 263 k 2022-12-01T09:40:43.888 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 81 k 2022-12-01T09:40:43.888 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 257 k 2022-12-01T09:40:43.888 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 15 k 2022-12-01T09:40:43.889 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.188-3.el8 CentOS-BaseOS 61 k 2022-12-01T09:40:43.889 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-12-01T09:40:43.889 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 19 k 2022-12-01T09:40:43.889 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 30 k 2022-12-01T09:40:43.890 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 768 k 2022-12-01T09:40:43.890 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 139 k 2022-12-01T09:40:43.890 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-12-01T09:40:43.890 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.32.1-38.el8 CentOS-BaseOS 99 k 2022-12-01T09:40:43.891 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:1.1.1k-7.el8 CentOS-BaseOS 2.3 M 2022-12-01T09:40:43.891 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 1.5 M 2022-12-01T09:40:43.891 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 807 k 2022-12-01T09:40:43.891 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 5.1 M 2022-12-01T09:40:43.892 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 190 k 2022-12-01T09:40:43.892 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 370 k 2022-12-01T09:40:43.892 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 364 k 2022-12-01T09:40:43.892 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 107 k 2022-12-01T09:40:43.893 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 94 k 2022-12-01T09:40:43.893 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.5 M 2022-12-01T09:40:43.893 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 177 k 2022-12-01T09:40:43.894 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-BaseOS 72 k 2022-12-01T09:40:43.894 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2022-12-01T09:40:43.894 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-initscripts-updown noarch 1:1.40.4-1.el8 CentOS-BaseOS 141 k 2022-12-01T09:40:43.894 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-debuginfod-client x86_64 0.188-3.el8 CentOS-BaseOS 75 k 2022-12-01T09:40:43.895 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf x86_64 0.188-3.el8 CentOS-BaseOS 231 k 2022-12-01T09:40:43.895 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libs x86_64 0.188-3.el8 CentOS-BaseOS 299 k 2022-12-01T09:40:43.895 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.6 M 2022-12-01T09:40:43.895 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.6 M 2022-12-01T09:40:43.895 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-12-01T09:40:43.896 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-12-01T09:40:43.896 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 24 M 2022-12-01T09:40:43.896 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 23 k 2022-12-01T09:40:43.896 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 2.3 M 2022-12-01T09:40:43.897 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 234 k 2022-12-01T09:40:43.897 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.9 M 2022-12-01T09:40:43.897 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 17 M 2022-12-01T09:40:43.897 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 14 k 2022-12-01T09:40:43.897 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 24 k 2022-12-01T09:40:43.898 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2022-12-01T09:40:43.898 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-12-01T09:40:43.898 INFO:teuthology.orchestra.run.smithi033.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2022-12-01T09:40:43.899 INFO:teuthology.orchestra.run.smithi033.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-BaseOS 48 k 2022-12-01T09:40:43.899 INFO:teuthology.orchestra.run.smithi033.stdout: krb5-devel x86_64 1.18.2-21.el8 CentOS-BaseOS 560 k 2022-12-01T09:40:43.899 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 137 k 2022-12-01T09:40:43.899 INFO:teuthology.orchestra.run.smithi033.stdout: libcom_err-devel x86_64 1.45.6-5.el8 CentOS-BaseOS 39 k 2022-12-01T09:40:43.899 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 8.5.0-17.el8 CentOS-BaseOS 645 k 2022-12-01T09:40:43.900 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-12-01T09:40:43.900 INFO:teuthology.orchestra.run.smithi033.stdout: libpq x86_64 13.5-1.el8 CentOS-AppStream 198 k 2022-12-01T09:40:43.900 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 8.5.0-17.el8 CentOS-BaseOS 172 k 2022-12-01T09:40:43.900 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2022-12-01T09:40:43.900 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 474 k 2022-12-01T09:40:43.901 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-12-01T09:40:43.901 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 6.5 M 2022-12-01T09:40:43.901 INFO:teuthology.orchestra.run.smithi033.stdout: libselinux-devel x86_64 2.9-6.el8 CentOS-BaseOS 200 k 2022-12-01T09:40:43.901 INFO:teuthology.orchestra.run.smithi033.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-BaseOS 87 k 2022-12-01T09:40:43.901 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-12-01T09:40:43.902 INFO:teuthology.orchestra.run.smithi033.stdout: libverto-devel x86_64 0.3.2-2.el8 CentOS-BaseOS 18 k 2022-12-01T09:40:43.902 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-12-01T09:40:43.902 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-12-01T09:40:43.902 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2022-12-01T09:40:43.903 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2022-12-01T09:40:43.903 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-devel x86_64 10.32-3.el8 CentOS-BaseOS 605 k 2022-12-01T09:40:43.903 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf16 x86_64 10.32-3.el8 CentOS-BaseOS 229 k 2022-12-01T09:40:43.903 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf32 x86_64 10.32-3.el8 CentOS-BaseOS 220 k 2022-12-01T09:40:43.904 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-12-01T09:40:43.904 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-12-01T09:40:43.904 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-12-01T09:40:43.905 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-12-01T09:40:43.905 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-12-01T09:40:43.905 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 45 k 2022-12-01T09:40:43.905 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 109 k 2022-12-01T09:40:43.905 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-12-01T09:40:43.906 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2022-12-01T09:40:43.906 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-12-01T09:40:43.906 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-12-01T09:40:43.906 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2022-12-01T09:40:43.907 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-12-01T09:40:43.907 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-12-01T09:40:43.907 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-12-01T09:40:43.907 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-12-01T09:40:43.908 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-12-01T09:40:43.908 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-12-01T09:40:43.908 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2022-12-01T09:40:43.909 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-12-01T09:40:43.909 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-12-01T09:40:43.910 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-12-01T09:40:43.910 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-12-01T09:40:43.911 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-12-01T09:40:43.911 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-12-01T09:40:43.912 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-12-01T09:40:43.912 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-12-01T09:40:43.912 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2022-12-01T09:40:43.913 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-12-01T09:40:43.913 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-12-01T09:40:43.913 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-12-01T09:40:43.914 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-12-01T09:40:43.914 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-12-01T09:40:43.914 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-12-01T09:40:43.915 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2022-12-01T09:40:43.915 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-12-01T09:40:43.916 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-12-01T09:40:43.916 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2022-12-01T09:40:43.916 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-12-01T09:40:43.916 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-12-01T09:40:43.917 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-12-01T09:40:43.917 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-12-01T09:40:43.917 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-12-01T09:40:43.917 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-12-01T09:40:43.917 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-12-01T09:40:43.918 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-12-01T09:40:43.918 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-12-01T09:40:43.918 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-12-01T09:40:43.918 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-12-01T09:40:43.919 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-12-01T09:40:43.919 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-12-01T09:40:43.919 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-12-01T09:40:43.919 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-12-01T09:40:43.920 INFO:teuthology.orchestra.run.smithi033.stdout: uuid x86_64 1.6.2-43.el8 CentOS-AppStream 64 k 2022-12-01T09:40:43.920 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2022-12-01T09:40:43.920 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-20.el8 CentOS-BaseOS 58 k 2022-12-01T09:40:43.920 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling module streams: 2022-12-01T09:40:43.920 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql 10 2022-12-01T09:40:43.921 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:40:43.921 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-12-01T09:40:43.921 INFO:teuthology.orchestra.run.smithi033.stdout:========================================================================================================= 2022-12-01T09:40:43.921 INFO:teuthology.orchestra.run.smithi033.stdout:Install 127 Packages 2022-12-01T09:40:43.921 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 6 Packages 2022-12-01T09:40:43.922 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:40:43.923 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 217 M 2022-12-01T09:40:43.923 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-12-01T09:40:44.010 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-12-01T09:40:44.010 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-12-01T09:40:44.022 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-1:1.40.0-1.el8.x86_64 is already installed. 2022-12-01T09:40:44.022 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-initscripts-updown-1:1.40.0-1.el8.noarch is already installed. 2022-12-01T09:40:44.023 INFO:teuthology.orchestra.run.smithi156.stdout:Package iproute-5.18.0-1.el8.x86_64 is already installed. 2022-12-01T09:40:44.023 INFO:teuthology.orchestra.run.smithi156.stdout:Package util-linux-2.32.1-38.el8.x86_64 is already installed. 2022-12-01T09:40:44.024 INFO:teuthology.orchestra.run.smithi156.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-12-01T09:40:44.026 INFO:teuthology.orchestra.run.smithi156.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-12-01T09:40:44.028 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-12-01T09:40:44.029 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-12-01T09:40:44.088 INFO:teuthology.orchestra.run.smithi033.stdout:(1/133): ceph-18.0.0-676.gf6922ca2.el8.x86_64.r 35 kB/s | 6.4 kB 00:00 2022-12-01T09:40:44.142 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2022-12-01T09:40:44.154 INFO:teuthology.orchestra.run.smithi156.stdout:========================================================================================================= 2022-12-01T09:40:44.154 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2022-12-01T09:40:44.155 INFO:teuthology.orchestra.run.smithi156.stdout:========================================================================================================= 2022-12-01T09:40:44.155 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2022-12-01T09:40:44.155 INFO:teuthology.orchestra.run.smithi156.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-12-01T09:40:44.155 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 6.4 k 2022-12-01T09:40:44.156 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 5.2 M 2022-12-01T09:40:44.156 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 845 k 2022-12-01T09:40:44.156 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 165 k 2022-12-01T09:40:44.156 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 1.5 M 2022-12-01T09:40:44.157 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 118 k 2022-12-01T09:40:44.157 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 1.7 M 2022-12-01T09:40:44.157 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 7.4 M 2022-12-01T09:40:44.157 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 47 k 2022-12-01T09:40:44.158 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 18 M 2022-12-01T09:40:44.158 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 55 M 2022-12-01T09:40:44.158 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 263 k 2022-12-01T09:40:44.158 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 81 k 2022-12-01T09:40:44.159 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 257 k 2022-12-01T09:40:44.159 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 15 k 2022-12-01T09:40:44.159 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel x86_64 0.188-3.el8 CentOS-BaseOS 61 k 2022-12-01T09:40:44.159 INFO:teuthology.orchestra.run.smithi156.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-12-01T09:40:44.160 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 19 k 2022-12-01T09:40:44.160 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 30 k 2022-12-01T09:40:44.160 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 768 k 2022-12-01T09:40:44.160 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 139 k 2022-12-01T09:40:44.161 INFO:teuthology.orchestra.run.smithi156.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-12-01T09:40:44.161 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel x86_64 2.32.1-38.el8 CentOS-BaseOS 99 k 2022-12-01T09:40:44.161 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel x86_64 1:1.1.1k-7.el8 CentOS-BaseOS 2.3 M 2022-12-01T09:40:44.161 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 1.5 M 2022-12-01T09:40:44.162 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 807 k 2022-12-01T09:40:44.162 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 5.1 M 2022-12-01T09:40:44.162 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 190 k 2022-12-01T09:40:44.163 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 370 k 2022-12-01T09:40:44.163 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 364 k 2022-12-01T09:40:44.163 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 107 k 2022-12-01T09:40:44.163 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 94 k 2022-12-01T09:40:44.164 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.5 M 2022-12-01T09:40:44.164 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 177 k 2022-12-01T09:40:44.164 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-BaseOS 72 k 2022-12-01T09:40:44.165 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2022-12-01T09:40:44.165 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown noarch 1:1.40.4-1.el8 CentOS-BaseOS 141 k 2022-12-01T09:40:44.166 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-debuginfod-client x86_64 0.188-3.el8 CentOS-BaseOS 75 k 2022-12-01T09:40:44.166 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf x86_64 0.188-3.el8 CentOS-BaseOS 231 k 2022-12-01T09:40:44.166 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libs x86_64 0.188-3.el8 CentOS-BaseOS 299 k 2022-12-01T09:40:44.166 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.6 M 2022-12-01T09:40:44.166 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.6 M 2022-12-01T09:40:44.167 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2022-12-01T09:40:44.167 INFO:teuthology.orchestra.run.smithi156.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-12-01T09:40:44.167 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 24 M 2022-12-01T09:40:44.168 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 23 k 2022-12-01T09:40:44.168 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 2.3 M 2022-12-01T09:40:44.168 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 234 k 2022-12-01T09:40:44.168 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 3.9 M 2022-12-01T09:40:44.169 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 17 M 2022-12-01T09:40:44.169 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:18.0.0-676.gf6922ca2.el8 ceph-noarch 14 k 2022-12-01T09:40:44.169 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 24 k 2022-12-01T09:40:44.169 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2022-12-01T09:40:44.169 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-12-01T09:40:44.170 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2022-12-01T09:40:44.170 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-BaseOS 48 k 2022-12-01T09:40:44.170 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel x86_64 1.18.2-21.el8 CentOS-BaseOS 560 k 2022-12-01T09:40:44.170 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 137 k 2022-12-01T09:40:44.171 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel x86_64 1.45.6-5.el8 CentOS-BaseOS 39 k 2022-12-01T09:40:44.171 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 8.5.0-17.el8 CentOS-BaseOS 645 k 2022-12-01T09:40:44.171 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-12-01T09:40:44.171 INFO:teuthology.orchestra.run.smithi156.stdout: libpq x86_64 13.5-1.el8 CentOS-AppStream 198 k 2022-12-01T09:40:44.172 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 8.5.0-17.el8 CentOS-BaseOS 172 k 2022-12-01T09:40:44.172 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2022-12-01T09:40:44.172 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 474 k 2022-12-01T09:40:44.172 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-12-01T09:40:44.173 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 6.5 M 2022-12-01T09:40:44.173 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel x86_64 2.9-6.el8 CentOS-BaseOS 200 k 2022-12-01T09:40:44.173 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-BaseOS 87 k 2022-12-01T09:40:44.173 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-12-01T09:40:44.173 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel x86_64 0.3.2-2.el8 CentOS-BaseOS 18 k 2022-12-01T09:40:44.174 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-12-01T09:40:44.174 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-12-01T09:40:44.174 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2022-12-01T09:40:44.174 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2022-12-01T09:40:44.175 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel x86_64 10.32-3.el8 CentOS-BaseOS 605 k 2022-12-01T09:40:44.175 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16 x86_64 10.32-3.el8 CentOS-BaseOS 229 k 2022-12-01T09:40:44.175 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32 x86_64 10.32-3.el8 CentOS-BaseOS 220 k 2022-12-01T09:40:44.175 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-12-01T09:40:44.176 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-12-01T09:40:44.176 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-12-01T09:40:44.176 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-12-01T09:40:44.176 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-12-01T09:40:44.176 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 45 k 2022-12-01T09:40:44.177 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:18.0.0-676.gf6922ca2.el8 ceph 109 k 2022-12-01T09:40:44.177 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-12-01T09:40:44.177 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2022-12-01T09:40:44.178 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-12-01T09:40:44.178 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-12-01T09:40:44.179 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2022-12-01T09:40:44.179 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-12-01T09:40:44.180 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-12-01T09:40:44.180 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-12-01T09:40:44.181 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-12-01T09:40:44.181 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-12-01T09:40:44.181 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-12-01T09:40:44.182 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2022-12-01T09:40:44.182 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-12-01T09:40:44.182 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-12-01T09:40:44.183 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-12-01T09:40:44.183 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-12-01T09:40:44.184 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-12-01T09:40:44.184 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-12-01T09:40:44.185 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-12-01T09:40:44.185 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-12-01T09:40:44.185 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2022-12-01T09:40:44.186 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-12-01T09:40:44.186 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-12-01T09:40:44.186 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-12-01T09:40:44.187 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-12-01T09:40:44.187 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-12-01T09:40:44.187 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-12-01T09:40:44.188 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2022-12-01T09:40:44.188 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-12-01T09:40:44.188 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-12-01T09:40:44.188 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2022-12-01T09:40:44.188 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-12-01T09:40:44.189 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-12-01T09:40:44.189 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-12-01T09:40:44.189 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-12-01T09:40:44.189 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-12-01T09:40:44.190 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-12-01T09:40:44.190 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-12-01T09:40:44.190 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-12-01T09:40:44.190 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-12-01T09:40:44.191 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-12-01T09:40:44.191 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-12-01T09:40:44.191 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-12-01T09:40:44.191 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-12-01T09:40:44.192 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-12-01T09:40:44.192 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-12-01T09:40:44.192 INFO:teuthology.orchestra.run.smithi156.stdout: uuid x86_64 1.6.2-43.el8 CentOS-AppStream 64 k 2022-12-01T09:40:44.192 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2022-12-01T09:40:44.193 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.11-20.el8 CentOS-BaseOS 58 k 2022-12-01T09:40:44.193 INFO:teuthology.orchestra.run.smithi156.stdout:Enabling module streams: 2022-12-01T09:40:44.193 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql 10 2022-12-01T09:40:44.193 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:40:44.194 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2022-12-01T09:40:44.194 INFO:teuthology.orchestra.run.smithi156.stdout:========================================================================================================= 2022-12-01T09:40:44.194 INFO:teuthology.orchestra.run.smithi156.stdout:Install 127 Packages 2022-12-01T09:40:44.195 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 6 Packages 2022-12-01T09:40:44.195 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:40:44.196 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 217 M 2022-12-01T09:40:44.196 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2022-12-01T09:40:44.377 INFO:teuthology.orchestra.run.smithi156.stdout:(1/133): ceph-18.0.0-676.gf6922ca2.el8.x86_64.r 31 kB/s | 6.4 kB 00:00 2022-12-01T09:40:44.488 INFO:teuthology.orchestra.run.smithi033.stdout:(2/133): ceph-fuse-18.0.0-676.gf6922ca2.el8.x86 2.1 MB/s | 845 kB 00:00 2022-12-01T09:40:44.630 INFO:teuthology.orchestra.run.smithi033.stdout:(3/133): ceph-immutable-object-cache-18.0.0-676 1.1 MB/s | 165 kB 00:00 2022-12-01T09:40:44.886 INFO:teuthology.orchestra.run.smithi156.stdout:(2/133): ceph-fuse-18.0.0-676.gf6922ca2.el8.x86 1.6 MB/s | 845 kB 00:00 2022-12-01T09:40:45.020 INFO:teuthology.orchestra.run.smithi156.stdout:(3/133): ceph-immutable-object-cache-18.0.0-676 1.2 MB/s | 165 kB 00:00 2022-12-01T09:40:45.372 INFO:teuthology.orchestra.run.smithi033.stdout:(4/133): ceph-mds-18.0.0-676.gf6922ca2.el8.x86_ 3.1 MB/s | 2.3 MB 00:00 2022-12-01T09:40:45.489 INFO:teuthology.orchestra.run.smithi033.stdout:(5/133): ceph-base-18.0.0-676.gf6922ca2.el8.x86 3.3 MB/s | 5.2 MB 00:01 2022-12-01T09:40:45.889 INFO:teuthology.orchestra.run.smithi033.stdout:(6/133): ceph-mgr-18.0.0-676.gf6922ca2.el8.x86_ 3.0 MB/s | 1.5 MB 00:00 2022-12-01T09:40:45.953 INFO:teuthology.orchestra.run.smithi156.stdout:(4/133): ceph-mds-18.0.0-676.gf6922ca2.el8.x86_ 2.4 MB/s | 2.3 MB 00:00 2022-12-01T09:40:46.212 INFO:teuthology.orchestra.run.smithi156.stdout:(5/133): ceph-base-18.0.0-676.gf6922ca2.el8.x86 2.5 MB/s | 5.2 MB 00:02 2022-12-01T09:40:46.489 INFO:teuthology.orchestra.run.smithi033.stdout:(7/133): ceph-mon-18.0.0-676.gf6922ca2.el8.x86_ 3.9 MB/s | 3.9 MB 00:01 2022-12-01T09:40:46.645 INFO:teuthology.orchestra.run.smithi156.stdout:(6/133): ceph-mgr-18.0.0-676.gf6922ca2.el8.x86_ 2.2 MB/s | 1.5 MB 00:00 2022-12-01T09:40:47.429 INFO:teuthology.orchestra.run.smithi156.stdout:(7/133): ceph-mon-18.0.0-676.gf6922ca2.el8.x86_ 3.2 MB/s | 3.9 MB 00:01 2022-12-01T09:40:48.156 INFO:teuthology.orchestra.run.smithi033.stdout:(8/133): ceph-common-18.0.0-676.gf6922ca2.el8.x 5.7 MB/s | 24 MB 00:04 2022-12-01T09:40:48.231 INFO:teuthology.orchestra.run.smithi033.stdout:(9/133): ceph-selinux-18.0.0-676.gf6922ca2.el8. 325 kB/s | 24 kB 00:00 2022-12-01T09:40:50.684 INFO:teuthology.orchestra.run.smithi033.stdout:(10/133): ceph-osd-18.0.0-676.gf6922ca2.el8.x86 3.5 MB/s | 17 MB 00:04 2022-12-01T09:40:50.831 INFO:teuthology.orchestra.run.smithi033.stdout:(11/133): cephfs-mirror-18.0.0-676.gf6922ca2.el 1.7 MB/s | 257 kB 00:00 2022-12-01T09:40:50.890 INFO:teuthology.orchestra.run.smithi033.stdout:(12/133): libcephfs-devel-18.0.0-676.gf6922ca2. 523 kB/s | 30 kB 00:00 2022-12-01T09:40:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:(13/133): libcephfs2-18.0.0-676.gf6922ca2.el8.x 3.6 MB/s | 768 kB 00:00 2022-12-01T09:40:51.157 INFO:teuthology.orchestra.run.smithi033.stdout:(14/133): libcephsqlite-18.0.0-676.gf6922ca2.el 2.3 MB/s | 137 kB 00:00 2022-12-01T09:40:51.207 INFO:teuthology.orchestra.run.smithi033.stdout:(15/133): librados-devel-18.0.0-676.gf6922ca2.e 2.7 MB/s | 139 kB 00:00 2022-12-01T09:40:51.374 INFO:teuthology.orchestra.run.smithi033.stdout:(16/133): libradosstriper1-18.0.0-676.gf6922ca2 2.8 MB/s | 474 kB 00:00 2022-12-01T09:40:52.800 INFO:teuthology.orchestra.run.smithi033.stdout:(17/133): ceph-radosgw-18.0.0-676.gf6922ca2.el8 2.9 MB/s | 18 MB 00:06 2022-12-01T09:40:52.810 INFO:teuthology.orchestra.run.smithi156.stdout:(8/133): ceph-common-18.0.0-676.gf6922ca2.el8.x 2.8 MB/s | 24 MB 00:08 2022-12-01T09:40:52.895 INFO:teuthology.orchestra.run.smithi156.stdout:(9/133): ceph-selinux-18.0.0-676.gf6922ca2.el8. 266 kB/s | 24 kB 00:00 2022-12-01T09:40:53.033 INFO:teuthology.orchestra.run.smithi033.stdout:(18/133): python3-ceph-argparse-18.0.0-676.gf69 191 kB/s | 45 kB 00:00 2022-12-01T09:40:53.175 INFO:teuthology.orchestra.run.smithi033.stdout:(19/133): python3-ceph-common-18.0.0-676.gf6922 770 kB/s | 109 kB 00:00 2022-12-01T09:40:53.403 INFO:teuthology.orchestra.run.smithi033.stdout:(20/133): python3-cephfs-18.0.0-676.gf6922ca2.e 837 kB/s | 190 kB 00:00 2022-12-01T09:40:53.488 INFO:teuthology.orchestra.run.smithi156.stdout:(10/133): ceph-osd-18.0.0-676.gf6922ca2.el8.x86 2.5 MB/s | 17 MB 00:06 2022-12-01T09:40:53.757 INFO:teuthology.orchestra.run.smithi033.stdout:(21/133): python3-rados-18.0.0-676.gf6922ca2.el 1.0 MB/s | 370 kB 00:00 2022-12-01T09:40:53.812 INFO:teuthology.orchestra.run.smithi156.stdout:(11/133): cephfs-mirror-18.0.0-676.gf6922ca2.el 793 kB/s | 257 kB 00:00 2022-12-01T09:40:53.921 INFO:teuthology.orchestra.run.smithi156.stdout:(12/133): libcephfs-devel-18.0.0-676.gf6922ca2. 281 kB/s | 30 kB 00:00 2022-12-01T09:40:54.276 INFO:teuthology.orchestra.run.smithi033.stdout:(22/133): librgw2-18.0.0-676.gf6922ca2.el8.x86_ 2.2 MB/s | 6.5 MB 00:02 2022-12-01T09:40:54.301 INFO:teuthology.orchestra.run.smithi033.stdout:(23/133): python3-rbd-18.0.0-676.gf6922ca2.el8. 669 kB/s | 364 kB 00:00 2022-12-01T09:40:54.452 INFO:teuthology.orchestra.run.smithi033.stdout:(24/133): python3-rgw-18.0.0-676.gf6922ca2.el8. 608 kB/s | 107 kB 00:00 2022-12-01T09:40:54.469 INFO:teuthology.orchestra.run.smithi033.stdout:(25/133): rbd-fuse-18.0.0-676.gf6922ca2.el8.x86 566 kB/s | 94 kB 00:00 2022-12-01T09:40:54.719 INFO:teuthology.orchestra.run.smithi033.stdout:(26/133): rbd-nbd-18.0.0-676.gf6922ca2.el8.x86_ 709 kB/s | 177 kB 00:00 2022-12-01T09:40:54.802 INFO:teuthology.orchestra.run.smithi033.stdout:(27/133): ceph-grafana-dashboards-18.0.0-676.gf 274 kB/s | 23 kB 00:00 2022-12-01T09:40:54.944 INFO:teuthology.orchestra.run.smithi033.stdout:(28/133): ceph-mgr-cephadm-18.0.0-676.gf6922ca2 835 kB/s | 118 kB 00:00 2022-12-01T09:40:55.163 INFO:teuthology.orchestra.run.smithi156.stdout:(13/133): libcephfs2-18.0.0-676.gf6922ca2.el8.x 619 kB/s | 768 kB 00:01 2022-12-01T09:40:55.401 INFO:teuthology.orchestra.run.smithi156.stdout:(14/133): libcephsqlite-18.0.0-676.gf6922ca2.el 586 kB/s | 137 kB 00:00 2022-12-01T09:40:55.697 INFO:teuthology.orchestra.run.smithi156.stdout:(15/133): librados-devel-18.0.0-676.gf6922ca2.e 463 kB/s | 139 kB 00:00 2022-12-01T09:40:56.905 INFO:teuthology.orchestra.run.smithi156.stdout:(16/133): libradosstriper1-18.0.0-676.gf6922ca2 392 kB/s | 474 kB 00:01 2022-12-01T09:40:57.928 INFO:teuthology.orchestra.run.smithi033.stdout:(29/133): ceph-mgr-dashboard-18.0.0-676.gf6922c 567 kB/s | 1.7 MB 00:02 2022-12-01T09:41:00.145 INFO:teuthology.orchestra.run.smithi033.stdout:(30/133): rbd-mirror-18.0.0-676.gf6922ca2.el8.x 627 kB/s | 3.5 MB 00:05 2022-12-01T09:41:00.570 INFO:teuthology.orchestra.run.smithi033.stdout:(31/133): ceph-mgr-modules-core-18.0.0-676.gf69 550 kB/s | 234 kB 00:00 2022-12-01T09:41:00.645 INFO:teuthology.orchestra.run.smithi033.stdout:(32/133): ceph-mgr-rook-18.0.0-676.gf6922ca2.el 627 kB/s | 47 kB 00:00 2022-12-01T09:41:00.695 INFO:teuthology.orchestra.run.smithi033.stdout:(33/133): ceph-prometheus-alerts-18.0.0-676.gf6 289 kB/s | 14 kB 00:00 2022-12-01T09:41:01.029 INFO:teuthology.orchestra.run.smithi033.stdout:(34/133): ceph-volume-18.0.0-676.gf6922ca2.el8. 789 kB/s | 263 kB 00:00 2022-12-01T09:41:01.138 INFO:teuthology.orchestra.run.smithi033.stdout:(35/133): cephadm-18.0.0-676.gf6922ca2.el8.noar 751 kB/s | 81 kB 00:00 2022-12-01T09:41:01.217 INFO:teuthology.orchestra.run.smithi033.stdout:(36/133): cephfs-top-18.0.0-676.gf6922ca2.el8.n 196 kB/s | 15 kB 00:00 2022-12-01T09:41:01.263 INFO:teuthology.orchestra.run.smithi156.stdout:(17/133): ceph-radosgw-18.0.0-676.gf6922ca2.el8 1.3 MB/s | 18 MB 00:13 2022-12-01T09:41:01.288 INFO:teuthology.orchestra.run.smithi033.stdout:(37/133): automake-1.16.1-7.el8.noarch.rpm 9.8 MB/s | 713 kB 00:00 2022-12-01T09:41:01.330 INFO:teuthology.orchestra.run.smithi033.stdout:(38/133): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2022-12-01T09:41:01.356 INFO:teuthology.orchestra.run.smithi156.stdout:(18/133): python3-ceph-argparse-18.0.0-676.gf69 487 kB/s | 45 kB 00:00 2022-12-01T09:41:01.364 INFO:teuthology.orchestra.run.smithi033.stdout:(39/133): flex-2.6.1-9.el8.x86_64.rpm 9.4 MB/s | 320 kB 00:00 2022-12-01T09:41:01.389 INFO:teuthology.orchestra.run.smithi033.stdout:(40/133): jq-1.6-6.el8.x86_64.rpm 7.9 MB/s | 202 kB 00:00 2022-12-01T09:41:01.459 INFO:teuthology.orchestra.run.smithi033.stdout:(41/133): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2022-12-01T09:41:01.490 INFO:teuthology.orchestra.run.smithi033.stdout:(42/133): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2022-12-01T09:41:01.522 INFO:teuthology.orchestra.run.smithi156.stdout:(19/133): python3-ceph-common-18.0.0-676.gf6922 655 kB/s | 109 kB 00:00 2022-12-01T09:41:01.523 INFO:teuthology.orchestra.run.smithi033.stdout:(43/133): libtool-2.4.6-25.el8.x86_64.rpm 21 MB/s | 709 kB 00:00 2022-12-01T09:41:01.591 INFO:teuthology.orchestra.run.smithi033.stdout:(44/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2022-12-01T09:41:01.607 INFO:teuthology.orchestra.run.smithi033.stdout:(45/133): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2022-12-01T09:41:01.716 INFO:teuthology.orchestra.run.smithi033.stdout:(46/133): openblas-0.3.15-4.el8.x86_64.rpm 44 MB/s | 4.7 MB 00:00 2022-12-01T09:41:01.731 INFO:teuthology.orchestra.run.smithi156.stdout:(20/133): python3-cephfs-18.0.0-676.gf6922ca2.e 914 kB/s | 190 kB 00:00 2022-12-01T09:41:01.825 INFO:teuthology.orchestra.run.smithi033.stdout:(47/133): openblas-threads-0.3.15-4.el8.x86_64. 45 MB/s | 4.9 MB 00:00 2022-12-01T09:41:01.933 INFO:teuthology.orchestra.run.smithi033.stdout:(48/133): postgresql-10.19-1.module_el8.6.0+104 14 MB/s | 1.5 MB 00:00 2022-12-01T09:41:02.009 INFO:teuthology.orchestra.run.smithi033.stdout:(49/133): postgresql-contrib-10.19-1.module_el8 10 MB/s | 807 kB 00:00 2022-12-01T09:41:02.056 INFO:teuthology.orchestra.run.smithi156.stdout:(21/133): python3-rados-18.0.0-676.gf6922ca2.el 1.1 MB/s | 370 kB 00:00 2022-12-01T09:41:02.168 INFO:teuthology.orchestra.run.smithi033.stdout:(50/133): postgresql-server-10.19-1.module_el8. 32 MB/s | 5.1 MB 00:00 2022-12-01T09:41:02.284 INFO:teuthology.orchestra.run.smithi033.stdout:(51/133): python3-babel-2.5.1-7.el8.noarch.rpm 41 MB/s | 4.8 MB 00:00 2022-12-01T09:41:02.318 INFO:teuthology.orchestra.run.smithi033.stdout:(52/133): python3-jinja2-2.10.1-3.el8.noarch.rp 16 MB/s | 538 kB 00:00 2022-12-01T09:41:02.344 INFO:teuthology.orchestra.run.smithi033.stdout:(53/133): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2022-12-01T09:41:02.360 INFO:teuthology.orchestra.run.smithi033.stdout:(54/133): python3-jsonpointer-1.10-11.el8.noarc 1.2 MB/s | 20 kB 00:00 2022-12-01T09:41:02.385 INFO:teuthology.orchestra.run.smithi033.stdout:(55/133): python3-mako-1.0.6-13.el8.noarch.rpm 6.1 MB/s | 157 kB 00:00 2022-12-01T09:41:02.403 INFO:teuthology.orchestra.run.smithi033.stdout:(56/133): python3-markupsafe-0.23-19.el8.x86_64 2.2 MB/s | 39 kB 00:00 2022-12-01T09:41:02.406 INFO:teuthology.orchestra.run.smithi156.stdout:(22/133): python3-rbd-18.0.0-676.gf6922ca2.el8. 1.0 MB/s | 364 kB 00:00 2022-12-01T09:41:02.495 INFO:teuthology.orchestra.run.smithi033.stdout:(57/133): python3-numpy-1.14.3-10.el8.x86_64.rp 41 MB/s | 3.7 MB 00:00 2022-12-01T09:41:02.520 INFO:teuthology.orchestra.run.smithi033.stdout:(58/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 8.8 MB/s | 225 kB 00:00 2022-12-01T09:41:02.540 INFO:teuthology.orchestra.run.smithi156.stdout:(23/133): python3-rgw-18.0.0-676.gf6922ca2.el8. 799 kB/s | 107 kB 00:00 2022-12-01T09:41:02.580 INFO:teuthology.orchestra.run.smithi033.stdout:(59/133): python3-prettytable-0.7.2-14.el8.noar 736 kB/s | 44 kB 00:00 2022-12-01T09:41:02.612 INFO:teuthology.orchestra.run.smithi033.stdout:(60/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 3.2 MB/s | 103 kB 00:00 2022-12-01T09:41:02.638 INFO:teuthology.orchestra.run.smithi033.stdout:(61/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.9 MB/s | 126 kB 00:00 2022-12-01T09:41:02.649 INFO:teuthology.orchestra.run.smithi156.stdout:(24/133): rbd-fuse-18.0.0-676.gf6922ca2.el8.x86 871 kB/s | 94 kB 00:00 2022-12-01T09:41:02.663 INFO:teuthology.orchestra.run.smithi033.stdout:(62/133): python3-pyasn1-modules-0.3.7-6.el8.no 4.3 MB/s | 110 kB 00:00 2022-12-01T09:41:02.688 INFO:teuthology.orchestra.run.smithi033.stdout:(63/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-12-01T09:41:03.022 INFO:teuthology.orchestra.run.smithi033.stdout:(64/133): python3-scipy-1.0.0-21.module_el8.5.0 41 MB/s | 14 MB 00:00 2022-12-01T09:41:03.055 INFO:teuthology.orchestra.run.smithi033.stdout:(65/133): python3-werkzeug-0.12.2-4.el8.noarch. 14 MB/s | 457 kB 00:00 2022-12-01T09:41:03.081 INFO:teuthology.orchestra.run.smithi033.stdout:(66/133): socat-1.7.4.1-1.el8.x86_64.rpm 13 MB/s | 323 kB 00:00 2022-12-01T09:41:03.132 INFO:teuthology.orchestra.run.smithi033.stdout:(67/133): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2022-12-01T09:41:03.148 INFO:teuthology.orchestra.run.smithi033.stdout:(68/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.2 MB/s | 71 kB 00:00 2022-12-01T09:41:03.173 INFO:teuthology.orchestra.run.smithi033.stdout:(69/133): elfutils-libelf-devel-0.188-3.el8.x86 2.4 MB/s | 61 kB 00:00 2022-12-01T09:41:03.190 INFO:teuthology.orchestra.run.smithi033.stdout:(70/133): fuse-2.9.7-16.el8.x86_64.rpm 4.8 MB/s | 83 kB 00:00 2022-12-01T09:41:03.207 INFO:teuthology.orchestra.run.smithi156.stdout:(25/133): librgw2-18.0.0-676.gf6922ca2.el8.x86_ 1.0 MB/s | 6.5 MB 00:06 2022-12-01T09:41:03.216 INFO:teuthology.orchestra.run.smithi033.stdout:(71/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.9 MB/s | 48 kB 00:00 2022-12-01T09:41:03.283 INFO:teuthology.orchestra.run.smithi033.stdout:(72/133): krb5-devel-1.18.2-21.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2022-12-01T09:41:03.308 INFO:teuthology.orchestra.run.smithi033.stdout:(73/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 741 kB/s | 19 kB 00:00 2022-12-01T09:41:03.333 INFO:teuthology.orchestra.run.smithi033.stdout:(74/133): libcom_err-devel-1.45.6-5.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2022-12-01T09:41:03.367 INFO:teuthology.orchestra.run.smithi033.stdout:(75/133): libgfortran-8.5.0-17.el8.x86_64.rpm 19 MB/s | 645 kB 00:00 2022-12-01T09:41:03.374 INFO:teuthology.orchestra.run.smithi156.stdout:(26/133): rbd-nbd-18.0.0-676.gf6922ca2.el8.x86_ 1.0 MB/s | 177 kB 00:00 2022-12-01T09:41:03.392 INFO:teuthology.orchestra.run.smithi033.stdout:(76/133): libquadmath-8.5.0-17.el8.x86_64.rpm 6.7 MB/s | 172 kB 00:00 2022-12-01T09:41:03.417 INFO:teuthology.orchestra.run.smithi033.stdout:(77/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2022-12-01T09:41:03.434 INFO:teuthology.orchestra.run.smithi033.stdout:(78/133): libselinux-devel-2.9-6.el8.x86_64.rpm 12 MB/s | 200 kB 00:00 2022-12-01T09:41:03.461 INFO:teuthology.orchestra.run.smithi156.stdout:(27/133): ceph-grafana-dashboards-18.0.0-676.gf 274 kB/s | 23 kB 00:00 2022-12-01T09:41:03.462 INFO:teuthology.orchestra.run.smithi033.stdout:(79/133): libsepol-devel-2.9-3.el8.x86_64.rpm 3.4 MB/s | 87 kB 00:00 2022-12-01T09:41:03.485 INFO:teuthology.orchestra.run.smithi033.stdout:(80/133): libuuid-devel-2.32.1-38.el8.x86_64.rp 3.9 MB/s | 99 kB 00:00 2022-12-01T09:41:03.511 INFO:teuthology.orchestra.run.smithi033.stdout:(81/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 723 kB/s | 18 kB 00:00 2022-12-01T09:41:03.550 INFO:teuthology.orchestra.run.smithi156.stdout:(28/133): ceph-mgr-cephadm-18.0.0-676.gf6922ca2 1.3 MB/s | 118 kB 00:00 2022-12-01T09:41:03.607 INFO:teuthology.orchestra.run.smithi033.stdout:(82/133): openssl-devel-1.1.1k-7.el8.x86_64.rpm 24 MB/s | 2.3 MB 00:00 2022-12-01T09:41:03.645 INFO:teuthology.orchestra.run.smithi033.stdout:(83/133): pcre2-devel-10.32-3.el8.x86_64.rpm 16 MB/s | 605 kB 00:00 2022-12-01T09:41:03.670 INFO:teuthology.orchestra.run.smithi033.stdout:(84/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 9.0 MB/s | 229 kB 00:00 2022-12-01T09:41:03.696 INFO:teuthology.orchestra.run.smithi033.stdout:(85/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 8.6 MB/s | 220 kB 00:00 2022-12-01T09:41:03.721 INFO:teuthology.orchestra.run.smithi033.stdout:(86/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.3 MB/s | 237 kB 00:00 2022-12-01T09:41:03.754 INFO:teuthology.orchestra.run.smithi033.stdout:(87/133): python3-cryptography-3.2.1-5.el8.x86_ 16 MB/s | 559 kB 00:00 2022-12-01T09:41:03.780 INFO:teuthology.orchestra.run.smithi033.stdout:(88/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2022-12-01T09:41:03.805 INFO:teuthology.orchestra.run.smithi033.stdout:(89/133): python3-oauthlib-2.1.0-1.el8.noarch.r 6.1 MB/s | 155 kB 00:00 2022-12-01T09:41:03.830 INFO:teuthology.orchestra.run.smithi033.stdout:(90/133): python3-pycparser-2.14-14.el8.noarch. 4.2 MB/s | 109 kB 00:00 2022-12-01T09:41:03.856 INFO:teuthology.orchestra.run.smithi033.stdout:(91/133): python3-requests-oauthlib-1.0.0-1.el8 1.7 MB/s | 43 kB 00:00 2022-12-01T09:41:03.881 INFO:teuthology.orchestra.run.smithi033.stdout:(92/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 2.8 MB/s | 72 kB 00:00 2022-12-01T09:41:03.906 INFO:teuthology.orchestra.run.smithi033.stdout:(93/133): zlib-devel-1.2.11-20.el8.x86_64.rpm 2.3 MB/s | 58 kB 00:00 2022-12-01T09:41:04.323 INFO:teuthology.orchestra.run.smithi033.stdout:(94/133): gperftools-libs-2.7-9.el8.x86_64.rpm 736 kB/s | 306 kB 00:00 2022-12-01T09:41:04.333 INFO:teuthology.orchestra.run.smithi156.stdout:(29/133): ceph-mgr-dashboard-18.0.0-676.gf6922c 2.1 MB/s | 1.7 MB 00:00 2022-12-01T09:41:04.416 INFO:teuthology.orchestra.run.smithi033.stdout:(95/133): liboath-2.6.2-3.el8.x86_64.rpm 641 kB/s | 59 kB 00:00 2022-12-01T09:41:04.549 INFO:teuthology.orchestra.run.smithi033.stdout:(96/133): libunwind-1.3.1-3.el8.x86_64.rpm 563 kB/s | 75 kB 00:00 2022-12-01T09:41:04.964 INFO:teuthology.orchestra.run.smithi033.stdout:(97/133): ceph-mgr-diskprediction-local-18.0.0- 1.1 MB/s | 7.4 MB 00:07 2022-12-01T09:41:05.000 INFO:teuthology.orchestra.run.smithi033.stdout:(98/133): python3-asyncssh-2.7.0-2.el8.noarch.r 1.0 MB/s | 476 kB 00:00 2022-12-01T09:41:05.175 INFO:teuthology.orchestra.run.smithi033.stdout:(99/133): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2022-12-01T09:41:05.200 INFO:teuthology.orchestra.run.smithi033.stdout:(100/133): python3-bcrypt-3.1.6-2.el8.1.x86_64. 185 kB/s | 44 kB 00:00 2022-12-01T09:41:05.258 INFO:teuthology.orchestra.run.smithi156.stdout:(30/133): rbd-mirror-18.0.0-676.gf6922ca2.el8.x 1.3 MB/s | 3.5 MB 00:02 2022-12-01T09:41:05.267 INFO:teuthology.orchestra.run.smithi033.stdout:(101/133): python3-cachetools-3.1.1-4.el8.noarc 358 kB/s | 33 kB 00:00 2022-12-01T09:41:05.317 INFO:teuthology.orchestra.run.smithi033.stdout:(102/133): python3-certifi-2018.10.15-7.el8.noa 140 kB/s | 16 kB 00:00 2022-12-01T09:41:05.393 INFO:teuthology.orchestra.run.smithi033.stdout:(103/133): python3-cheroot-8.5.2-1.el8.noarch.r 1.3 MB/s | 173 kB 00:00 2022-12-01T09:41:05.409 INFO:teuthology.orchestra.run.smithi156.stdout:(31/133): ceph-mgr-modules-core-18.0.0-676.gf69 1.5 MB/s | 234 kB 00:00 2022-12-01T09:41:05.451 INFO:teuthology.orchestra.run.smithi033.stdout:(104/133): python3-google-auth-1.1.1-10.el8.noa 1.4 MB/s | 81 kB 00:00 2022-12-01T09:41:05.467 INFO:teuthology.orchestra.run.smithi156.stdout:(32/133): ceph-mgr-rook-18.0.0-676.gf6922ca2.el 806 kB/s | 47 kB 00:00 2022-12-01T09:41:05.518 INFO:teuthology.orchestra.run.smithi033.stdout:(105/133): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2022-12-01T09:41:05.525 INFO:teuthology.orchestra.run.smithi156.stdout:(33/133): ceph-prometheus-alerts-18.0.0-676.gf6 248 kB/s | 14 kB 00:00 2022-12-01T09:41:05.602 INFO:teuthology.orchestra.run.smithi033.stdout:(106/133): python3-jaraco-functools-2.0-4.el8.n 212 kB/s | 18 kB 00:00 2022-12-01T09:41:05.670 INFO:teuthology.orchestra.run.smithi033.stdout:(107/133): python3-cherrypy-18.4.0-1.el8.noarch 1.1 MB/s | 384 kB 00:00 2022-12-01T09:41:05.726 INFO:teuthology.orchestra.run.smithi156.stdout:(34/133): ceph-volume-18.0.0-676.gf6922ca2.el8. 1.3 MB/s | 263 kB 00:00 2022-12-01T09:41:05.810 INFO:teuthology.orchestra.run.smithi156.stdout:(35/133): cephadm-18.0.0-676.gf6922ca2.el8.noar 975 kB/s | 81 kB 00:00 2022-12-01T09:41:05.877 INFO:teuthology.orchestra.run.smithi156.stdout:(36/133): cephfs-top-18.0.0-676.gf6922ca2.el8.n 232 kB/s | 15 kB 00:00 2022-12-01T09:41:05.944 INFO:teuthology.orchestra.run.smithi156.stdout:(37/133): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2022-12-01T09:41:05.977 INFO:teuthology.orchestra.run.smithi156.stdout:(38/133): bison-3.0.4-10.el8.x86_64.rpm 20 MB/s | 688 kB 00:00 2022-12-01T09:41:06.037 INFO:teuthology.orchestra.run.smithi156.stdout:(39/133): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2022-12-01T09:41:06.069 INFO:teuthology.orchestra.run.smithi156.stdout:(40/133): jq-1.6-6.el8.x86_64.rpm 6.2 MB/s | 202 kB 00:00 2022-12-01T09:41:06.095 INFO:teuthology.orchestra.run.smithi156.stdout:(41/133): libpq-13.5-1.el8.x86_64.rpm 7.7 MB/s | 198 kB 00:00 2022-12-01T09:41:06.129 INFO:teuthology.orchestra.run.smithi156.stdout:(42/133): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2022-12-01T09:41:06.153 INFO:teuthology.orchestra.run.smithi033.stdout:(108/133): python3-logutils-0.3.5-11.el8.noarch 101 kB/s | 49 kB 00:00 2022-12-01T09:41:06.162 INFO:teuthology.orchestra.run.smithi156.stdout:(43/133): libtool-2.4.6-25.el8.x86_64.rpm 21 MB/s | 709 kB 00:00 2022-12-01T09:41:06.187 INFO:teuthology.orchestra.run.smithi156.stdout:(44/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2022-12-01T09:41:06.213 INFO:teuthology.orchestra.run.smithi156.stdout:(45/133): oniguruma-6.8.2-2.el8.x86_64.rpm 7.3 MB/s | 187 kB 00:00 2022-12-01T09:41:06.270 INFO:teuthology.orchestra.run.smithi033.stdout:(109/133): python3-more-itertools-7.2.0-3.el8.n 503 kB/s | 59 kB 00:00 2022-12-01T09:41:06.330 INFO:teuthology.orchestra.run.smithi156.stdout:(46/133): openblas-0.3.15-4.el8.x86_64.rpm 40 MB/s | 4.7 MB 00:00 2022-12-01T09:41:06.379 INFO:teuthology.orchestra.run.smithi033.stdout:(110/133): python3-natsort-7.1.1-2.el8.noarch.r 557 kB/s | 60 kB 00:00 2022-12-01T09:41:06.456 INFO:teuthology.orchestra.run.smithi156.stdout:(47/133): openblas-threads-0.3.15-4.el8.x86_64. 39 MB/s | 4.9 MB 00:00 2022-12-01T09:41:06.514 INFO:teuthology.orchestra.run.smithi156.stdout:(48/133): postgresql-10.19-1.module_el8.6.0+104 26 MB/s | 1.5 MB 00:00 2022-12-01T09:41:06.572 INFO:teuthology.orchestra.run.smithi156.stdout:(49/133): postgresql-contrib-10.19-1.module_el8 13 MB/s | 807 kB 00:00 2022-12-01T09:41:06.681 INFO:teuthology.orchestra.run.smithi156.stdout:(50/133): postgresql-server-10.19-1.module_el8. 47 MB/s | 5.1 MB 00:00 2022-12-01T09:41:06.684 INFO:teuthology.orchestra.run.smithi033.stdout:(111/133): python3-pecan-1.3.2-9.el8.noarch.rpm 926 kB/s | 283 kB 00:00 2022-12-01T09:41:06.737 INFO:teuthology.orchestra.run.smithi033.stdout:(112/133): python3-kubernetes-11.0.0-6.el8.noar 1.0 MB/s | 1.2 MB 00:01 2022-12-01T09:41:06.754 INFO:teuthology.orchestra.run.smithi033.stdout:(113/133): python3-portend-2.6-1.el8.noarch.rpm 224 kB/s | 16 kB 00:00 2022-12-01T09:41:06.788 INFO:teuthology.orchestra.run.smithi033.stdout:(114/133): python3-repoze-lru-0.7-6.el8.noarch. 669 kB/s | 34 kB 00:00 2022-12-01T09:41:06.790 INFO:teuthology.orchestra.run.smithi156.stdout:(51/133): python3-babel-2.5.1-7.el8.noarch.rpm 44 MB/s | 4.8 MB 00:00 2022-12-01T09:41:06.823 INFO:teuthology.orchestra.run.smithi156.stdout:(52/133): python3-jinja2-2.10.1-3.el8.noarch.rp 16 MB/s | 538 kB 00:00 2022-12-01T09:41:06.840 INFO:teuthology.orchestra.run.smithi156.stdout:(53/133): python3-jsonpatch-1.21-2.el8.noarch.r 1.5 MB/s | 27 kB 00:00 2022-12-01T09:41:06.847 INFO:teuthology.orchestra.run.smithi033.stdout:(115/133): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2022-12-01T09:41:06.885 INFO:teuthology.orchestra.run.smithi156.stdout:(54/133): python3-jsonpointer-1.10-11.el8.noarc 454 kB/s | 20 kB 00:00 2022-12-01T09:41:06.916 INFO:teuthology.orchestra.run.smithi156.stdout:(55/133): python3-mako-1.0.6-13.el8.noarch.rpm 4.9 MB/s | 157 kB 00:00 2022-12-01T09:41:06.922 INFO:teuthology.orchestra.run.smithi033.stdout:(116/133): python3-simplegeneric-0.8.1-17.el8.n 250 kB/s | 19 kB 00:00 2022-12-01T09:41:06.932 INFO:teuthology.orchestra.run.smithi156.stdout:(56/133): python3-markupsafe-0.23-19.el8.x86_64 2.3 MB/s | 39 kB 00:00 2022-12-01T09:41:06.955 INFO:teuthology.orchestra.run.smithi033.stdout:(117/133): python3-routes-2.4.1-12.el8.noarch.r 978 kB/s | 196 kB 00:00 2022-12-01T09:41:06.981 INFO:teuthology.orchestra.run.smithi033.stdout:(118/133): python3-singledispatch-3.4.0.3-18.el 408 kB/s | 24 kB 00:00 2022-12-01T09:41:07.033 INFO:teuthology.orchestra.run.smithi156.stdout:(57/133): python3-numpy-1.14.3-10.el8.x86_64.rp 37 MB/s | 3.7 MB 00:00 2022-12-01T09:41:07.050 INFO:teuthology.orchestra.run.smithi156.stdout:(58/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 13 MB/s | 225 kB 00:00 2022-12-01T09:41:07.056 INFO:teuthology.orchestra.run.smithi033.stdout:(119/133): python3-tempora-1.14.1-5.el8.noarch. 291 kB/s | 29 kB 00:00 2022-12-01T09:41:07.067 INFO:teuthology.orchestra.run.smithi156.stdout:(59/133): python3-prettytable-0.7.2-14.el8.noar 2.6 MB/s | 44 kB 00:00 2022-12-01T09:41:07.089 INFO:teuthology.orchestra.run.smithi033.stdout:(120/133): python3-trustme-0.6.0-4.el8.noarch.r 274 kB/s | 27 kB 00:00 2022-12-01T09:41:07.092 INFO:teuthology.orchestra.run.smithi156.stdout:(60/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 4.0 MB/s | 103 kB 00:00 2022-12-01T09:41:07.118 INFO:teuthology.orchestra.run.smithi156.stdout:(61/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.0 MB/s | 126 kB 00:00 2022-12-01T09:41:07.143 INFO:teuthology.orchestra.run.smithi156.stdout:(62/133): python3-pyasn1-modules-0.3.7-6.el8.no 4.3 MB/s | 110 kB 00:00 2022-12-01T09:41:07.168 INFO:teuthology.orchestra.run.smithi156.stdout:(63/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-12-01T09:41:07.240 INFO:teuthology.orchestra.run.smithi033.stdout:(121/133): python3-waitress-1.2.1-2.el8.1.noarc 1.3 MB/s | 241 kB 00:00 2022-12-01T09:41:07.266 INFO:teuthology.orchestra.run.smithi033.stdout:(122/133): python3-webob-1.8.5-1.el8.1.noarch.r 1.3 MB/s | 251 kB 00:00 2022-12-01T09:41:07.307 INFO:teuthology.orchestra.run.smithi033.stdout:(123/133): python3-websocket-client-0.56.0-5.el 916 kB/s | 61 kB 00:00 2022-12-01T09:41:07.383 INFO:teuthology.orchestra.run.smithi033.stdout:(124/133): python3-webtest-2.0.33-1.el8.noarch. 730 kB/s | 85 kB 00:00 2022-12-01T09:41:07.400 INFO:teuthology.orchestra.run.smithi033.stdout:(125/133): python3-zc-lockfile-2.0-2.el8.noarch 249 kB/s | 23 kB 00:00 2022-12-01T09:41:07.454 INFO:teuthology.orchestra.run.smithi156.stdout:(64/133): python3-scipy-1.0.0-21.module_el8.5.0 48 MB/s | 14 MB 00:00 2022-12-01T09:41:07.485 INFO:teuthology.orchestra.run.smithi156.stdout:(65/133): python3-werkzeug-0.12.2-4.el8.noarch. 13 MB/s | 457 kB 00:00 2022-12-01T09:41:07.511 INFO:teuthology.orchestra.run.smithi156.stdout:(66/133): socat-1.7.4.1-1.el8.x86_64.rpm 13 MB/s | 323 kB 00:00 2022-12-01T09:41:07.536 INFO:teuthology.orchestra.run.smithi156.stdout:(67/133): uuid-1.6.2-43.el8.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2022-12-01T09:41:07.561 INFO:teuthology.orchestra.run.smithi156.stdout:(68/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 71 kB 00:00 2022-12-01T09:41:07.586 INFO:teuthology.orchestra.run.smithi156.stdout:(69/133): elfutils-libelf-devel-0.188-3.el8.x86 2.4 MB/s | 61 kB 00:00 2022-12-01T09:41:07.612 INFO:teuthology.orchestra.run.smithi156.stdout:(70/133): fuse-2.9.7-16.el8.x86_64.rpm 3.2 MB/s | 83 kB 00:00 2022-12-01T09:41:07.637 INFO:teuthology.orchestra.run.smithi156.stdout:(71/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.9 MB/s | 48 kB 00:00 2022-12-01T09:41:07.671 INFO:teuthology.orchestra.run.smithi156.stdout:(72/133): krb5-devel-1.18.2-21.el8.x86_64.rpm 16 MB/s | 560 kB 00:00 2022-12-01T09:41:07.696 INFO:teuthology.orchestra.run.smithi156.stdout:(73/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 746 kB/s | 19 kB 00:00 2022-12-01T09:41:07.738 INFO:teuthology.orchestra.run.smithi156.stdout:(74/133): libcom_err-devel-1.45.6-5.el8.x86_64. 923 kB/s | 39 kB 00:00 2022-12-01T09:41:07.780 INFO:teuthology.orchestra.run.smithi156.stdout:(75/133): libgfortran-8.5.0-17.el8.x86_64.rpm 15 MB/s | 645 kB 00:00 2022-12-01T09:41:07.806 INFO:teuthology.orchestra.run.smithi156.stdout:(76/133): libquadmath-8.5.0-17.el8.x86_64.rpm 6.7 MB/s | 172 kB 00:00 2022-12-01T09:41:07.831 INFO:teuthology.orchestra.run.smithi156.stdout:(77/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2022-12-01T09:41:07.856 INFO:teuthology.orchestra.run.smithi156.stdout:(78/133): libselinux-devel-2.9-6.el8.x86_64.rpm 7.9 MB/s | 200 kB 00:00 2022-12-01T09:41:07.873 INFO:teuthology.orchestra.run.smithi156.stdout:(79/133): libsepol-devel-2.9-3.el8.x86_64.rpm 5.1 MB/s | 87 kB 00:00 2022-12-01T09:41:07.899 INFO:teuthology.orchestra.run.smithi156.stdout:(80/133): libuuid-devel-2.32.1-38.el8.x86_64.rp 3.8 MB/s | 99 kB 00:00 2022-12-01T09:41:07.915 INFO:teuthology.orchestra.run.smithi156.stdout:(81/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 1.1 MB/s | 18 kB 00:00 2022-12-01T09:41:07.982 INFO:teuthology.orchestra.run.smithi156.stdout:(82/133): openssl-devel-1.1.1k-7.el8.x86_64.rpm 35 MB/s | 2.3 MB 00:00 2022-12-01T09:41:08.016 INFO:teuthology.orchestra.run.smithi156.stdout:(83/133): pcre2-devel-10.32-3.el8.x86_64.rpm 18 MB/s | 605 kB 00:00 2022-12-01T09:41:08.041 INFO:teuthology.orchestra.run.smithi156.stdout:(84/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 9.0 MB/s | 229 kB 00:00 2022-12-01T09:41:08.067 INFO:teuthology.orchestra.run.smithi156.stdout:(85/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 8.6 MB/s | 220 kB 00:00 2022-12-01T09:41:08.092 INFO:teuthology.orchestra.run.smithi156.stdout:(86/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.3 MB/s | 237 kB 00:00 2022-12-01T09:41:08.159 INFO:teuthology.orchestra.run.smithi156.stdout:(87/133): python3-cryptography-3.2.1-5.el8.x86_ 8.2 MB/s | 559 kB 00:00 2022-12-01T09:41:08.184 INFO:teuthology.orchestra.run.smithi156.stdout:(88/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2022-12-01T09:41:08.200 INFO:teuthology.orchestra.run.smithi033.stdout:(126/133): thrift-0.13.0-2.el8.x86_64.rpm 2.1 MB/s | 1.7 MB 00:00 2022-12-01T09:41:08.218 INFO:teuthology.orchestra.run.smithi156.stdout:(89/133): python3-oauthlib-2.1.0-1.el8.noarch.r 4.5 MB/s | 155 kB 00:00 2022-12-01T09:41:08.243 INFO:teuthology.orchestra.run.smithi156.stdout:(90/133): python3-pycparser-2.14-14.el8.noarch. 4.3 MB/s | 109 kB 00:00 2022-12-01T09:41:08.260 INFO:teuthology.orchestra.run.smithi156.stdout:(91/133): python3-requests-oauthlib-1.0.0-1.el8 2.5 MB/s | 43 kB 00:00 2022-12-01T09:41:08.285 INFO:teuthology.orchestra.run.smithi156.stdout:(92/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 2.8 MB/s | 72 kB 00:00 2022-12-01T09:41:08.311 INFO:teuthology.orchestra.run.smithi156.stdout:(93/133): zlib-devel-1.2.11-20.el8.x86_64.rpm 2.3 MB/s | 58 kB 00:00 2022-12-01T09:41:08.869 INFO:teuthology.orchestra.run.smithi156.stdout:(94/133): gperftools-libs-2.7-9.el8.x86_64.rpm 549 kB/s | 306 kB 00:00 2022-12-01T09:41:08.981 INFO:teuthology.orchestra.run.smithi156.stdout:(95/133): liboath-2.6.2-3.el8.x86_64.rpm 526 kB/s | 59 kB 00:00 2022-12-01T09:41:09.136 INFO:teuthology.orchestra.run.smithi156.stdout:(96/133): libunwind-1.3.1-3.el8.x86_64.rpm 484 kB/s | 75 kB 00:00 2022-12-01T09:41:09.278 INFO:teuthology.orchestra.run.smithi156.stdout:(97/133): ceph-mgr-diskprediction-local-18.0.0- 1.5 MB/s | 7.4 MB 00:04 2022-12-01T09:41:09.562 INFO:teuthology.orchestra.run.smithi156.stdout:(98/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 154 kB/s | 44 kB 00:00 2022-12-01T09:41:09.737 INFO:teuthology.orchestra.run.smithi156.stdout:(99/133): python3-asyncssh-2.7.0-2.el8.noarch.r 792 kB/s | 476 kB 00:00 2022-12-01T09:41:09.846 INFO:teuthology.orchestra.run.smithi156.stdout:(100/133): python3-cachetools-3.1.1-4.el8.noarc 304 kB/s | 33 kB 00:00 2022-12-01T09:41:09.871 INFO:teuthology.orchestra.run.smithi156.stdout:(101/133): python3-beautifulsoup4-4.6.3-2.el8.1 599 kB/s | 185 kB 00:00 2022-12-01T09:41:09.938 INFO:teuthology.orchestra.run.smithi156.stdout:(102/133): python3-certifi-2018.10.15-7.el8.noa 177 kB/s | 16 kB 00:00 2022-12-01T09:41:10.089 INFO:teuthology.orchestra.run.smithi156.stdout:(103/133): python3-cheroot-8.5.2-1.el8.noarch.r 795 kB/s | 173 kB 00:00 2022-12-01T09:41:10.256 INFO:teuthology.orchestra.run.smithi156.stdout:(104/133): python3-google-auth-1.1.1-10.el8.noa 486 kB/s | 81 kB 00:00 2022-12-01T09:41:10.331 INFO:teuthology.orchestra.run.smithi156.stdout:(105/133): python3-cherrypy-18.4.0-1.el8.noarch 980 kB/s | 384 kB 00:00 2022-12-01T09:41:10.348 INFO:teuthology.orchestra.run.smithi156.stdout:(106/133): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2022-12-01T09:41:10.398 INFO:teuthology.orchestra.run.smithi156.stdout:(107/133): python3-jaraco-functools-2.0-4.el8.n 263 kB/s | 18 kB 00:00 2022-12-01T09:41:10.473 INFO:teuthology.orchestra.run.smithi156.stdout:(108/133): python3-logutils-0.3.5-11.el8.noarch 650 kB/s | 49 kB 00:00 2022-12-01T09:41:10.549 INFO:teuthology.orchestra.run.smithi156.stdout:(109/133): python3-more-itertools-7.2.0-3.el8.n 782 kB/s | 59 kB 00:00 2022-12-01T09:41:10.632 INFO:teuthology.orchestra.run.smithi156.stdout:(110/133): python3-natsort-7.1.1-2.el8.noarch.r 725 kB/s | 60 kB 00:00 2022-12-01T09:41:10.892 INFO:teuthology.orchestra.run.smithi033.stdout:(127/133): librados2-18.0.0-676.gf6922ca2.el8.x 1.0 MB/s | 3.6 MB 00:03 2022-12-01T09:41:10.950 INFO:teuthology.orchestra.run.smithi033.stdout:(128/133): NetworkManager-initscripts-updown-1. 2.4 MB/s | 141 kB 00:00 2022-12-01T09:41:10.957 INFO:teuthology.orchestra.run.smithi156.stdout:(111/133): python3-pecan-1.3.2-9.el8.noarch.rpm 869 kB/s | 283 kB 00:00 2022-12-01T09:41:10.967 INFO:teuthology.orchestra.run.smithi033.stdout:(129/133): elfutils-debuginfod-client-0.188-3.e 4.5 MB/s | 75 kB 00:00 2022-12-01T09:41:10.993 INFO:teuthology.orchestra.run.smithi033.stdout:(130/133): elfutils-libelf-0.188-3.el8.x86_64.r 9.0 MB/s | 231 kB 00:00 2022-12-01T09:41:11.026 INFO:teuthology.orchestra.run.smithi033.stdout:(131/133): elfutils-libs-0.188-3.el8.x86_64.rpm 8.8 MB/s | 299 kB 00:00 2022-12-01T09:41:11.041 INFO:teuthology.orchestra.run.smithi156.stdout:(112/133): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2022-12-01T09:41:11.125 INFO:teuthology.orchestra.run.smithi156.stdout:(113/133): python3-repoze-lru-0.7-6.el8.noarch. 403 kB/s | 34 kB 00:00 2022-12-01T09:41:11.135 INFO:teuthology.orchestra.run.smithi033.stdout:(132/133): librbd1-18.0.0-676.gf6922ca2.el8.x86 1.2 MB/s | 3.6 MB 00:02 2022-12-01T09:41:11.233 INFO:teuthology.orchestra.run.smithi156.stdout:(114/133): python3-kubernetes-11.0.0-6.el8.noar 1.3 MB/s | 1.2 MB 00:00 2022-12-01T09:41:11.309 INFO:teuthology.orchestra.run.smithi156.stdout:(115/133): python3-rsa-4.8-1.el8.noarch.rpm 819 kB/s | 61 kB 00:00 2022-12-01T09:41:11.342 INFO:teuthology.orchestra.run.smithi156.stdout:(116/133): python3-routes-2.4.1-12.el8.noarch.r 904 kB/s | 196 kB 00:00 2022-12-01T09:41:11.384 INFO:teuthology.orchestra.run.smithi156.stdout:(117/133): python3-simplegeneric-0.8.1-17.el8.n 249 kB/s | 19 kB 00:00 2022-12-01T09:41:11.426 INFO:teuthology.orchestra.run.smithi156.stdout:(118/133): python3-singledispatch-3.4.0.3-18.el 286 kB/s | 24 kB 00:00 2022-12-01T09:41:11.460 INFO:teuthology.orchestra.run.smithi156.stdout:(119/133): python3-tempora-1.14.1-5.el8.noarch. 388 kB/s | 29 kB 00:00 2022-12-01T09:41:11.529 INFO:teuthology.orchestra.run.smithi156.stdout:(120/133): python3-trustme-0.6.0-4.el8.noarch.r 274 kB/s | 27 kB 00:00 2022-12-01T09:41:11.677 INFO:teuthology.orchestra.run.smithi156.stdout:(121/133): python3-waitress-1.2.1-2.el8.1.noarc 1.1 MB/s | 241 kB 00:00 2022-12-01T09:41:11.752 INFO:teuthology.orchestra.run.smithi156.stdout:(122/133): python3-websocket-client-0.56.0-5.el 819 kB/s | 61 kB 00:00 2022-12-01T09:41:11.777 INFO:teuthology.orchestra.run.smithi156.stdout:(123/133): python3-webob-1.8.5-1.el8.1.noarch.r 1.0 MB/s | 251 kB 00:00 2022-12-01T09:41:11.836 INFO:teuthology.orchestra.run.smithi156.stdout:(124/133): python3-webtest-2.0.33-1.el8.noarch. 1.0 MB/s | 85 kB 00:00 2022-12-01T09:41:11.861 INFO:teuthology.orchestra.run.smithi156.stdout:(125/133): python3-zc-lockfile-2.0-2.el8.noarch 274 kB/s | 23 kB 00:00 2022-12-01T09:41:12.512 INFO:teuthology.orchestra.run.smithi156.stdout:(126/133): thrift-0.13.0-2.el8.x86_64.rpm 2.6 MB/s | 1.7 MB 00:00 2022-12-01T09:41:13.429 INFO:teuthology.orchestra.run.smithi156.stdout:(127/133): librados2-18.0.0-676.gf6922ca2.el8.x 2.3 MB/s | 3.6 MB 00:01 2022-12-01T09:41:13.479 INFO:teuthology.orchestra.run.smithi156.stdout:(128/133): NetworkManager-initscripts-updown-1. 2.8 MB/s | 141 kB 00:00 2022-12-01T09:41:13.505 INFO:teuthology.orchestra.run.smithi156.stdout:(129/133): elfutils-debuginfod-client-0.188-3.e 2.9 MB/s | 75 kB 00:00 2022-12-01T09:41:13.522 INFO:teuthology.orchestra.run.smithi156.stdout:(130/133): elfutils-libelf-0.188-3.el8.x86_64.r 14 MB/s | 231 kB 00:00 2022-12-01T09:41:13.555 INFO:teuthology.orchestra.run.smithi156.stdout:(131/133): elfutils-libs-0.188-3.el8.x86_64.rpm 8.8 MB/s | 299 kB 00:00 2022-12-01T09:41:13.602 INFO:teuthology.orchestra.run.smithi033.stdout:(133/133): ceph-test-18.0.0-676.gf6922ca2.el8.x 2.2 MB/s | 55 MB 00:25 2022-12-01T09:41:13.605 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-12-01T09:41:13.606 INFO:teuthology.orchestra.run.smithi033.stdout:Total 7.3 MB/s | 217 MB 00:29 2022-12-01T09:41:14.388 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-12-01T09:41:14.530 INFO:teuthology.orchestra.run.smithi156.stdout:(132/133): librbd1-18.0.0-676.gf6922ca2.el8.x86 1.8 MB/s | 3.6 MB 00:02 2022-12-01T09:41:14.602 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-12-01T09:41:14.603 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-12-01T09:41:15.992 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-12-01T09:41:15.996 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-12-01T09:41:18.347 INFO:teuthology.orchestra.run.smithi156.stdout:(133/133): ceph-test-18.0.0-676.gf6922ca2.el8.x 2.2 MB/s | 55 MB 00:25 2022-12-01T09:41:18.350 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2022-12-01T09:41:18.351 INFO:teuthology.orchestra.run.smithi156.stdout:Total 6.3 MB/s | 217 MB 00:34 2022-12-01T09:41:19.111 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2022-12-01T09:41:19.309 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2022-12-01T09:41:19.310 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2022-12-01T09:41:20.637 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2022-12-01T09:41:20.641 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2022-12-01T09:41:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-12-01T09:41:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/139 2022-12-01T09:41:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2022-12-01T09:41:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/139 2022-12-01T09:41:22.112 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/139 2022-12-01T09:41:22.529 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/139 2022-12-01T09:41:22.692 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 5/139 2022-12-01T09:41:23.133 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 5/139 2022-12-01T09:41:23.326 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 6/139 2022-12-01T09:41:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 6/139 2022-12-01T09:41:23.593 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 7/139 2022-12-01T09:41:23.675 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 7/139 2022-12-01T09:41:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 8/139 2022-12-01T09:41:24.000 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/139 2022-12-01T09:41:24.077 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/139 2022-12-01T09:41:24.305 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : elfutils-libelf-0.188-3.el8.x86_64 10/139 2022-12-01T09:41:24.475 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/139 2022-12-01T09:41:24.625 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2022-12-01T09:41:25.008 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpq-13.5-1.el8.x86_64 13/139 2022-12-01T09:41:25.238 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 14/139 2022-12-01T09:41:25.376 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 15/139 2022-12-01T09:41:25.481 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 15/139 2022-12-01T09:41:25.609 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 16/139 2022-12-01T09:41:25.731 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 16/139 2022-12-01T09:41:25.737 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2022-12-01T09:41:25.903 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/139 2022-12-01T09:41:25.923 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/139 2022-12-01T09:41:26.059 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2022-12-01T09:41:26.063 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-20.el8.x86_64 18/139 2022-12-01T09:41:26.200 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-8.5.0-17.el8.x86_64 19/139 2022-12-01T09:41:26.231 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/139 2022-12-01T09:41:26.335 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libquadmath-8.5.0-17.el8.x86_64 19/139 2022-12-01T09:41:26.396 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/139 2022-12-01T09:41:26.433 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-8.5.0-17.el8.x86_64 20/139 2022-12-01T09:41:26.792 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/139 2022-12-01T09:41:26.980 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 5/139 2022-12-01T09:41:27.092 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libgfortran-8.5.0-17.el8.x86_64 20/139 2022-12-01T09:41:27.250 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/139 2022-12-01T09:41:27.364 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 5/139 2022-12-01T09:41:27.579 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 6/139 2022-12-01T09:41:27.705 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 6/139 2022-12-01T09:41:27.855 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 7/139 2022-12-01T09:41:27.898 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/139 2022-12-01T09:41:27.932 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 7/139 2022-12-01T09:41:28.059 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/139 2022-12-01T09:41:28.186 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 8/139 2022-12-01T09:41:28.304 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/139 2022-12-01T09:41:28.426 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/139 2022-12-01T09:41:28.632 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : elfutils-libelf-0.188-3.el8.x86_64 10/139 2022-12-01T09:41:28.799 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/139 2022-12-01T09:41:28.802 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/139 2022-12-01T09:41:28.960 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2022-12-01T09:41:29.158 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/139 2022-12-01T09:41:29.323 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/139 2022-12-01T09:41:29.362 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpq-13.5-1.el8.x86_64 13/139 2022-12-01T09:41:29.437 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/139 2022-12-01T09:41:29.556 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 14/139 2022-12-01T09:41:29.708 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/139 2022-12-01T09:41:29.721 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 15/139 2022-12-01T09:41:29.813 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 15/139 2022-12-01T09:41:29.857 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x 27/139 2022-12-01T09:41:29.938 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 16/139 2022-12-01T09:41:30.028 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8 28/139 2022-12-01T09:41:30.054 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 16/139 2022-12-01T09:41:30.223 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 29/139 2022-12-01T09:41:30.252 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/139 2022-12-01T09:41:30.405 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.11-20.el8.x86_64 18/139 2022-12-01T09:41:30.538 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-8.5.0-17.el8.x86_64 19/139 2022-12-01T09:41:30.670 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libquadmath-8.5.0-17.el8.x86_64 19/139 2022-12-01T09:41:30.779 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-8.5.0-17.el8.x86_64 20/139 2022-12-01T09:41:31.217 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 30/139 2022-12-01T09:41:31.379 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libgfortran-8.5.0-17.el8.x86_64 20/139 2022-12-01T09:41:31.554 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/139 2022-12-01T09:41:31.582 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/139 2022-12-01T09:41:31.850 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/139 2022-12-01T09:41:32.066 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/139 2022-12-01T09:41:32.164 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/139 2022-12-01T09:41:32.329 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/139 2022-12-01T09:41:33.014 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/139 2022-12-01T09:41:33.314 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/139 2022-12-01T09:41:33.501 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/139 2022-12-01T09:41:33.649 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/139 2022-12-01T09:41:33.897 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/139 2022-12-01T09:41:33.953 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/139 2022-12-01T09:41:34.068 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x 27/139 2022-12-01T09:41:34.214 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8 28/139 2022-12-01T09:41:34.256 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/139 2022-12-01T09:41:34.442 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 29/139 2022-12-01T09:41:34.470 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/139 2022-12-01T09:41:34.665 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/139 2022-12-01T09:41:34.866 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : elfutils-libs-0.188-3.el8.x86_64 37/139 2022-12-01T09:41:35.080 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : elfutils-debuginfod-client-0.188-3.el8.x86_64 38/139 2022-12-01T09:41:35.256 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 39/139 2022-12-01T09:41:35.390 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 30/139 2022-12-01T09:41:35.458 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 40/139 2022-12-01T09:41:35.623 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/139 2022-12-01T09:41:35.735 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/139 2022-12-01T09:41:35.899 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/139 2022-12-01T09:41:35.965 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/139 2022-12-01T09:41:36.065 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/139 2022-12-01T09:41:36.120 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/139 2022-12-01T09:41:36.212 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/139 2022-12-01T09:41:36.345 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/139 2022-12-01T09:41:36.586 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/139 2022-12-01T09:41:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/139 2022-12-01T09:41:36.971 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/139 2022-12-01T09:41:37.210 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/139 2022-12-01T09:41:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/139 2022-12-01T09:41:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2022-12-01T09:41:37.672 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/139 2022-12-01T09:41:37.841 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/139 2022-12-01T09:41:37.921 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/139 2022-12-01T09:41:38.001 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/139 2022-12-01T09:41:38.224 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/139 2022-12-01T09:41:38.253 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/139 2022-12-01T09:41:38.421 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/139 2022-12-01T09:41:38.480 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/139 2022-12-01T09:41:38.634 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/139 2022-12-01T09:41:38.678 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/139 2022-12-01T09:41:38.800 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : elfutils-libs-0.188-3.el8.x86_64 37/139 2022-12-01T09:41:39.019 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/139 2022-12-01T09:41:39.058 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : elfutils-debuginfod-client-0.188-3.el8.x86_64 38/139 2022-12-01T09:41:39.242 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 39/139 2022-12-01T09:41:39.301 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/139 2022-12-01T09:41:39.436 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 40/139 2022-12-01T09:41:39.492 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/139 2022-12-01T09:41:39.638 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/139 2022-12-01T09:41:39.916 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/139 2022-12-01T09:41:40.109 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/139 2022-12-01T09:41:40.284 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/139 2022-12-01T09:41:40.307 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/139 2022-12-01T09:41:40.423 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 62/139 2022-12-01T09:41:40.463 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/139 2022-12-01T09:41:40.499 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 62/139 2022-12-01T09:41:40.709 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/139 2022-12-01T09:41:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 63/139 2022-12-01T09:41:40.896 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/139 2022-12-01T09:41:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/139 2022-12-01T09:41:41.078 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/139 2022-12-01T09:41:41.280 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/139 2022-12-01T09:41:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/139 2022-12-01T09:41:41.417 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/139 2022-12-01T09:41:41.589 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2022-12-01T09:41:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/139 2022-12-01T09:41:41.767 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/139 2022-12-01T09:41:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/139 2022-12-01T09:41:41.943 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/139 2022-12-01T09:41:42.063 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/139 2022-12-01T09:41:42.117 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/139 2022-12-01T09:41:42.239 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/139 2022-12-01T09:41:42.375 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/139 2022-12-01T09:41:42.632 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/139 2022-12-01T09:41:42.870 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/139 2022-12-01T09:41:43.196 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/139 2022-12-01T09:41:43.359 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/139 2022-12-01T09:41:43.470 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/139 2022-12-01T09:41:43.685 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/139 2022-12-01T09:41:43.758 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/139 2022-12-01T09:41:43.998 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/139 2022-12-01T09:41:44.218 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/139 2022-12-01T09:41:44.425 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/139 2022-12-01T09:41:44.527 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/139 2022-12-01T09:41:44.560 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 62/139 2022-12-01T09:41:44.630 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 62/139 2022-12-01T09:41:44.808 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/139 2022-12-01T09:41:44.869 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 63/139 2022-12-01T09:41:45.043 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/139 2022-12-01T09:41:45.104 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/139 2022-12-01T09:41:45.210 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/139 2022-12-01T09:41:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/139 2022-12-01T09:41:45.540 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/139 2022-12-01T09:41:45.780 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/139 2022-12-01T09:41:45.816 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/139 2022-12-01T09:41:45.955 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 80/139 2022-12-01T09:41:45.961 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/139 2022-12-01T09:41:46.130 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.32.1-38.el8.x86_64 81/139 2022-12-01T09:41:46.207 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/139 2022-12-01T09:41:46.406 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 82/139 2022-12-01T09:41:46.415 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/139 2022-12-01T09:41:46.627 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libselinux-devel-2.9-6.el8.x86_64 83/139 2022-12-01T09:41:46.802 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 84/139 2022-12-01T09:41:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 85/139 2022-12-01T09:41:47.313 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : krb5-devel-1.18.2-21.el8.x86_64 86/139 2022-12-01T09:41:47.493 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/139 2022-12-01T09:41:47.508 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.7-16.el8.x86_64 87/139 2022-12-01T09:41:47.657 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 88/139 2022-12-01T09:41:47.818 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/139 2022-12-01T09:41:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : uuid-1.6.2-43.el8.x86_64 89/139 2022-12-01T09:41:47.953 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 89/139 2022-12-01T09:41:48.051 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/139 2022-12-01T09:41:48.158 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 90/139 2022-12-01T09:41:48.305 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 91/139 2022-12-01T09:41:48.309 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/139 2022-12-01T09:41:48.573 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/139 2022-12-01T09:41:48.869 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/139 2022-12-01T09:41:49.137 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/139 2022-12-01T09:41:49.329 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/139 2022-12-01T09:41:49.638 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/139 2022-12-01T09:41:49.878 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/139 2022-12-01T09:41:50.067 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 80/139 2022-12-01T09:41:50.215 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libuuid-devel-2.32.1-38.el8.x86_64 81/139 2022-12-01T09:41:50.502 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 82/139 2022-12-01T09:41:50.697 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libselinux-devel-2.9-6.el8.x86_64 83/139 2022-12-01T09:41:50.879 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 84/139 2022-12-01T09:41:51.048 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 85/139 2022-12-01T09:41:51.283 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : krb5-devel-1.18.2-21.el8.x86_64 86/139 2022-12-01T09:41:51.477 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.7-16.el8.x86_64 87/139 2022-12-01T09:41:51.667 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 88/139 2022-12-01T09:41:51.860 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : uuid-1.6.2-43.el8.x86_64 89/139 2022-12-01T09:41:51.962 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 89/139 2022-12-01T09:41:52.159 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 90/139 2022-12-01T09:41:52.371 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 92/139 2022-12-01T09:41:52.621 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 92/139 2022-12-01T09:41:52.785 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 91/139 2022-12-01T09:41:53.226 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 92/139 2022-12-01T09:41:53.506 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 93/139 2022-12-01T09:41:53.629 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 93/139 2022-12-01T09:41:53.771 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 94/139 2022-12-01T09:41:56.504 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 92/139 2022-12-01T09:41:56.747 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 92/139 2022-12-01T09:41:57.320 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 92/139 2022-12-01T09:41:57.634 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 93/139 2022-12-01T09:41:57.726 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 93/139 2022-12-01T09:41:58.138 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 94/139 2022-12-01T09:42:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 94/139 2022-12-01T09:42:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2022-12-01T09:42:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2022-12-01T09:42:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2022-12-01T09:42:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /run 2022-12-01T09:42:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2022-12-01T09:42:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2022-12-01T09:42:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2022-12-01T09:42:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2022-12-01T09:42:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2022-12-01T09:42:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:14.451 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 95/139 2022-12-01T09:42:16.037 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 95/139 2022-12-01T09:42:16.253 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 96/139 2022-12-01T09:42:16.482 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 96/139 2022-12-01T09:42:16.659 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 97/139 2022-12-01T09:42:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 97/139 2022-12-01T09:42:17.217 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 98/139 2022-12-01T09:42:17.242 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 98/139 2022-12-01T09:42:17.441 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 99/139 2022-12-01T09:42:17.629 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 100/139 2022-12-01T09:42:17.739 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 94/139 2022-12-01T09:42:17.739 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2022-12-01T09:42:17.739 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2022-12-01T09:42:17.740 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2022-12-01T09:42:17.740 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /run 2022-12-01T09:42:17.740 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2022-12-01T09:42:17.741 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2022-12-01T09:42:17.741 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2022-12-01T09:42:17.741 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2022-12-01T09:42:17.742 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2022-12-01T09:42:17.742 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:17.809 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 101/139 2022-12-01T09:42:17.894 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 101/139 2022-12-01T09:42:18.147 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 95/139 2022-12-01T09:42:18.157 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jq-1.6-6.el8.x86_64 102/139 2022-12-01T09:42:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.1-7.el8.noarch 103/139 2022-12-01T09:42:19.645 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 95/139 2022-12-01T09:42:19.821 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 96/139 2022-12-01T09:42:20.009 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 104/139 2022-12-01T09:42:20.038 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 96/139 2022-12-01T09:42:20.180 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 104/139 2022-12-01T09:42:20.221 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 97/139 2022-12-01T09:42:20.282 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el 105/139 2022-12-01T09:42:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.e 106/139 2022-12-01T09:42:20.603 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 97/139 2022-12-01T09:42:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 107/139 2022-12-01T09:42:20.763 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 98/139 2022-12-01T09:42:20.786 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 98/139 2022-12-01T09:42:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 107/139 2022-12-01T09:42:21.003 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 99/139 2022-12-01T09:42:21.207 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 100/139 2022-12-01T09:42:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 108/139 2022-12-01T09:42:21.388 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 101/139 2022-12-01T09:42:21.452 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 101/139 2022-12-01T09:42:21.721 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.6-6.el8.x86_64 102/139 2022-12-01T09:42:21.921 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : automake-1.16.1-7.el8.noarch 103/139 2022-12-01T09:42:22.258 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 108/139 2022-12-01T09:42:22.417 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 109/139 2022-12-01T09:42:22.519 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 109/139 2022-12-01T09:42:22.919 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8 110/139 2022-12-01T09:42:23.110 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 111/139 2022-12-01T09:42:23.146 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 111/139 2022-12-01T09:42:23.324 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 112/139 2022-12-01T09:42:23.335 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 112/139 2022-12-01T09:42:23.499 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 104/139 2022-12-01T09:42:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 113/139 2022-12-01T09:42:23.665 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 104/139 2022-12-01T09:42:23.785 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el 105/139 2022-12-01T09:42:23.807 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/139 2022-12-01T09:42:23.982 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.e 106/139 2022-12-01T09:42:24.180 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 107/139 2022-12-01T09:42:24.385 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 107/139 2022-12-01T09:42:24.712 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 108/139 2022-12-01T09:42:25.674 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 108/139 2022-12-01T09:42:25.912 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 109/139 2022-12-01T09:42:26.007 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 109/139 2022-12-01T09:42:26.371 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8 110/139 2022-12-01T09:42:26.563 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 111/139 2022-12-01T09:42:26.597 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 111/139 2022-12-01T09:42:26.779 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 112/139 2022-12-01T09:42:26.789 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 112/139 2022-12-01T09:42:26.983 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 113/139 2022-12-01T09:42:27.262 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/139 2022-12-01T09:42:29.260 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/139 2022-12-01T09:42:31.218 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 115/139 2022-12-01T09:42:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 116/139 2022-12-01T09:42:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 116/139 2022-12-01T09:42:31.598 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-676.gf6922c 117/139 2022-12-01T09:42:31.640 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-676.gf6922c 117/139 2022-12-01T09:42:31.798 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 118/139 2022-12-01T09:42:32.166 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 118/139 2022-12-01T09:42:32.340 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 119/139 2022-12-01T09:42:32.396 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/139 2022-12-01T09:42:32.566 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 119/139 2022-12-01T09:42:32.892 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 120/139 2022-12-01T09:42:33.784 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 121/139 2022-12-01T09:42:34.059 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:1.1.1k-7.el8.x86_64 122/139 2022-12-01T09:42:34.210 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 123/139 2022-12-01T09:42:34.245 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 115/139 2022-12-01T09:42:34.394 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_6 124/139 2022-12-01T09:42:34.469 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 116/139 2022-12-01T09:42:34.502 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 116/139 2022-12-01T09:42:34.557 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.188-3.el8.x86_64 125/139 2022-12-01T09:42:34.653 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-676.gf6922c 117/139 2022-12-01T09:42:34.693 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-676.gf6922c 117/139 2022-12-01T09:42:34.886 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 118/139 2022-12-01T09:42:35.235 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 118/139 2022-12-01T09:42:35.369 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 119/139 2022-12-01T09:42:35.579 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 119/139 2022-12-01T09:42:35.909 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 120/139 2022-12-01T09:42:36.748 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 121/139 2022-12-01T09:42:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 126/139 2022-12-01T09:42:36.989 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-server-10.19-1.module_el8.6.0+1047+42 126/139 2022-12-01T09:42:37.006 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 126/139 2022-12-01T09:42:37.029 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openssl-devel-1:1.1.1k-7.el8.x86_64 122/139 2022-12-01T09:42:37.181 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 123/139 2022-12-01T09:42:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 127/139 2022-12-01T09:42:37.398 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_6 124/139 2022-12-01T09:42:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 128/139 2022-12-01T09:42:37.578 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : elfutils-libelf-devel-0.188-3.el8.x86_64 125/139 2022-12-01T09:42:37.749 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 129/139 2022-12-01T09:42:37.930 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.4-1.el8 130/139 2022-12-01T09:42:37.948 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.4-1.el8 130/139 2022-12-01T09:42:38.180 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/139 2022-12-01T09:42:38.339 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/139 2022-12-01T09:42:38.430 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/139 2022-12-01T09:42:38.613 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/139 2022-12-01T09:42:38.626 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/139 2022-12-01T09:42:38.773 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : elfutils-debuginfod-client-0.187-4.el8.x86_64 134/139 2022-12-01T09:42:38.959 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : elfutils-libs-0.187-4.el8.x86_64 135/139 2022-12-01T09:42:38.960 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/139 2022-12-01T09:42:39.207 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/139 2022-12-01T09:42:39.212 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.0-1.el8 137/139 2022-12-01T09:42:39.325 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.0-1.el8 137/139 2022-12-01T09:42:39.326 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 138/139 2022-12-01T09:42:39.574 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 138/139 2022-12-01T09:42:39.635 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 126/139 2022-12-01T09:42:39.738 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : elfutils-libelf-0.187-4.el8.x86_64 139/139 2022-12-01T09:42:39.902 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-server-10.19-1.module_el8.6.0+1047+42 126/139 2022-12-01T09:42:39.919 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 126/139 2022-12-01T09:42:40.280 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: elfutils-libelf-0.187-4.el8.x86_64 139/139 2022-12-01T09:42:40.280 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 1/139 2022-12-01T09:42:40.280 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 2/139 2022-12-01T09:42:40.281 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 3/139 2022-12-01T09:42:40.281 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 4/139 2022-12-01T09:42:40.281 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-676.gf6922c 5/139 2022-12-01T09:42:40.281 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 6/139 2022-12-01T09:42:40.282 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 7/139 2022-12-01T09:42:40.282 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 8/139 2022-12-01T09:42:40.282 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 9/139 2022-12-01T09:42:40.282 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 10/139 2022-12-01T09:42:40.283 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 11/139 2022-12-01T09:42:40.283 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 12/139 2022-12-01T09:42:40.283 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 13/139 2022-12-01T09:42:40.283 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_6 14/139 2022-12-01T09:42:40.283 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 15/139 2022-12-01T09:42:40.284 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 16/139 2022-12-01T09:42:40.284 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 17/139 2022-12-01T09:42:40.284 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 18/139 2022-12-01T09:42:40.284 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 19/139 2022-12-01T09:42:40.285 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8 20/139 2022-12-01T09:42:40.285 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x 21/139 2022-12-01T09:42:40.285 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 22/139 2022-12-01T09:42:40.285 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 23/139 2022-12-01T09:42:40.285 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 24/139 2022-12-01T09:42:40.286 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 25/139 2022-12-01T09:42:40.286 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 26/139 2022-12-01T09:42:40.286 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 27/139 2022-12-01T09:42:40.287 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 28/139 2022-12-01T09:42:40.287 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.e 29/139 2022-12-01T09:42:40.287 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 30/139 2022-12-01T09:42:40.298 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 31/139 2022-12-01T09:42:40.298 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 32/139 2022-12-01T09:42:40.298 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8 33/139 2022-12-01T09:42:40.299 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 34/139 2022-12-01T09:42:40.299 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el 35/139 2022-12-01T09:42:40.299 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 36/139 2022-12-01T09:42:40.299 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 37/139 2022-12-01T09:42:40.300 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 38/139 2022-12-01T09:42:40.300 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/139 2022-12-01T09:42:40.300 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/139 2022-12-01T09:42:40.300 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/139 2022-12-01T09:42:40.301 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jq-1.6-6.el8.x86_64 42/139 2022-12-01T09:42:40.301 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/139 2022-12-01T09:42:40.301 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/139 2022-12-01T09:42:40.301 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/139 2022-12-01T09:42:40.301 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/139 2022-12-01T09:42:40.302 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/139 2022-12-01T09:42:40.302 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/139 2022-12-01T09:42:40.302 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/139 2022-12-01T09:42:40.302 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 50/139 2022-12-01T09:42:40.302 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 51/139 2022-12-01T09:42:40.303 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-server-10.19-1.module_el8.6.0+1047+42 52/139 2022-12-01T09:42:40.303 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/139 2022-12-01T09:42:40.303 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/139 2022-12-01T09:42:40.303 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/139 2022-12-01T09:42:40.304 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/139 2022-12-01T09:42:40.304 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 57/139 2022-12-01T09:42:40.304 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/139 2022-12-01T09:42:40.304 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/139 2022-12-01T09:42:40.304 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/139 2022-12-01T09:42:40.305 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/139 2022-12-01T09:42:40.305 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/139 2022-12-01T09:42:40.305 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/139 2022-12-01T09:42:40.305 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/139 2022-12-01T09:42:40.306 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/139 2022-12-01T09:42:40.306 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/139 2022-12-01T09:42:40.306 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/139 2022-12-01T09:42:40.306 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/139 2022-12-01T09:42:40.307 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/139 2022-12-01T09:42:40.307 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/139 2022-12-01T09:42:40.307 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.188-3.el8.x86_64 71/139 2022-12-01T09:42:40.307 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 72/139 2022-12-01T09:42:40.308 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/139 2022-12-01T09:42:40.308 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : krb5-devel-1.18.2-21.el8.x86_64 74/139 2022-12-01T09:42:40.308 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/139 2022-12-01T09:42:40.308 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/139 2022-12-01T09:42:40.308 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-8.5.0-17.el8.x86_64 77/139 2022-12-01T09:42:40.309 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-8.5.0-17.el8.x86_64 78/139 2022-12-01T09:42:40.309 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/139 2022-12-01T09:42:40.309 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libselinux-devel-2.9-6.el8.x86_64 80/139 2022-12-01T09:42:40.309 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/139 2022-12-01T09:42:40.310 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.32.1-38.el8.x86_64 82/139 2022-12-01T09:42:40.310 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/139 2022-12-01T09:42:40.310 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8.x86_64 84/139 2022-12-01T09:42:40.310 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 85/139 2022-12-01T09:42:40.310 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 86/139 2022-12-01T09:42:40.311 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 87/139 2022-12-01T09:42:40.311 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 88/139 2022-12-01T09:42:40.311 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 89/139 2022-12-01T09:42:40.311 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 90/139 2022-12-01T09:42:40.312 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 91/139 2022-12-01T09:42:40.312 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 92/139 2022-12-01T09:42:40.312 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 93/139 2022-12-01T09:42:40.312 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 94/139 2022-12-01T09:42:40.312 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-20.el8.x86_64 95/139 2022-12-01T09:42:40.313 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/139 2022-12-01T09:42:40.313 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 97/139 2022-12-01T09:42:40.313 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 98/139 2022-12-01T09:42:40.313 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 99/139 2022-12-01T09:42:40.314 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 100/139 2022-12-01T09:42:40.314 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 101/139 2022-12-01T09:42:40.314 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 102/139 2022-12-01T09:42:40.314 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 103/139 2022-12-01T09:42:40.314 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 104/139 2022-12-01T09:42:40.315 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 105/139 2022-12-01T09:42:40.315 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 106/139 2022-12-01T09:42:40.315 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 107/139 2022-12-01T09:42:40.315 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 108/139 2022-12-01T09:42:40.316 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 109/139 2022-12-01T09:42:40.316 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 110/139 2022-12-01T09:42:40.316 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 111/139 2022-12-01T09:42:40.316 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 112/139 2022-12-01T09:42:40.316 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/139 2022-12-01T09:42:40.317 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/139 2022-12-01T09:42:40.317 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 115/139 2022-12-01T09:42:40.317 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 116/139 2022-12-01T09:42:40.317 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 117/139 2022-12-01T09:42:40.317 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 118/139 2022-12-01T09:42:40.318 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 119/139 2022-12-01T09:42:40.318 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 120/139 2022-12-01T09:42:40.318 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 121/139 2022-12-01T09:42:40.318 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 122/139 2022-12-01T09:42:40.319 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 123/139 2022-12-01T09:42:40.319 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 124/139 2022-12-01T09:42:40.319 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 125/139 2022-12-01T09:42:40.319 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/139 2022-12-01T09:42:40.319 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 127/139 2022-12-01T09:42:40.320 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 128/139 2022-12-01T09:42:40.320 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2022-12-01T09:42:40.320 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 130/139 2022-12-01T09:42:40.320 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2022-12-01T09:42:40.321 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.4-1.el8 132/139 2022-12-01T09:42:40.321 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.0-1.el8 133/139 2022-12-01T09:42:40.321 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el8.x86_64 134/139 2022-12-01T09:42:40.321 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-debuginfod-client-0.187-4.el8.x86_64 135/139 2022-12-01T09:42:40.321 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-0.188-3.el8.x86_64 136/139 2022-12-01T09:42:40.322 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-0.187-4.el8.x86_64 137/139 2022-12-01T09:42:40.322 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libs-0.188-3.el8.x86_64 138/139 2022-12-01T09:42:40.322 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 127/139 2022-12-01T09:42:40.492 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 128/139 2022-12-01T09:42:40.711 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 129/139 2022-12-01T09:42:40.851 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.4-1.el8 130/139 2022-12-01T09:42:40.869 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.4-1.el8 130/139 2022-12-01T09:42:41.051 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/139 2022-12-01T09:42:41.276 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/139 2022-12-01T09:42:41.360 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/139 2022-12-01T09:42:41.568 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/139 2022-12-01T09:42:41.580 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/139 2022-12-01T09:42:41.727 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : elfutils-debuginfod-client-0.187-4.el8.x86_64 134/139 2022-12-01T09:42:41.870 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : elfutils-libs-0.187-4.el8.x86_64 135/139 2022-12-01T09:42:41.870 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/139 2022-12-01T09:42:42.111 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/139 2022-12-01T09:42:42.115 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.0-1.el8 137/139 2022-12-01T09:42:42.229 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.0-1.el8 137/139 2022-12-01T09:42:42.230 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 138/139 2022-12-01T09:42:42.288 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libs-0.187-4.el8.x86_64 139/139 2022-12-01T09:42:42.288 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:42.288 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2022-12-01T09:42:42.289 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-initscripts-updown-1:1.40.4-1.el8.noarch 2022-12-01T09:42:42.289 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-debuginfod-client-0.188-3.el8.x86_64 2022-12-01T09:42:42.289 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-0.188-3.el8.x86_64 2022-12-01T09:42:42.289 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libs-0.188-3.el8.x86_64 2022-12-01T09:42:42.290 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.290 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.290 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-12-01T09:42:42.290 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.1-7.el8.noarch 2022-12-01T09:42:42.291 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.0.4-10.el8.x86_64 2022-12-01T09:42:42.291 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.291 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.291 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.292 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.292 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.292 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.292 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.293 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.293 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.293 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.293 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.294 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.294 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.294 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.294 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.295 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.295 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.295 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.295 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.296 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.296 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.296 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.296 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:42.297 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.188-3.el8.x86_64 2022-12-01T09:42:42.297 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.1-9.el8.x86_64 2022-12-01T09:42:42.297 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.7-16.el8.x86_64 2022-12-01T09:42:42.297 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-12-01T09:42:42.297 INFO:teuthology.orchestra.run.smithi033.stdout: jq-1.6-6.el8.x86_64 2022-12-01T09:42:42.298 INFO:teuthology.orchestra.run.smithi033.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-12-01T09:42:42.298 INFO:teuthology.orchestra.run.smithi033.stdout: krb5-devel-1.18.2-21.el8.x86_64 2022-12-01T09:42:42.298 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-12-01T09:42:42.298 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.298 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.299 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.299 INFO:teuthology.orchestra.run.smithi033.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2022-12-01T09:42:42.299 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-8.5.0-17.el8.x86_64 2022-12-01T09:42:42.300 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.2-3.el8.x86_64 2022-12-01T09:42:42.300 INFO:teuthology.orchestra.run.smithi033.stdout: libpq-13.5-1.el8.x86_64 2022-12-01T09:42:42.300 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-8.5.0-17.el8.x86_64 2022-12-01T09:42:42.300 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-12-01T09:42:42.300 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.301 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.301 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-12-01T09:42:42.301 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.301 INFO:teuthology.orchestra.run.smithi033.stdout: libselinux-devel-2.9-6.el8.x86_64 2022-12-01T09:42:42.302 INFO:teuthology.orchestra.run.smithi033.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-12-01T09:42:42.302 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-25.el8.x86_64 2022-12-01T09:42:42.302 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.3.1-3.el8.x86_64 2022-12-01T09:42:42.303 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.32.1-38.el8.x86_64 2022-12-01T09:42:42.303 INFO:teuthology.orchestra.run.smithi033.stdout: libverto-devel-0.3.2-2.el8.x86_64 2022-12-01T09:42:42.303 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-12-01T09:42:42.303 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-12-01T09:42:42.304 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.15-4.el8.x86_64 2022-12-01T09:42:42.304 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads-0.3.15-4.el8.x86_64 2022-12-01T09:42:42.304 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:1.1.1k-7.el8.x86_64 2022-12-01T09:42:42.304 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-devel-10.32-3.el8.x86_64 2022-12-01T09:42:42.305 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf16-10.32-3.el8.x86_64 2022-12-01T09:42:42.305 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf32-10.32-3.el8.x86_64 2022-12-01T09:42:42.305 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-12-01T09:42:42.305 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-12-01T09:42:42.306 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-12-01T09:42:42.306 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-12-01T09:42:42.306 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.5.1-7.el8.noarch 2022-12-01T09:42:42.306 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-12-01T09:42:42.306 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-12-01T09:42:42.307 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-12-01T09:42:42.307 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.307 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.307 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.308 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-12-01T09:42:42.308 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-12-01T09:42:42.308 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-12-01T09:42:42.308 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-12-01T09:42:42.309 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-12-01T09:42:42.309 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-12-01T09:42:42.309 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-6.2-6.el8.noarch 2022-12-01T09:42:42.309 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-12-01T09:42:42.309 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-12-01T09:42:42.310 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-12-01T09:42:42.310 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-12-01T09:42:42.310 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-12-01T09:42:42.310 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-12-01T09:42:42.310 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-12-01T09:42:42.311 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.0.6-13.el8.noarch 2022-12-01T09:42:42.311 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-12-01T09:42:42.311 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-12-01T09:42:42.311 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-12-01T09:42:42.311 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-12-01T09:42:42.312 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-12-01T09:42:42.312 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-12-01T09:42:42.312 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-12-01T09:42:42.312 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-2.6-1.el8.noarch 2022-12-01T09:42:42.312 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-12-01T09:42:42.313 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-12-01T09:42:42.313 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-12-01T09:42:42.313 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-12-01T09:42:42.313 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.14-14.el8.noarch 2022-12-01T09:42:42.314 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2017.2-9.el8.noarch 2022-12-01T09:42:42.314 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.314 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.314 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-12-01T09:42:42.314 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-12-01T09:42:42.315 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.315 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.4.1-12.el8.noarch 2022-12-01T09:42:42.315 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.8-1.el8.noarch 2022-12-01T09:42:42.315 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-12-01T09:42:42.316 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-12-01T09:42:42.316 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-12-01T09:42:42.316 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-12-01T09:42:42.316 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-12-01T09:42:42.316 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-12-01T09:42:42.317 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-12-01T09:42:42.317 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-12-01T09:42:42.317 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-12-01T09:42:42.317 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-12-01T09:42:42.318 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-12-01T09:42:42.318 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.318 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.318 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:42.318 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-1.el8.x86_64 2022-12-01T09:42:42.319 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.13.0-2.el8.x86_64 2022-12-01T09:42:42.319 INFO:teuthology.orchestra.run.smithi033.stdout: uuid-1.6.2-43.el8.x86_64 2022-12-01T09:42:42.319 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-12-01T09:42:42.319 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-12-01T09:42:42.320 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-20.el8.x86_64 2022-12-01T09:42:42.320 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:42.320 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-12-01T09:42:42.439 DEBUG:teuthology.parallel:result is None 2022-12-01T09:42:42.445 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 138/139 2022-12-01T09:42:42.617 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : elfutils-libelf-0.187-4.el8.x86_64 139/139 2022-12-01T09:42:43.145 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: elfutils-libelf-0.187-4.el8.x86_64 139/139 2022-12-01T09:42:43.146 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 1/139 2022-12-01T09:42:43.146 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 2/139 2022-12-01T09:42:43.146 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 3/139 2022-12-01T09:42:43.146 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 4/139 2022-12-01T09:42:43.147 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-676.gf6922c 5/139 2022-12-01T09:42:43.147 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 6/139 2022-12-01T09:42:43.147 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 7/139 2022-12-01T09:42:43.147 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 8/139 2022-12-01T09:42:43.148 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 9/139 2022-12-01T09:42:43.148 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 10/139 2022-12-01T09:42:43.148 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 11/139 2022-12-01T09:42:43.148 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 12/139 2022-12-01T09:42:43.148 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 13/139 2022-12-01T09:42:43.149 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_6 14/139 2022-12-01T09:42:43.149 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 15/139 2022-12-01T09:42:43.149 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 16/139 2022-12-01T09:42:43.149 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 17/139 2022-12-01T09:42:43.150 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_ 18/139 2022-12-01T09:42:43.150 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 19/139 2022-12-01T09:42:43.150 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8 20/139 2022-12-01T09:42:43.150 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x 21/139 2022-12-01T09:42:43.151 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 22/139 2022-12-01T09:42:43.151 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 23/139 2022-12-01T09:42:43.151 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 24/139 2022-12-01T09:42:43.151 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 25/139 2022-12-01T09:42:43.152 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 26/139 2022-12-01T09:42:43.152 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 27/139 2022-12-01T09:42:43.152 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 28/139 2022-12-01T09:42:43.152 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.e 29/139 2022-12-01T09:42:43.163 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noar 30/139 2022-12-01T09:42:43.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.no 31/139 2022-12-01T09:42:43.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-676.gf692 32/139 2022-12-01T09:42:43.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8 33/139 2022-12-01T09:42:43.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 34/139 2022-12-01T09:42:43.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el 35/139 2022-12-01T09:42:43.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 36/139 2022-12-01T09:42:43.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 37/139 2022-12-01T09:42:43.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 38/139 2022-12-01T09:42:43.166 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/139 2022-12-01T09:42:43.166 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/139 2022-12-01T09:42:43.166 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/139 2022-12-01T09:42:43.166 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.6-6.el8.x86_64 42/139 2022-12-01T09:42:43.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/139 2022-12-01T09:42:43.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/139 2022-12-01T09:42:43.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/139 2022-12-01T09:42:43.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/139 2022-12-01T09:42:43.168 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/139 2022-12-01T09:42:43.168 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/139 2022-12-01T09:42:43.168 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/139 2022-12-01T09:42:43.168 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 50/139 2022-12-01T09:42:43.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 51/139 2022-12-01T09:42:43.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-server-10.19-1.module_el8.6.0+1047+42 52/139 2022-12-01T09:42:43.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/139 2022-12-01T09:42:43.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/139 2022-12-01T09:42:43.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/139 2022-12-01T09:42:43.170 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/139 2022-12-01T09:42:43.170 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 57/139 2022-12-01T09:42:43.170 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/139 2022-12-01T09:42:43.170 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/139 2022-12-01T09:42:43.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/139 2022-12-01T09:42:43.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/139 2022-12-01T09:42:43.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/139 2022-12-01T09:42:43.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/139 2022-12-01T09:42:43.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/139 2022-12-01T09:42:43.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/139 2022-12-01T09:42:43.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/139 2022-12-01T09:42:43.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/139 2022-12-01T09:42:43.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/139 2022-12-01T09:42:43.173 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/139 2022-12-01T09:42:43.173 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/139 2022-12-01T09:42:43.173 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-devel-0.188-3.el8.x86_64 71/139 2022-12-01T09:42:43.173 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 72/139 2022-12-01T09:42:43.174 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/139 2022-12-01T09:42:43.174 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : krb5-devel-1.18.2-21.el8.x86_64 74/139 2022-12-01T09:42:43.174 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/139 2022-12-01T09:42:43.174 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/139 2022-12-01T09:42:43.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-8.5.0-17.el8.x86_64 77/139 2022-12-01T09:42:43.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-8.5.0-17.el8.x86_64 78/139 2022-12-01T09:42:43.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/139 2022-12-01T09:42:43.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libselinux-devel-2.9-6.el8.x86_64 80/139 2022-12-01T09:42:43.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/139 2022-12-01T09:42:43.176 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-devel-2.32.1-38.el8.x86_64 82/139 2022-12-01T09:42:43.176 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/139 2022-12-01T09:42:43.176 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8.x86_64 84/139 2022-12-01T09:42:43.176 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 85/139 2022-12-01T09:42:43.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 86/139 2022-12-01T09:42:43.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 87/139 2022-12-01T09:42:43.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 88/139 2022-12-01T09:42:43.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 89/139 2022-12-01T09:42:43.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 90/139 2022-12-01T09:42:43.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 91/139 2022-12-01T09:42:43.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 92/139 2022-12-01T09:42:43.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 93/139 2022-12-01T09:42:43.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 94/139 2022-12-01T09:42:43.179 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.11-20.el8.x86_64 95/139 2022-12-01T09:42:43.179 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/139 2022-12-01T09:42:43.179 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 97/139 2022-12-01T09:42:43.179 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 98/139 2022-12-01T09:42:43.180 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 99/139 2022-12-01T09:42:43.180 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 100/139 2022-12-01T09:42:43.180 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 101/139 2022-12-01T09:42:43.180 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 102/139 2022-12-01T09:42:43.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 103/139 2022-12-01T09:42:43.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 104/139 2022-12-01T09:42:43.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 105/139 2022-12-01T09:42:43.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 106/139 2022-12-01T09:42:43.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 107/139 2022-12-01T09:42:43.182 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 108/139 2022-12-01T09:42:43.182 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 109/139 2022-12-01T09:42:43.182 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 110/139 2022-12-01T09:42:43.182 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 111/139 2022-12-01T09:42:43.183 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 112/139 2022-12-01T09:42:43.183 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/139 2022-12-01T09:42:43.183 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/139 2022-12-01T09:42:43.183 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 115/139 2022-12-01T09:42:43.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 116/139 2022-12-01T09:42:43.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 117/139 2022-12-01T09:42:43.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 118/139 2022-12-01T09:42:43.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 119/139 2022-12-01T09:42:43.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 120/139 2022-12-01T09:42:43.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 121/139 2022-12-01T09:42:43.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 122/139 2022-12-01T09:42:43.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 123/139 2022-12-01T09:42:43.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 124/139 2022-12-01T09:42:43.186 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 125/139 2022-12-01T09:42:43.186 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/139 2022-12-01T09:42:43.186 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 127/139 2022-12-01T09:42:43.186 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 128/139 2022-12-01T09:42:43.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2022-12-01T09:42:43.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 130/139 2022-12-01T09:42:43.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2022-12-01T09:42:43.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.4-1.el8 132/139 2022-12-01T09:42:43.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.0-1.el8 133/139 2022-12-01T09:42:43.188 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el8.x86_64 134/139 2022-12-01T09:42:43.188 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-debuginfod-client-0.187-4.el8.x86_64 135/139 2022-12-01T09:42:43.188 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-0.188-3.el8.x86_64 136/139 2022-12-01T09:42:43.188 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-0.187-4.el8.x86_64 137/139 2022-12-01T09:42:43.189 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libs-0.188-3.el8.x86_64 138/139 2022-12-01T09:42:45.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libs-0.187-4.el8.x86_64 139/139 2022-12-01T09:42:45.166 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:45.166 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2022-12-01T09:42:45.166 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown-1:1.40.4-1.el8.noarch 2022-12-01T09:42:45.167 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-debuginfod-client-0.188-3.el8.x86_64 2022-12-01T09:42:45.167 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-0.188-3.el8.x86_64 2022-12-01T09:42:45.167 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libs-0.188-3.el8.x86_64 2022-12-01T09:42:45.167 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.168 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.168 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2022-12-01T09:42:45.168 INFO:teuthology.orchestra.run.smithi156.stdout: automake-1.16.1-7.el8.noarch 2022-12-01T09:42:45.168 INFO:teuthology.orchestra.run.smithi156.stdout: bison-3.0.4-10.el8.x86_64 2022-12-01T09:42:45.169 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.169 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.169 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.169 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.170 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.170 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.170 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.170 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.171 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.171 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.171 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.171 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.172 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.172 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.172 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.172 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.173 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.173 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.173 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.173 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.173 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.174 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.174 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top-2:18.0.0-676.gf6922ca2.el8.noarch 2022-12-01T09:42:45.174 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel-0.188-3.el8.x86_64 2022-12-01T09:42:45.174 INFO:teuthology.orchestra.run.smithi156.stdout: flex-2.6.1-9.el8.x86_64 2022-12-01T09:42:45.175 INFO:teuthology.orchestra.run.smithi156.stdout: fuse-2.9.7-16.el8.x86_64 2022-12-01T09:42:45.175 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-12-01T09:42:45.175 INFO:teuthology.orchestra.run.smithi156.stdout: jq-1.6-6.el8.x86_64 2022-12-01T09:42:45.175 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-12-01T09:42:45.176 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel-1.18.2-21.el8.x86_64 2022-12-01T09:42:45.176 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-12-01T09:42:45.176 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.176 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.176 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.177 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2022-12-01T09:42:45.177 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-8.5.0-17.el8.x86_64 2022-12-01T09:42:45.177 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.2-3.el8.x86_64 2022-12-01T09:42:45.177 INFO:teuthology.orchestra.run.smithi156.stdout: libpq-13.5-1.el8.x86_64 2022-12-01T09:42:45.178 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-8.5.0-17.el8.x86_64 2022-12-01T09:42:45.178 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-12-01T09:42:45.178 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.179 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.179 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-12-01T09:42:45.179 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.180 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel-2.9-6.el8.x86_64 2022-12-01T09:42:45.180 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-12-01T09:42:45.180 INFO:teuthology.orchestra.run.smithi156.stdout: libtool-2.4.6-25.el8.x86_64 2022-12-01T09:42:45.181 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.3.1-3.el8.x86_64 2022-12-01T09:42:45.181 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel-2.32.1-38.el8.x86_64 2022-12-01T09:42:45.181 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel-0.3.2-2.el8.x86_64 2022-12-01T09:42:45.181 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-12-01T09:42:45.181 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-12-01T09:42:45.182 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.15-4.el8.x86_64 2022-12-01T09:42:45.182 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads-0.3.15-4.el8.x86_64 2022-12-01T09:42:45.182 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel-1:1.1.1k-7.el8.x86_64 2022-12-01T09:42:45.182 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel-10.32-3.el8.x86_64 2022-12-01T09:42:45.183 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16-10.32-3.el8.x86_64 2022-12-01T09:42:45.183 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32-10.32-3.el8.x86_64 2022-12-01T09:42:45.183 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-12-01T09:42:45.184 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-12-01T09:42:45.184 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-12-01T09:42:45.184 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-12-01T09:42:45.184 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.5.1-7.el8.noarch 2022-12-01T09:42:45.185 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-12-01T09:42:45.185 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-12-01T09:42:45.185 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-12-01T09:42:45.185 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.186 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.186 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.186 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-12-01T09:42:45.186 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-12-01T09:42:45.187 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-12-01T09:42:45.187 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-12-01T09:42:45.187 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-12-01T09:42:45.187 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-12-01T09:42:45.187 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-6.2-6.el8.noarch 2022-12-01T09:42:45.188 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-12-01T09:42:45.188 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-12-01T09:42:45.188 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-12-01T09:42:45.188 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-12-01T09:42:45.189 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-12-01T09:42:45.189 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-12-01T09:42:45.189 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-12-01T09:42:45.189 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.0.6-13.el8.noarch 2022-12-01T09:42:45.190 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-12-01T09:42:45.190 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-12-01T09:42:45.190 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-12-01T09:42:45.190 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-12-01T09:42:45.190 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-12-01T09:42:45.191 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-12-01T09:42:45.191 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-12-01T09:42:45.191 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-2.6-1.el8.noarch 2022-12-01T09:42:45.191 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-12-01T09:42:45.192 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-12-01T09:42:45.192 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-12-01T09:42:45.192 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-12-01T09:42:45.193 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.14-14.el8.noarch 2022-12-01T09:42:45.193 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2017.2-9.el8.noarch 2022-12-01T09:42:45.193 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.193 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.194 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-12-01T09:42:45.194 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-12-01T09:42:45.194 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.194 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.4.1-12.el8.noarch 2022-12-01T09:42:45.194 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.8-1.el8.noarch 2022-12-01T09:42:45.195 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-12-01T09:42:45.195 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-12-01T09:42:45.195 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-12-01T09:42:45.195 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-12-01T09:42:45.196 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-12-01T09:42:45.196 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-12-01T09:42:45.196 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-12-01T09:42:45.196 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-12-01T09:42:45.197 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-12-01T09:42:45.197 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-12-01T09:42:45.197 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-12-01T09:42:45.197 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.197 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.198 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:18.0.0-676.gf6922ca2.el8.x86_64 2022-12-01T09:42:45.198 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-1.el8.x86_64 2022-12-01T09:42:45.198 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.13.0-2.el8.x86_64 2022-12-01T09:42:45.198 INFO:teuthology.orchestra.run.smithi156.stdout: uuid-1.6.2-43.el8.x86_64 2022-12-01T09:42:45.198 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-12-01T09:42:45.199 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-12-01T09:42:45.199 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel-1.2.11-20.el8.x86_64 2022-12-01T09:42:45.200 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:45.200 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2022-12-01T09:42:45.327 DEBUG:teuthology.parallel:result is None 2022-12-01T09:42:45.328 DEBUG:teuthology.orchestra.run.smithi033:> sudo lsb_release -is 2022-12-01T09:42:45.378 INFO:teuthology.orchestra.run.smithi033.stdout:CentOSStream 2022-12-01T09:42:45.380 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-12-01T09:42:45.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:42:45.591 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-12-01T09:42:45.619 INFO:teuthology.orchestra.run.smithi033.stdout:18.0.0-676.gf6922ca2.el8 2022-12-01T09:42:45.620 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-676.gf6922ca2.el8 2022-12-01T09:42:45.620 INFO:teuthology.task.install:The correct ceph version 18.0.0-676.gf6922ca2 is installed. 2022-12-01T09:42:45.621 DEBUG:teuthology.orchestra.run.smithi156:> sudo lsb_release -is 2022-12-01T09:42:45.663 INFO:teuthology.orchestra.run.smithi156.stdout:CentOSStream 2022-12-01T09:42:45.664 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-12-01T09:42:45.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f6922ca21f63dad2b198f92826f75d268f12fc97 2022-12-01T09:42:45.890 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-12-01T09:42:45.912 INFO:teuthology.orchestra.run.smithi156.stdout:18.0.0-676.gf6922ca2.el8 2022-12-01T09:42:45.912 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-676.gf6922ca2.el8 2022-12-01T09:42:45.913 INFO:teuthology.task.install:The correct ceph version 18.0.0-676.gf6922ca2 is installed. 2022-12-01T09:42:45.913 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-12-01T09:42:45.914 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:45.914 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-12-01T09:42:45.947 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:42:45.948 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-12-01T09:42:45.979 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-12-01T09:42:45.980 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:45.980 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2022-12-01T09:42:46.019 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-12-01T09:42:46.090 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:42:46.090 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2022-12-01T09:42:46.118 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-12-01T09:42:46.185 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-12-01T09:42:46.186 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:46.186 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2022-12-01T09:42:46.216 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-12-01T09:42:46.286 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:42:46.287 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2022-12-01T09:42:46.314 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-12-01T09:42:46.381 INFO:teuthology.run_tasks:Running task ceph... 2022-12-01T09:42:46.456 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-12-01T09:42:46.457 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /var/log/ceph 2022-12-01T09:42:46.459 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2022-12-01T09:42:46.487 INFO:tasks.ceph:Disabling ceph logrotate... 2022-12-01T09:42:46.488 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/logrotate.d/ceph 2022-12-01T09:42:46.530 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2022-12-01T09:42:46.558 INFO:tasks.ceph:Creating extra log directories... 2022-12-01T09:42:46.558 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-12-01T09:42:46.600 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-12-01T09:42:46.635 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-12-01T09:42:46.636 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-12-01T09:42:46.636 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-12-01T09:42:46.637 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:46.637 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-12-01T09:42:46.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-12-01T09:42:46.805 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-12-01T09:42:46.833 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:42:46.834 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-12-01T09:42:46.852 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-12-01T09:42:46.964 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-12-01T09:42:46.998 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-12-01T09:42:46.998 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-12-01T09:42:46.999 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi/7090976', 'branch': 'wip-khiremat-47893-test-mgr-finisher-thread-5', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}', 'email': None, 'first_in_suite': False, 'job_id': '7090976', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'khiremat-2022-11-24_05:02:42-fs:volumes-wip-khiremat-47893-test-mgr-finisher-thread-5-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-khiremat-47893-test-mgr-finisher-thread-5'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-khiremat-47893-test-mgr-finisher-thread-5', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}}, 'owner': 'scheduled_khiremat@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'wip-khiremat-47893-test-mgr-finisher-thread-5', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_f6922ca21f63dad2b198f92826f75d268f12fc97/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi033.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCU5K+iSOct0/GpdgNFOLbMw2Md3rElP+7vCBZqJCUnY1qOE2O0Esus38MorvaP0+V+BYms3Of/1rzQ6FV63twPbuU8FI8E3LSIGKwLpDYHlmpWdJ1cBQ6MLYI+yHYkDKGY3Uy3WKN6J/DrREE7wb0HgWQ8rdg+BnfeWToIIkY7JYcZfjN9tFSrXuvqMW6JmAL3sIxlmSZzTIt0REBru8oM5hFpAmEy2t42gnJTN5mvXDe5E8BMn4+IAy2cOXkVxAMYG8qIIoeYjZ4MRDvR1kNA+z5KHKXoqmfWSxEu6vhR6Uwfx96MW0vKYYF7YXtSbHUQg3Kd0eSPZGR9L2jjmn+i4oyHo+mXqS45GFbxq98n7Q1UK5r05k6hQZA00lVR4lhQZg4OXIVGCSPx6d2oZIHV4/F3Wm1ZQ26shv6QXBhnoGykJVQ2maqp84OJLe05KSPRCMPqeCAuM/b5f1eaYRtT3BRVnoBVz1SAiatcQh2nIkH34/ZJjU3cOy3qaggwc58=', 'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSSHHPRSNTRUwZpIdve/83WPpP0Z/Iatvpm23NM8z85EaPQFmgKwfIdTKYCz0TJ4BcOvVMu7XNQlTmXBTcHUgA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f6922ca21f63dad2b198f92826f75d268f12fc97'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots', 'tasks.cephfs.test_volumes.TestSubvolumeSnapshots']}}], 'teuthology_branch': 'main', 'teuthology_sha1': '4da97cf64e542f347ec47b7bdbe5eca99759f9b7', 'timestamp': '2022-11-24_05:02:42', 'tube': 'smithi', 'user': 'khiremat', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23126'} 2022-12-01T09:42:47.000 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-12-01T09:42:47.002 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-12-01T09:42:47.049 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/run/ceph 2022-12-01T09:42:47.061 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2022-12-01T09:42:47.118 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:47.119 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2022-12-01T09:42:47.147 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-12-01T09:42:47.148 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2022-12-01T09:42:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-12-01T09:42:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:42:47.207 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 381336 Links: 1 2022-12-01T09:42:47.207 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:42:47.207 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:42:47.208 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2022-12-01 09:42:39.946215427 +0000 2022-12-01T09:42:47.208 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2022-12-01 09:39:44.111944077 +0000 2022-12-01T09:42:47.208 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2022-12-01 09:39:44.111944077 +0000 2022-12-01T09:42:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2022-12-01T09:42:47.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2022-12-01T09:42:47.273 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2022-12-01T09:42:47.273 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2022-12-01T09:42:47.274 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000218785 s, 2.3 MB/s 2022-12-01T09:42:47.275 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2022-12-01T09:42:47.335 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2022-12-01T09:42:47.394 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-12-01T09:42:47.394 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:42:47.395 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 378596 Links: 1 2022-12-01T09:42:47.395 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:42:47.395 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:42:47.395 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2022-12-01 09:42:39.946215427 +0000 2022-12-01T09:42:47.396 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2022-12-01 09:39:44.665935414 +0000 2022-12-01T09:42:47.396 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2022-12-01 09:39:44.665935414 +0000 2022-12-01T09:42:47.396 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2022-12-01T09:42:47.397 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2022-12-01T09:42:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2022-12-01T09:42:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2022-12-01T09:42:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000207102 s, 2.5 MB/s 2022-12-01T09:42:47.463 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2022-12-01T09:42:47.522 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2022-12-01T09:42:47.581 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-12-01T09:42:47.581 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:42:47.581 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 383057 Links: 1 2022-12-01T09:42:47.582 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:42:47.582 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:42:47.582 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2022-12-01 09:42:39.946215427 +0000 2022-12-01T09:42:47.582 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2022-12-01 09:39:45.232926547 +0000 2022-12-01T09:42:47.583 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2022-12-01 09:39:45.232926547 +0000 2022-12-01T09:42:47.583 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2022-12-01T09:42:47.583 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2022-12-01T09:42:47.648 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2022-12-01T09:42:47.648 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2022-12-01T09:42:47.649 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000190864 s, 2.7 MB/s 2022-12-01T09:42:47.650 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2022-12-01T09:42:47.708 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2022-12-01T09:42:47.767 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-12-01T09:42:47.767 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:42:47.768 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 378789 Links: 1 2022-12-01T09:42:47.768 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:42:47.768 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:42:47.769 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2022-12-01 09:42:39.946215427 +0000 2022-12-01T09:42:47.769 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2022-12-01 09:39:45.767918181 +0000 2022-12-01T09:42:47.769 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2022-12-01 09:39:45.767918181 +0000 2022-12-01T09:42:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2022-12-01T09:42:47.770 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2022-12-01T09:42:47.835 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2022-12-01T09:42:47.836 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2022-12-01T09:42:47.836 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000221227 s, 2.3 MB/s 2022-12-01T09:42:47.837 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2022-12-01T09:42:47.895 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:42:47.895 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:42:47.896 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2022-12-01T09:42:47.917 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-12-01T09:42:47.919 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2022-12-01T09:42:47.977 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-12-01T09:42:47.977 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:42:47.978 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 378402 Links: 1 2022-12-01T09:42:47.978 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:42:47.978 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:42:47.979 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2022-12-01 09:42:42.815880850 +0000 2022-12-01T09:42:47.979 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2022-12-01 09:39:34.366182889 +0000 2022-12-01T09:42:47.979 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2022-12-01 09:39:34.366182889 +0000 2022-12-01T09:42:47.979 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2022-12-01T09:42:47.980 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2022-12-01T09:42:48.045 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2022-12-01T09:42:48.045 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2022-12-01T09:42:48.046 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000181266 s, 2.8 MB/s 2022-12-01T09:42:48.047 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2022-12-01T09:42:48.107 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2022-12-01T09:42:48.166 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-12-01T09:42:48.167 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:42:48.167 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 378536 Links: 1 2022-12-01T09:42:48.167 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:42:48.168 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:42:48.168 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2022-12-01 09:42:42.816880833 +0000 2022-12-01T09:42:48.168 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2022-12-01 09:39:34.897173759 +0000 2022-12-01T09:42:48.169 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2022-12-01 09:39:34.897173759 +0000 2022-12-01T09:42:48.169 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2022-12-01T09:42:48.170 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2022-12-01T09:42:48.233 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2022-12-01T09:42:48.234 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2022-12-01T09:42:48.234 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000126949 s, 4.0 MB/s 2022-12-01T09:42:48.235 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2022-12-01T09:42:48.297 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2022-12-01T09:42:48.355 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-12-01T09:42:48.355 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:42:48.356 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 379207 Links: 1 2022-12-01T09:42:48.356 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:42:48.356 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:42:48.356 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2022-12-01 09:42:42.816880833 +0000 2022-12-01T09:42:48.357 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2022-12-01 09:39:35.467163959 +0000 2022-12-01T09:42:48.357 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2022-12-01 09:39:35.467163959 +0000 2022-12-01T09:42:48.357 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2022-12-01T09:42:48.358 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2022-12-01T09:42:48.421 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2022-12-01T09:42:48.421 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2022-12-01T09:42:48.422 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 8.2242e-05 s, 6.2 MB/s 2022-12-01T09:42:48.423 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2022-12-01T09:42:48.482 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2022-12-01T09:42:48.539 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-12-01T09:42:48.540 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-12-01T09:42:48.540 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 384080 Links: 1 2022-12-01T09:42:48.540 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-12-01T09:42:48.540 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2022-12-01T09:42:48.541 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2022-12-01 09:42:42.816880833 +0000 2022-12-01T09:42:48.541 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2022-12-01 09:39:36.010154624 +0000 2022-12-01T09:42:48.541 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2022-12-01 09:39:36.010154624 +0000 2022-12-01T09:42:48.541 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2022-12-01T09:42:48.542 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2022-12-01T09:42:48.605 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2022-12-01T09:42:48.605 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2022-12-01T09:42:48.606 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000114881 s, 4.5 MB/s 2022-12-01T09:42:48.607 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2022-12-01T09:42:48.666 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:42:48.823 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-12-01T09:42:48.824 INFO:tasks.ceph:Generating config... 2022-12-01T09:42:48.825 INFO:tasks.ceph:[client] client mount timeout = 600 2022-12-01T09:42:48.826 INFO:tasks.ceph:[client] debug client = 20 2022-12-01T09:42:48.826 INFO:tasks.ceph:[client] debug ms = 1 2022-12-01T09:42:48.826 INFO:tasks.ceph:[client] pid file = 2022-12-01T09:42:48.827 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-12-01T09:42:48.827 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-12-01T09:42:48.827 INFO:tasks.ceph:[mds] debug mds = 20 2022-12-01T09:42:48.828 INFO:tasks.ceph:[mds] debug mds balancer = 20 2022-12-01T09:42:48.828 INFO:tasks.ceph:[mds] debug ms = 1 2022-12-01T09:42:48.828 INFO:tasks.ceph:[mds] mds debug frag = True 2022-12-01T09:42:48.829 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-12-01T09:42:48.829 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-12-01T09:42:48.829 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-12-01T09:42:48.829 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-12-01T09:42:48.830 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-12-01T09:42:48.830 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-12-01T09:42:48.830 INFO:tasks.ceph:[mgr] debug client = 20 2022-12-01T09:42:48.831 INFO:tasks.ceph:[mgr] debug finisher = 20 2022-12-01T09:42:48.831 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-12-01T09:42:48.831 INFO:tasks.ceph:[mgr] debug ms = 1 2022-12-01T09:42:48.832 INFO:tasks.ceph:[mon] debug mon = 20 2022-12-01T09:42:48.832 INFO:tasks.ceph:[mon] debug ms = 1 2022-12-01T09:42:48.832 INFO:tasks.ceph:[mon] debug paxos = 20 2022-12-01T09:42:48.833 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-12-01T09:42:48.833 INFO:tasks.ceph:[osd] bdev async discard = True 2022-12-01T09:42:48.833 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-12-01T09:42:48.833 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-12-01T09:42:48.834 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-12-01T09:42:48.834 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-12-01T09:42:48.834 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2022-12-01T09:42:48.835 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2022-12-01T09:42:48.835 INFO:tasks.ceph:[osd] debug ms = 1 2022-12-01T09:42:48.835 INFO:tasks.ceph:[osd] debug osd = 20 2022-12-01T09:42:48.836 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2022-12-01T09:42:48.836 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-12-01T09:42:48.836 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-12-01T09:42:48.836 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-12-01T09:42:48.837 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-12-01T09:42:48.837 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-12-01T09:42:48.837 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-12-01T09:42:48.838 INFO:tasks.ceph:Setting up mon.a... 2022-12-01T09:42:48.838 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-12-01T09:42:48.912 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.keyring 2022-12-01T09:42:48.915 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-12-01T09:42:48.967 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-12-01T09:42:48.997 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.33'), ('mon.b', '172.21.15.156'), ('mon.c', '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]')] 2022-12-01T09:42:48.998 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.33,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-12-01T09:42:48.999 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:49.000 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-12-01T09:42:49.057 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.33 --add b 172.21.15.156 --addv c '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:42:49.148 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:42:49.148 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: generated fsid c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a 2022-12-01T09:42:49.148 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = pacific 2022-12-01T09:42:49.149 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 0 2022-12-01T09:42:49.149 INFO:teuthology.orchestra.run.smithi033.stdout:fsid c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a 2022-12-01T09:42:49.149 INFO:teuthology.orchestra.run.smithi033.stdout:last_changed 2022-12-01T09:42:49.145634+0000 2022-12-01T09:42:49.150 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-12-01T09:42:49.145634+0000 2022-12-01T09:42:49.150 INFO:teuthology.orchestra.run.smithi033.stdout:min_mon_release 16 (pacific) 2022-12-01T09:42:49.150 INFO:teuthology.orchestra.run.smithi033.stdout:election_strategy: 1 2022-12-01T09:42:49.150 INFO:teuthology.orchestra.run.smithi033.stdout:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2022-12-01T09:42:49.150 INFO:teuthology.orchestra.run.smithi033.stdout:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2022-12-01T09:42:49.151 INFO:teuthology.orchestra.run.smithi033.stdout:2: [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] mon.c 2022-12-01T09:42:49.151 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-12-01T09:42:49.153 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-12-01T09:42:49.171 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a... 2022-12-01T09:42:49.173 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-12-01T09:42:49.214 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-12-01T09:42:49.261 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2022-12-01T09:42:49.261 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2022-12-01T09:42:49.262 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-12-01T09:42:49.262 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2022-12-01T09:42:49.262 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.262 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2022-12-01T09:42:49.263 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.263 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2022-12-01T09:42:49.263 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.263 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2022-12-01T09:42:49.263 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2022-12-01T09:42:49.264 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.264 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2022-12-01T09:42:49.264 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2022-12-01T09:42:49.264 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.265 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2022-12-01T09:42:49.265 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2022-12-01T09:42:49.265 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.265 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2022-12-01T09:42:49.266 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2022-12-01T09:42:49.266 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.266 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2022-12-01T09:42:49.266 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.266 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2022-12-01T09:42:49.267 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2022-12-01T09:42:49.267 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2022-12-01T09:42:49.267 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2022-12-01T09:42:49.267 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2022-12-01T09:42:49.268 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2022-12-01T09:42:49.268 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2022-12-01T09:42:49.268 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-12-01T09:42:49.268 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2022-12-01T09:42:49.268 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2022-12-01T09:42:49.269 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.269 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-12-01T09:42:49.269 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.269 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2022-12-01T09:42:49.270 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.270 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2022-12-01T09:42:49.270 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.270 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2022-12-01T09:42:49.270 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2022-12-01T09:42:49.271 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2022-12-01T09:42:49.271 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.33,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]" 2022-12-01T09:42:49.271 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a 2022-12-01T09:42:49.271 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.272 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2022-12-01T09:42:49.272 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2022-12-01T09:42:49.272 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.272 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2022-12-01T09:42:49.273 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2022-12-01T09:42:49.273 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.273 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2022-12-01T09:42:49.273 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2022-12-01T09:42:49.273 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.274 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2022-12-01T09:42:49.274 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2022-12-01T09:42:49.274 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2022-12-01T09:42:49.274 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.274 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2022-12-01T09:42:49.275 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2022-12-01T09:42:49.275 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.275 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2022-12-01T09:42:49.275 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.276 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2022-12-01T09:42:49.276 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.276 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2022-12-01T09:42:49.276 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.277 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2022-12-01T09:42:49.277 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2022-12-01T09:42:49.277 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.277 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2022-12-01T09:42:49.277 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2022-12-01T09:42:49.278 INFO:teuthology.orchestra.run.smithi156.stdout: bdev async discard = True 2022-12-01T09:42:49.278 INFO:teuthology.orchestra.run.smithi156.stdout: bdev enable discard = True 2022-12-01T09:42:49.278 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore allocator = bitmap 2022-12-01T09:42:49.278 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore block size = 96636764160 2022-12-01T09:42:49.278 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore fsck on mount = True 2022-12-01T09:42:49.279 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluefs = 1/20 2022-12-01T09:42:49.279 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluestore = 1/20 2022-12-01T09:42:49.279 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2022-12-01T09:42:49.279 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2022-12-01T09:42:49.280 INFO:teuthology.orchestra.run.smithi156.stdout: debug rocksdb = 4/10 2022-12-01T09:42:49.280 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd backfillfull_ratio = 0.85 2022-12-01T09:42:49.280 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd full ratio = 0.9 2022-12-01T09:42:49.280 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd nearfull ratio = 0.8 2022-12-01T09:42:49.280 INFO:teuthology.orchestra.run.smithi156.stdout: osd failsafe full ratio = 0.95 2022-12-01T09:42:49.281 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = bluestore 2022-12-01T09:42:49.281 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2022-12-01T09:42:49.281 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.281 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2022-12-01T09:42:49.282 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2022-12-01T09:42:49.282 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2022-12-01T09:42:49.282 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2022-12-01T09:42:49.282 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2022-12-01T09:42:49.282 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2022-12-01T09:42:49.283 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2022-12-01T09:42:49.283 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2022-12-01T09:42:49.283 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2022-12-01T09:42:49.283 INFO:teuthology.orchestra.run.smithi156.stdout: debug finisher = 20 2022-12-01T09:42:49.284 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.284 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2022-12-01T09:42:49.284 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2022-12-01T09:42:49.284 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2022-12-01T09:42:49.284 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2022-12-01T09:42:49.285 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2022-12-01T09:42:49.285 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2022-12-01T09:42:49.285 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2022-12-01T09:42:49.285 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2022-12-01T09:42:49.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2022-12-01T09:42:49.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2022-12-01T09:42:49.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2022-12-01T09:42:49.286 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.286 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-12-01T09:42:49.287 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2022-12-01T09:42:49.287 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2022-12-01T09:42:49.287 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.287 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2022-12-01T09:42:49.288 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-12-01T09:42:49.288 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-12-01T09:42:49.288 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.288 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2022-12-01T09:42:49.289 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2022-12-01T09:42:49.289 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.289 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2022-12-01T09:42:49.289 INFO:teuthology.orchestra.run.smithi156.stdout: mon op complaint time = 120 2022-12-01T09:42:49.289 INFO:teuthology.orchestra.run.smithi156.stdout: 2022-12-01T09:42:49.290 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2022-12-01T09:42:49.290 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2022-12-01T09:42:49.290 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2022-12-01T09:42:49.290 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2022-12-01T09:42:49.291 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-12-01T09:42:49.291 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-12-01T09:42:49.291 INFO:teuthology.orchestra.run.smithi156.stdout: client mount timeout = 600 2022-12-01T09:42:49.291 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2022-12-01T09:42:49.291 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2022-12-01T09:42:49.292 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = "" 2022-12-01T09:42:49.292 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2022-12-01T09:42:49.292 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2022-12-01T09:42:49.292 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2022-12-01T09:42:49.293 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2022-12-01T09:42:49.293 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2022-12-01T09:42:49.293 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2022-12-01T09:42:49.293 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2022-12-01T09:42:49.294 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2022-12-01T09:42:49.294 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.d] 2022-12-01T09:42:49.294 INFO:teuthology.orchestra.run.smithi156.stdout:[mds] 2022-12-01T09:42:49.294 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds = 20 2022-12-01T09:42:49.294 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds balancer = 20 2022-12-01T09:42:49.295 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2022-12-01T09:42:49.295 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug frag = True 2022-12-01T09:42:49.295 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug scatterstat = True 2022-12-01T09:42:49.295 INFO:teuthology.orchestra.run.smithi156.stdout: mds op complaint time = 180 2022-12-01T09:42:49.296 INFO:teuthology.orchestra.run.smithi156.stdout: mds verify scatter = True 2022-12-01T09:42:49.296 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2022-12-01T09:42:49.296 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2022-12-01T09:42:49.296 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2022-12-01T09:42:49.298 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2022-12-01T09:42:49.298 INFO:teuthology.orchestra.run.smithi033.stdout: chdir = "" 2022-12-01T09:42:49.299 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-12-01T09:42:49.299 INFO:teuthology.orchestra.run.smithi033.stdout: auth supported = cephx 2022-12-01T09:42:49.299 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.299 INFO:teuthology.orchestra.run.smithi033.stdout: filestore xattr use omap = true 2022-12-01T09:42:49.300 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.300 INFO:teuthology.orchestra.run.smithi033.stdout: mon clock drift allowed = 1.000 2022-12-01T09:42:49.300 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.300 INFO:teuthology.orchestra.run.smithi033.stdout: osd crush chooseleaf type = 0 2022-12-01T09:42:49.300 INFO:teuthology.orchestra.run.smithi033.stdout: auth debug = true 2022-12-01T09:42:49.301 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.301 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on old message = true 2022-12-01T09:42:49.301 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on bug = true 2022-12-01T09:42:49.301 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.302 INFO:teuthology.orchestra.run.smithi033.stdout: mon max pg per osd = 10000 # >= luminous 2022-12-01T09:42:49.302 INFO:teuthology.orchestra.run.smithi033.stdout: mon pg warn max object skew = 0 2022-12-01T09:42:49.302 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.302 INFO:teuthology.orchestra.run.smithi033.stdout: # disable pg_autoscaler by default for new pools 2022-12-01T09:42:49.302 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pool_default_pg_autoscale_mode = off 2022-12-01T09:42:49.303 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.303 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default size = 2 2022-12-01T09:42:49.304 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.304 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow primary affinity = true 2022-12-01T09:42:49.304 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow pg remap = true 2022-12-01T09:42:49.304 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on legacy crush tunables = false 2022-12-01T09:42:49.304 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on crush straw calc version zero = false 2022-12-01T09:42:49.305 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on no sortbitwise = false 2022-12-01T09:42:49.305 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on osd down out interval zero = false 2022-12-01T09:42:49.305 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on too few osds = false 2022-12-01T09:42:49.305 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-12-01T09:42:49.306 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_no_redundancy = false 2022-12-01T09:42:49.306 INFO:teuthology.orchestra.run.smithi033.stdout: mon_allow_pool_size_one = true 2022-12-01T09:42:49.306 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.306 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-12-01T09:42:49.307 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.307 INFO:teuthology.orchestra.run.smithi033.stdout: osd default data pool replay window = 5 2022-12-01T09:42:49.307 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.308 INFO:teuthology.orchestra.run.smithi033.stdout: mon allow pool delete = true 2022-12-01T09:42:49.308 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.308 INFO:teuthology.orchestra.run.smithi033.stdout: mon cluster log file level = debug 2022-12-01T09:42:49.308 INFO:teuthology.orchestra.run.smithi033.stdout: debug asserts on shutdown = true 2022-12-01T09:42:49.309 INFO:teuthology.orchestra.run.smithi033.stdout: mon health detail to clog = false 2022-12-01T09:42:49.309 INFO:teuthology.orchestra.run.smithi033.stdout: mon host = "172.21.15.33,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]" 2022-12-01T09:42:49.309 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a 2022-12-01T09:42:49.309 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.310 INFO:teuthology.orchestra.run.smithi033.stdout:[osd] 2022-12-01T09:42:49.310 INFO:teuthology.orchestra.run.smithi033.stdout: osd journal size = 100 2022-12-01T09:42:49.310 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.310 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub load threshold = 5.0 2022-12-01T09:42:49.311 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub max interval = 600 2022-12-01T09:42:49.311 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.311 INFO:teuthology.orchestra.run.smithi033.stdout: osd recover clone overlap = true 2022-12-01T09:42:49.311 INFO:teuthology.orchestra.run.smithi033.stdout: osd recovery max chunk = 1048576 2022-12-01T09:42:49.312 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.312 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug shutdown = true 2022-12-01T09:42:49.312 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug op order = true 2022-12-01T09:42:49.312 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug verify stray on activate = true 2022-12-01T09:42:49.312 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.313 INFO:teuthology.orchestra.run.smithi033.stdout: osd open classes on start = true 2022-12-01T09:42:49.313 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug pg log writeout = true 2022-12-01T09:42:49.313 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.313 INFO:teuthology.orchestra.run.smithi033.stdout: osd deep scrub update digest min age = 30 2022-12-01T09:42:49.314 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.314 INFO:teuthology.orchestra.run.smithi033.stdout: osd map max advance = 10 2022-12-01T09:42:49.314 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.314 INFO:teuthology.orchestra.run.smithi033.stdout: journal zero on create = true 2022-12-01T09:42:49.315 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.315 INFO:teuthology.orchestra.run.smithi033.stdout: filestore ondisk finisher threads = 3 2022-12-01T09:42:49.315 INFO:teuthology.orchestra.run.smithi033.stdout: filestore apply finisher threads = 3 2022-12-01T09:42:49.315 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.316 INFO:teuthology.orchestra.run.smithi033.stdout: bdev debug aio = true 2022-12-01T09:42:49.316 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug misdirected ops = true 2022-12-01T09:42:49.316 INFO:teuthology.orchestra.run.smithi033.stdout: bdev async discard = True 2022-12-01T09:42:49.316 INFO:teuthology.orchestra.run.smithi033.stdout: bdev enable discard = True 2022-12-01T09:42:49.317 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore allocator = bitmap 2022-12-01T09:42:49.317 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore block size = 96636764160 2022-12-01T09:42:49.317 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore fsck on mount = True 2022-12-01T09:42:49.317 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluefs = 1/20 2022-12-01T09:42:49.318 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluestore = 1/20 2022-12-01T09:42:49.318 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2022-12-01T09:42:49.318 INFO:teuthology.orchestra.run.smithi033.stdout: debug osd = 20 2022-12-01T09:42:49.318 INFO:teuthology.orchestra.run.smithi033.stdout: debug rocksdb = 4/10 2022-12-01T09:42:49.318 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd backfillfull_ratio = 0.85 2022-12-01T09:42:49.319 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd full ratio = 0.9 2022-12-01T09:42:49.319 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd nearfull ratio = 0.8 2022-12-01T09:42:49.319 INFO:teuthology.orchestra.run.smithi033.stdout: osd failsafe full ratio = 0.95 2022-12-01T09:42:49.319 INFO:teuthology.orchestra.run.smithi033.stdout: osd objectstore = bluestore 2022-12-01T09:42:49.320 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2022-12-01T09:42:49.320 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.320 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr] 2022-12-01T09:42:49.320 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2022-12-01T09:42:49.321 INFO:teuthology.orchestra.run.smithi033.stdout: debug mgr = 20 2022-12-01T09:42:49.321 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2022-12-01T09:42:49.321 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2022-12-01T09:42:49.321 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2022-12-01T09:42:49.322 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2022-12-01T09:42:49.322 INFO:teuthology.orchestra.run.smithi033.stdout: mgr/telemetry/nag = false 2022-12-01T09:42:49.322 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2022-12-01T09:42:49.322 INFO:teuthology.orchestra.run.smithi033.stdout: debug finisher = 20 2022-12-01T09:42:49.322 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.323 INFO:teuthology.orchestra.run.smithi033.stdout:[mon] 2022-12-01T09:42:49.323 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2022-12-01T09:42:49.323 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2022-12-01T09:42:49.323 INFO:teuthology.orchestra.run.smithi033.stdout: debug paxos = 20 2022-12-01T09:42:49.324 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2022-12-01T09:42:49.324 INFO:teuthology.orchestra.run.smithi033.stdout: mon data avail warn = 5 2022-12-01T09:42:49.324 INFO:teuthology.orchestra.run.smithi033.stdout: mon mgr mkfs grace = 240 2022-12-01T09:42:49.324 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2022-12-01T09:42:49.325 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd reporter subtree level = osd 2022-12-01T09:42:49.325 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd prime pg temp = true 2022-12-01T09:42:49.325 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2022-12-01T09:42:49.325 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.326 INFO:teuthology.orchestra.run.smithi033.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-12-01T09:42:49.326 INFO:teuthology.orchestra.run.smithi033.stdout: auth mon ticket ttl = 660 # 11m 2022-12-01T09:42:49.326 INFO:teuthology.orchestra.run.smithi033.stdout: auth service ticket ttl = 240 # 4m 2022-12-01T09:42:49.326 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.327 INFO:teuthology.orchestra.run.smithi033.stdout: # don't complain about insecure global_id in the test suite 2022-12-01T09:42:49.327 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-12-01T09:42:49.327 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-12-01T09:42:49.328 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.328 INFO:teuthology.orchestra.run.smithi033.stdout: # 1m isn't quite enough 2022-12-01T09:42:49.328 INFO:teuthology.orchestra.run.smithi033.stdout: mon_down_mkfs_grace = 2m 2022-12-01T09:42:49.328 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.328 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_filestore_osds = false 2022-12-01T09:42:49.329 INFO:teuthology.orchestra.run.smithi033.stdout: mon op complaint time = 120 2022-12-01T09:42:49.329 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:42:49.329 INFO:teuthology.orchestra.run.smithi033.stdout:[client] 2022-12-01T09:42:49.329 INFO:teuthology.orchestra.run.smithi033.stdout: rgw cache enabled = true 2022-12-01T09:42:49.330 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable ops log = true 2022-12-01T09:42:49.330 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable usage log = true 2022-12-01T09:42:49.330 INFO:teuthology.orchestra.run.smithi033.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-12-01T09:42:49.330 INFO:teuthology.orchestra.run.smithi033.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-12-01T09:42:49.331 INFO:teuthology.orchestra.run.smithi033.stdout: client mount timeout = 600 2022-12-01T09:42:49.331 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2022-12-01T09:42:49.331 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2022-12-01T09:42:49.331 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = "" 2022-12-01T09:42:49.332 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2022-12-01T09:42:49.332 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2022-12-01T09:42:49.332 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.a] 2022-12-01T09:42:49.332 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.b] 2022-12-01T09:42:49.332 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.c] 2022-12-01T09:42:49.333 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2022-12-01T09:42:49.333 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2022-12-01T09:42:49.333 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2022-12-01T09:42:49.333 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2022-12-01T09:42:49.334 INFO:teuthology.orchestra.run.smithi033.stdout:[mds] 2022-12-01T09:42:49.334 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds = 20 2022-12-01T09:42:49.334 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds balancer = 20 2022-12-01T09:42:49.335 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2022-12-01T09:42:49.335 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug frag = True 2022-12-01T09:42:49.335 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug scatterstat = True 2022-12-01T09:42:49.336 INFO:teuthology.orchestra.run.smithi033.stdout: mds op complaint time = 180 2022-12-01T09:42:49.336 INFO:teuthology.orchestra.run.smithi033.stdout: mds verify scatter = True 2022-12-01T09:42:49.336 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2022-12-01T09:42:49.337 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2022-12-01T09:42:49.337 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2022-12-01T09:42:49.337 INFO:tasks.ceph:Creating admin key on mon.a... 2022-12-01T09:42:49.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-12-01T09:42:49.422 INFO:tasks.ceph:Copying monmap to all nodes... 2022-12-01T09:42:49.422 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:49.423 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-12-01T09:42:49.441 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:49.442 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-12-01T09:42:49.500 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi033.front.sepia.ceph.com 2022-12-01T09:42:49.500 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:49.501 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.keyring 2022-12-01T09:42:49.501 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-12-01T09:42:49.605 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:42:49.606 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:42:49.713 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2022-12-01T09:42:49.713 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:42:49.714 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2022-12-01T09:42:49.714 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-12-01T09:42:49.753 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:42:49.753 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:42:49.811 INFO:tasks.ceph:Setting up mon nodes... 2022-12-01T09:42:49.811 INFO:tasks.ceph:Setting up mgr nodes... 2022-12-01T09:42:49.812 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-12-01T09:42:49.867 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-12-01T09:42:49.870 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-12-01T09:42:49.933 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-12-01T09:42:49.936 INFO:tasks.ceph:Setting up mds nodes... 2022-12-01T09:42:49.936 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-12-01T09:42:49.991 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-12-01T09:42:49.993 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-12-01T09:42:50.021 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-12-01T09:42:50.116 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-12-01T09:42:50.119 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-12-01T09:42:50.147 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-12-01T09:42:50.201 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-12-01T09:42:50.204 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-12-01T09:42:50.233 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-12-01T09:42:50.326 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-12-01T09:42:50.328 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-12-01T09:42:50.356 INFO:tasks.ceph_client:Setting up client nodes... 2022-12-01T09:42:50.357 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-12-01T09:42:50.403 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-12-01T09:42:50.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2022-12-01T09:42:50.461 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.2.keyring 2022-12-01T09:42:50.474 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-12-01T09:42:50.518 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-12-01T09:42:50.531 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2022-12-01T09:42:50.614 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.client.3.keyring 2022-12-01T09:42:50.627 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-12-01T09:42:50.628 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-12-01T09:42:50.628 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-12-01T09:42:50.657 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:42:50.658 INFO:tasks.ceph:role: osd.0 2022-12-01T09:42:50.658 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com 2022-12-01T09:42:50.659 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-12-01T09:42:50.733 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:42:50.733 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:42:50.734 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:42:50.734 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:42:50.734 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:42:50.734 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:42:50.735 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:42:50.735 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:42:50.735 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:42:50.735 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:42:51.160 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2022-12-01T09:42:51.162 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2022-12-01T09:42:51.162 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-12-01T09:42:51.320 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-12-01T09:42:51.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-12-01T09:42:51.428 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:42:51.429 INFO:tasks.ceph:role: osd.1 2022-12-01T09:42:51.429 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com 2022-12-01T09:42:51.429 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-12-01T09:42:51.505 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:42:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:42:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:42:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:42:51.507 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:42:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:42:51.507 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:42:51.508 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:42:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:42:51.508 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:42:51.926 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2022-12-01T09:42:51.928 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2022-12-01T09:42:51.928 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-12-01T09:42:52.036 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-12-01T09:42:52.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-12-01T09:42:52.145 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:42:52.146 INFO:tasks.ceph:role: osd.2 2022-12-01T09:42:52.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com 2022-12-01T09:42:52.146 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-12-01T09:42:52.231 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:42:52.232 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:42:52.232 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:42:52.232 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:42:52.232 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:42:52.233 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:42:52.233 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:42:52.233 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:42:52.233 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:42:52.233 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:42:52.686 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2022-12-01T09:42:52.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2022-12-01T09:42:52.689 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-12-01T09:42:52.874 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-12-01T09:42:52.911 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-12-01T09:42:52.982 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-12-01T09:42:52.982 INFO:tasks.ceph:role: osd.3 2022-12-01T09:42:52.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com 2022-12-01T09:42:52.983 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-12-01T09:42:53.058 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:42:53.059 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:42:53.060 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:42:53.060 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:42:53.061 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:42:53.061 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:42:53.061 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:42:53.062 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:42:53.062 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:42:53.063 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:42:53.476 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2022-12-01T09:42:53.477 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2022-12-01T09:42:53.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-12-01T09:42:53.655 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-12-01T09:42:53.690 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:42:53.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:53.776+0000 7f1cf1ebc5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-12-01T09:42:53.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:53.776+0000 7f1cf1ebc5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-12-01T09:42:53.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:53.776+0000 7f1cf1ebc5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-12-01T09:42:53.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:53.776+0000 7f1cf1ebc5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-12-01T09:42:53.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:53.776+0000 7f1cf1ebc5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-12-01T09:42:53.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:53.777+0000 7f1cf1ebc5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-12-01T09:42:56.638 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-12-01T09:42:56.672 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:42:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:56.764+0000 7ff23403d5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-12-01T09:42:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:56.764+0000 7ff23403d5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-12-01T09:42:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:56.764+0000 7ff23403d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-12-01T09:42:56.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:56.764+0000 7ff23403d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-12-01T09:42:56.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:56.764+0000 7ff23403d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-12-01T09:42:56.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:56.765+0000 7ff23403d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-12-01T09:42:59.613 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-12-01T09:42:59.646 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:42:59.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:59.736+0000 7f252b4d95c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-12-01T09:42:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:59.736+0000 7f252b4d95c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-12-01T09:42:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:59.736+0000 7f252b4d95c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-12-01T09:42:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:59.736+0000 7f252b4d95c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-12-01T09:42:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:59.736+0000 7f252b4d95c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-12-01T09:42:59.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:42:59.737+0000 7f252b4d95c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-12-01T09:43:02.587 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-12-01T09:43:02.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:43:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:02.715+0000 7f8f6d74d5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-12-01T09:43:02.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:02.715+0000 7f8f6d74d5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-12-01T09:43:02.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:02.715+0000 7f8f6d74d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-12-01T09:43:02.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:02.715+0000 7f8f6d74d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-12-01T09:43:02.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:02.715+0000 7f8f6d74d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-12-01T09:43:02.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:02.716+0000 7f8f6d74d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-12-01T09:43:05.571 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-12-01T09:43:05.605 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-12-01T09:43:05.641 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:43:05.642 INFO:tasks.ceph:role: osd.4 2022-12-01T09:43:05.642 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2022-12-01T09:43:05.643 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-12-01T09:43:05.710 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:43:05.711 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:43:05.711 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:43:05.711 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:43:05.712 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:43:05.712 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:43:05.712 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:43:05.712 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:43:05.713 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:43:05.713 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:43:05.733 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2022-12-01T09:43:05.734 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2022-12-01T09:43:05.735 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-12-01T09:43:05.817 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-12-01T09:43:05.889 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-12-01T09:43:05.957 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:43:05.958 INFO:tasks.ceph:role: osd.5 2022-12-01T09:43:05.958 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2022-12-01T09:43:05.959 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-12-01T09:43:06.024 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:43:06.025 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:43:06.025 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:43:06.025 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:43:06.026 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:43:06.026 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:43:06.026 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:43:06.026 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:43:06.027 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:43:06.027 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:43:06.047 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2022-12-01T09:43:06.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2022-12-01T09:43:06.049 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-12-01T09:43:06.129 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-12-01T09:43:06.200 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-12-01T09:43:06.267 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:43:06.268 INFO:tasks.ceph:role: osd.6 2022-12-01T09:43:06.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2022-12-01T09:43:06.269 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-12-01T09:43:06.334 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:43:06.335 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:43:06.335 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:43:06.336 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:43:06.336 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:43:06.337 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:43:06.337 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:43:06.337 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:43:06.337 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:43:06.338 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:43:06.357 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2022-12-01T09:43:06.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2022-12-01T09:43:06.359 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-12-01T09:43:06.447 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-12-01T09:43:06.517 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-12-01T09:43:06.585 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-12-01T09:43:06.585 INFO:tasks.ceph:role: osd.7 2022-12-01T09:43:06.585 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com 2022-12-01T09:43:06.586 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-12-01T09:43:06.651 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-12-01T09:43:06.652 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2022-12-01T09:43:06.652 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-12-01T09:43:06.652 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-12-01T09:43:06.653 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-12-01T09:43:06.653 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2022-12-01T09:43:06.653 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-12-01T09:43:06.654 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-12-01T09:43:06.654 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-12-01T09:43:06.654 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-12-01T09:43:06.674 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2022-12-01T09:43:06.676 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2022-12-01T09:43:06.676 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-12-01T09:43:06.760 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-12-01T09:43:06.831 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:43:06.917 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:06.914+0000 7fa8777cf5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-12-01T09:43:06.918 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:06.914+0000 7fa8777cf5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-12-01T09:43:06.918 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:06.914+0000 7fa8777cf5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-12-01T09:43:06.918 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:06.914+0000 7fa8777cf5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-12-01T09:43:06.919 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:06.914+0000 7fa8777cf5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-12-01T09:43:06.919 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:06.914+0000 7fa8777cf5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-12-01T09:43:09.761 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-12-01T09:43:09.790 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:43:09.879 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:09.875+0000 7fe051d135c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-12-01T09:43:09.880 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:09.875+0000 7fe051d135c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-12-01T09:43:09.880 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:09.875+0000 7fe051d135c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-12-01T09:43:09.881 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:09.875+0000 7fe051d135c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-12-01T09:43:09.881 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:09.875+0000 7fe051d135c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-12-01T09:43:09.881 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:09.875+0000 7fe051d135c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-12-01T09:43:12.736 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-12-01T09:43:12.769 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:43:12.863 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:12.858+0000 7ff38fa5d5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-12-01T09:43:12.863 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:12.858+0000 7ff38fa5d5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-12-01T09:43:12.864 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:12.858+0000 7ff38fa5d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-12-01T09:43:12.864 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:12.858+0000 7ff38fa5d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-12-01T09:43:12.865 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:12.858+0000 7ff38fa5d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-12-01T09:43:12.865 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:12.859+0000 7ff38fa5d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-12-01T09:43:15.710 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-12-01T09:43:15.742 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:43:15.835 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:15.831+0000 7fb5debc15c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-12-01T09:43:15.835 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:15.831+0000 7fb5debc15c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-12-01T09:43:15.836 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:15.831+0000 7fb5debc15c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-12-01T09:43:15.836 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:15.831+0000 7fb5debc15c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-12-01T09:43:15.836 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:15.831+0000 7fb5debc15c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-12-01T09:43:15.836 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:15.831+0000 7fb5debc15c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-12-01T09:43:17.001 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-12-01T09:43:17.004 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-12-01T09:43:18.690 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-12-01T09:43:18.724 INFO:tasks.ceph:Reading keys from all nodes... 2022-12-01T09:43:18.725 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:18.725 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-12-01T09:43:18.758 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:18.758 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-12-01T09:43:18.831 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:18.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-12-01T09:43:18.903 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:18.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-12-01T09:43:18.974 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:18.975 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-12-01T09:43:19.044 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:19.045 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-12-01T09:43:19.114 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:19.114 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-12-01T09:43:19.183 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:19.184 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-12-01T09:43:19.213 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:19.214 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-12-01T09:43:19.283 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:19.284 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-12-01T09:43:19.353 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:19.353 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-12-01T09:43:19.421 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:19.444 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-12-01T09:43:19.488 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:19.489 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-12-01T09:43:19.555 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:19.555 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-12-01T09:43:19.622 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:19.622 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-12-01T09:43:19.645 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:19.645 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2022-12-01T09:43:19.707 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:19.707 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2022-12-01T09:43:19.725 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:19.725 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2022-12-01T09:43:19.783 INFO:tasks.ceph:Adding keys to all mons... 2022-12-01T09:43:19.783 DEBUG:teuthology.orchestra.run.smithi033:> sudo tee -a /etc/ceph/ceph.keyring 2022-12-01T09:43:19.786 DEBUG:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2022-12-01T09:43:19.826 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.y] 2022-12-01T09:43:19.827 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAZd4hjluKZMxAARSJTYehJRelHtXCUZRnXNQ== 2022-12-01T09:43:19.827 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2022-12-01T09:43:19.827 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAZd4hjMOb0OhAAIdZtBJVijR180doidBIjgQ== 2022-12-01T09:43:19.827 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2022-12-01T09:43:19.828 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAad4hjZLvXBhAA7WX3/RuLYQrEnTwN50Gd4g== 2022-12-01T09:43:19.828 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.0] 2022-12-01T09:43:19.828 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAdd4hj3d1cLhAAxOVAAZU5bQOOXE0jrEDUjA== 2022-12-01T09:43:19.828 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.1] 2022-12-01T09:43:19.829 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAgd4hjCGmoLRAAyB3svZIpR5GUt5BsXRy+Ig== 2022-12-01T09:43:19.829 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.2] 2022-12-01T09:43:19.829 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAjd4hjHDz+KxAA5zOSSAAaTsV73pEsqnAQWQ== 2022-12-01T09:43:19.829 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.3] 2022-12-01T09:43:19.829 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAmd4hjHRu8KhAAXXv0tawz8Kf9Z2p/QUEmJA== 2022-12-01T09:43:19.830 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.x] 2022-12-01T09:43:19.830 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAZd4hjYluDNxAA8E3gNXppgTtoFDoNceErPg== 2022-12-01T09:43:19.830 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2022-12-01T09:43:19.830 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAad4hjUevfCxAAxnxXauHxRv/oEnBM0SRdoQ== 2022-12-01T09:43:19.831 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2022-12-01T09:43:19.831 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAad4hjnfdPExAAWt1bccQbPZXm4NE8Oi/L6Q== 2022-12-01T09:43:19.831 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.4] 2022-12-01T09:43:19.831 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAqd4hjoNaONhAASvLfx0sa/R8RL7XIxjS0Mw== 2022-12-01T09:43:19.832 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.5] 2022-12-01T09:43:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAtd4hjNe06NBAAif/lUzg/sCGZYqUKp51gQA== 2022-12-01T09:43:19.832 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.6] 2022-12-01T09:43:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAwd4hjMTs9MxAAZ5JYSErnsdm3GKaDkBx0QA== 2022-12-01T09:43:19.833 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.7] 2022-12-01T09:43:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAzd4hjE3GYMRAA0bjrzZDMIxBaI9BxdKXkdg== 2022-12-01T09:43:19.833 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2022-12-01T09:43:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAad4hjObzpFxAAW/Gw2wTHCfpBQqH7oewRkw== 2022-12-01T09:43:19.833 INFO:teuthology.orchestra.run.smithi033.stdout:[client.2] 2022-12-01T09:43:19.834 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAad4hjJAthGxAAyNBjg2p7AAo4hLDsrxyjQg== 2022-12-01T09:43:19.834 INFO:teuthology.orchestra.run.smithi033.stdout:[client.1] 2022-12-01T09:43:19.834 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAad4hjzkbHHhAAPtef7xSpvZBqGONWwKZC4g== 2022-12-01T09:43:19.834 INFO:teuthology.orchestra.run.smithi033.stdout:[client.3] 2022-12-01T09:43:19.835 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQAad4hjMtN8JBAAqWBy7H0JHhbAXl3NbkIQSg== 2022-12-01T09:43:19.848 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.y] 2022-12-01T09:43:19.849 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAZd4hjluKZMxAARSJTYehJRelHtXCUZRnXNQ== 2022-12-01T09:43:19.849 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2022-12-01T09:43:19.849 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAZd4hjMOb0OhAAIdZtBJVijR180doidBIjgQ== 2022-12-01T09:43:19.849 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2022-12-01T09:43:19.850 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAad4hjZLvXBhAA7WX3/RuLYQrEnTwN50Gd4g== 2022-12-01T09:43:19.850 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2022-12-01T09:43:19.850 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAdd4hj3d1cLhAAxOVAAZU5bQOOXE0jrEDUjA== 2022-12-01T09:43:19.850 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2022-12-01T09:43:19.851 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAgd4hjCGmoLRAAyB3svZIpR5GUt5BsXRy+Ig== 2022-12-01T09:43:19.851 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2022-12-01T09:43:19.851 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAjd4hjHDz+KxAA5zOSSAAaTsV73pEsqnAQWQ== 2022-12-01T09:43:19.851 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2022-12-01T09:43:19.852 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAmd4hjHRu8KhAAXXv0tawz8Kf9Z2p/QUEmJA== 2022-12-01T09:43:19.852 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2022-12-01T09:43:19.852 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAZd4hjYluDNxAA8E3gNXppgTtoFDoNceErPg== 2022-12-01T09:43:19.852 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2022-12-01T09:43:19.852 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAad4hjUevfCxAAxnxXauHxRv/oEnBM0SRdoQ== 2022-12-01T09:43:19.853 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.d] 2022-12-01T09:43:19.853 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAad4hjnfdPExAAWt1bccQbPZXm4NE8Oi/L6Q== 2022-12-01T09:43:19.853 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.4] 2022-12-01T09:43:19.854 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAqd4hjoNaONhAASvLfx0sa/R8RL7XIxjS0Mw== 2022-12-01T09:43:19.854 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.5] 2022-12-01T09:43:19.854 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAtd4hjNe06NBAAif/lUzg/sCGZYqUKp51gQA== 2022-12-01T09:43:19.854 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.6] 2022-12-01T09:43:19.855 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAwd4hjMTs9MxAAZ5JYSErnsdm3GKaDkBx0QA== 2022-12-01T09:43:19.855 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.7] 2022-12-01T09:43:19.855 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAzd4hjE3GYMRAA0bjrzZDMIxBaI9BxdKXkdg== 2022-12-01T09:43:19.855 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2022-12-01T09:43:19.856 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAad4hjObzpFxAAW/Gw2wTHCfpBQqH7oewRkw== 2022-12-01T09:43:19.856 INFO:teuthology.orchestra.run.smithi156.stdout:[client.2] 2022-12-01T09:43:19.856 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAad4hjJAthGxAAyNBjg2p7AAo4hLDsrxyjQg== 2022-12-01T09:43:19.857 INFO:teuthology.orchestra.run.smithi156.stdout:[client.1] 2022-12-01T09:43:19.857 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAad4hjzkbHHhAAPtef7xSpvZBqGONWwKZC4g== 2022-12-01T09:43:19.857 INFO:teuthology.orchestra.run.smithi156.stdout:[client.3] 2022-12-01T09:43:19.858 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAad4hjMtN8JBAAqWBy7H0JHhbAXl3NbkIQSg== 2022-12-01T09:43:19.859 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-12-01T09:43:19.878 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-12-01T09:43:19.951 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:43:19.954 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:43:20.013 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:43:20.016 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:43:20.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.075 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.128 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.131 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.185 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.187 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.240 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.243 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.296 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-12-01T09:43:20.299 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-12-01T09:43:20.353 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:43:20.356 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:43:20.413 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:43:20.415 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-12-01T09:43:20.472 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.474 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.528 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.531 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.585 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.588 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.642 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.644 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-12-01T09:43:20.698 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:43:20.702 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:43:20.759 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:43:20.762 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:43:20.818 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:43:20.821 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:43:20.877 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:43:20.879 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-12-01T09:43:20.935 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-12-01T09:43:20.936 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-12-01T09:43:20.964 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-12-01T09:43:21.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-12-01T09:43:21.091 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-12-01T09:43:21.119 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-12-01T09:43:21.216 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-12-01T09:43:21.244 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-12-01T09:43:21.312 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-12-01T09:43:21.410 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-12-01T09:43:21.437 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:43:21.440 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-12-01T09:43:21.496 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-12-01T09:43:21.497 INFO:tasks.ceph.mon.a:Restarting daemon 2022-12-01T09:43:21.497 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-12-01T09:43:21.500 INFO:tasks.ceph.mon.a:Started 2022-12-01T09:43:21.500 INFO:tasks.ceph.mon.b:Restarting daemon 2022-12-01T09:43:21.501 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-12-01T09:43:21.538 INFO:tasks.ceph.mon.b:Started 2022-12-01T09:43:21.539 INFO:tasks.ceph.mon.c:Restarting daemon 2022-12-01T09:43:21.539 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-12-01T09:43:21.542 INFO:tasks.ceph.mon.c:Started 2022-12-01T09:43:21.543 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-12-01T09:43:21.543 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-12-01T09:43:21.544 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-12-01T09:43:21.547 INFO:tasks.ceph.mgr.y:Started 2022-12-01T09:43:21.547 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-12-01T09:43:21.548 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-12-01T09:43:21.551 INFO:tasks.ceph.mgr.x:Started 2022-12-01T09:43:21.551 INFO:tasks.ceph:Setting crush tunables to default 2022-12-01T09:43:21.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd crush tunables default 2022-12-01T09:43:21.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.675+0000 7fa52ca0f700 1 Processor -- start 2022-12-01T09:43:21.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.675+0000 7fa52ca0f700 1 -- start start 2022-12-01T09:43:21.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa52ca0f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:21.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa52ca0f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:21.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa52ca0f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5280cc950 con 0x7fa5280b3ae0 2022-12-01T09:43:21.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa52ca0f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5280cc6b0 con 0x7fa5280d1540 2022-12-01T09:43:21.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa52ca0f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5280ccde0 con 0x7fa52815fdc0 2022-12-01T09:43:21.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa526d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa526d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38200/0 (socket says 172.21.15.33:38200) 2022-12-01T09:43:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 learned_addr learned my addr 172.21.15.33:0/374348772 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 msgr2=0x7fa5280d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-12-01T09:43:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 msgr2=0x7fa5280d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-12-01T09:43:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 msgr2=0x7fa5280cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 msgr2=0x7fa5280cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:21.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:21.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.676+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-12-01T09:43:21.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:21.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 msgr2=0x7fa5280d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:21.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 msgr2=0x7fa5280d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:21.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:21.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-12-01T09:43:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 msgr2=0x7fa5280cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-12-01T09:43:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 msgr2=0x7fa5280cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:21.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:21.878+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-12-01T09:43:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 msgr2=0x7fa5280d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 msgr2=0x7fa5280d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-12-01T09:43:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 msgr2=0x7fa5280cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-12-01T09:43:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 msgr2=0x7fa5280cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:22.279+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-12-01T09:43:23.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:23.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 msgr2=0x7fa5280d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:23.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 msgr2=0x7fa5280d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:23.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:23.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-12-01T09:43:23.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:23.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 msgr2=0x7fa5280cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-12-01T09:43:23.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 msgr2=0x7fa5280cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:23.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:23.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:23.081+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-12-01T09:43:24.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.677+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 msgr2=0x7fa5280cfc30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-12-01T09:43:24.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.677+0000 7fa517fff700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa52815fdc0 0x7fa5280cfc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:24.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.677+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 msgr2=0x7fa5280d0170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-12-01T09:43:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.677+0000 7fa517fff700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5280d1540 0x7fa5280d0170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.677+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 >> v1:172.21.15.156:6789/0 conn(0x7fa5280b3ae0 legacy=0x7fa5280b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.677+0000 7fa517fff700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.677+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5281602c0 con 0x7fa504003740 2022-12-01T09:43:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.677+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5280cc6b0 con 0x7fa504007340 2022-12-01T09:43:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.678+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.678+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 msgr2=0x7fa5040097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.678+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 msgr2=0x7fa5040097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:24.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.678+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:24.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.678+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-12-01T09:43:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.879+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.879+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 msgr2=0x7fa5040097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:24.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.879+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 msgr2=0x7fa5040097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:24.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.879+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:24.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:24.879+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-12-01T09:43:25.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:25.280+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:25.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:25.280+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 msgr2=0x7fa5040097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:25.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:25.280+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 msgr2=0x7fa5040097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:25.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:25.280+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:25.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:25.280+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-12-01T09:43:26.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:26.081+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:26.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:26.081+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 msgr2=0x7fa5040097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:26.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:26.081+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 msgr2=0x7fa5040097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:26.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:26.081+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:26.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:26.081+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-12-01T09:43:27.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.677+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 msgr2=0x7fa5040097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-12-01T09:43:27.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.677+0000 7fa517fff700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa504007340 0x7fa5040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.677+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 >> v1:172.21.15.33:6789/0 conn(0x7fa504003740 legacy=0x7fa504005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.677+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 reap_dead start 2022-12-01T09:43:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa517fff700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa517fff700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50400afc0 con 0x7fa50400a060 2022-12-01T09:43:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5280cc6b0 con 0x7fa5040097f0 2022-12-01T09:43:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5280ccde0 con 0x7fa50400b290 2022-12-01T09:43:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 msgr2=0x7fa504006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:27.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 msgr2=0x7fa504006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:27.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:27.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-12-01T09:43:27.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:27.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 msgr2=0x7fa50400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-12-01T09:43:27.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 msgr2=0x7fa50400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:27.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:27.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.678+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-12-01T09:43:27.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:27.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 msgr2=0x7fa504006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:27.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 msgr2=0x7fa504006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:27.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:27.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-12-01T09:43:27.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:27.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 msgr2=0x7fa50400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-12-01T09:43:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 msgr2=0x7fa50400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:27.879+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-12-01T09:43:28.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:28.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 msgr2=0x7fa504006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:28.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 msgr2=0x7fa504006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:28.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:28.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-12-01T09:43:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 msgr2=0x7fa50400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-12-01T09:43:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 msgr2=0x7fa50400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:28.280+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-12-01T09:43:29.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:29.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 msgr2=0x7fa504006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:29.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa525d9b700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 msgr2=0x7fa504006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:29.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:29.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-12-01T09:43:29.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:29.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 msgr2=0x7fa50400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-12-01T09:43:29.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 msgr2=0x7fa50400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:29.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:29.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:29.081+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-12-01T09:43:30.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 msgr2=0x7fa50400d670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-12-01T09:43:30.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa517fff700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50400b290 0x7fa50400d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:30.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 msgr2=0x7fa504006ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-12-01T09:43:30.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa517fff700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.33:3300/0 conn(0x7fa5040097f0 0x7fa504006ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:30.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 >> v1:172.21.15.33:6789/0 conn(0x7fa50400a060 legacy=0x7fa50400a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:30.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa517fff700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:30.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50400ebc0 con 0x7fa504010da0 2022-12-01T09:43:30.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa517fff700 1 -- 172.21.15.33:0/374348772 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5280cc6b0 con 0x7fa50400dd60 2022-12-01T09:43:30.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:30.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa52659c700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 msgr2=0x7fa50400e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:30.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa52659c700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 msgr2=0x7fa50400e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:30.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:30.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.678+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-12-01T09:43:30.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.879+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:30.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.879+0000 7fa52659c700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 msgr2=0x7fa50400e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:30.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.879+0000 7fa52659c700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 msgr2=0x7fa50400e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:30.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.879+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:30.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:30.879+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-12-01T09:43:31.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.280+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:31.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.280+0000 7fa52659c700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 msgr2=0x7fa50400e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-12-01T09:43:31.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.280+0000 7fa52659c700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 msgr2=0x7fa50400e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-12-01T09:43:31.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.280+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-12-01T09:43:31.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.280+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-12-01T09:43:31.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437890882 0 0) 0x7fa50400ebc0 con 0x7fa504010da0 2022-12-01T09:43:31.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c0035b0 con 0x7fa504010da0 2022-12-01T09:43:31.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196442695 0 0) 0x7fa50c0035b0 con 0x7fa504010da0 2022-12-01T09:43:31.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 msgr2=0x7fa50400e160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-12-01T09:43:31.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 --2- 172.21.15.33:0/374348772 >> v2:172.21.15.156:3300/0 conn(0x7fa50400dd60 0x7fa50400e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50400ea00 con 0x7fa504010da0 2022-12-01T09:43:31.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3904297037 0 0) 0x7fa51c0167f0 con 0x7fa504010da0 2022-12-01T09:43:31.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 >> v1:172.21.15.156:6789/0 conn(0x7fa504010da0 legacy=0x7fa504013180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:31.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa526d9d700 1 -- 172.21.15.33:0/374348772 reap_dead start 2022-12-01T09:43:31.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa50c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:31.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 0x7fa50c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:31.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 0x7fa50c014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:31.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5280cc6b0 con 0x7fa50c003a00 2022-12-01T09:43:31.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0149c0 con 0x7fa50c005270 2022-12-01T09:43:31.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c014b80 con 0x7fa50c004850 2022-12-01T09:43:31.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa50c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:31.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa525d9b700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 0x7fa50c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:31.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.869+0000 7fa526d9d700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 0x7fa50c014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:31.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.870+0000 7fa52659c700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 msgr2=0x7fa50c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:31.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.870+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 0x7fa50c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.870+0000 7fa52659c700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 msgr2=0x7fa50c014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:31.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.870+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 0x7fa50c014220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.870+0000 7fa52659c700 1 -- 172.21.15.33:0/374348772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0035b0 con 0x7fa50c003a00 2022-12-01T09:43:31.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.870+0000 7fa52659c700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa50c003df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa5040072b0 tx=0x7fa50c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da9c0c570b83043 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:31.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.870+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200052d0 con 0x7fa50c003a00 2022-12-01T09:43:31.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.870+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa520005430 con 0x7fa50c003a00 2022-12-01T09:43:31.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.870+0000 7fa52559a700 1 -- 172.21.15.33:0/374348772 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200038c0 con 0x7fa50c003a00 2022-12-01T09:43:31.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.871+0000 7fa52ca0f700 1 -- 172.21.15.33:0/374348772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 msgr2=0x7fa50c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:31.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.871+0000 7fa52ca0f700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa50c003df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa5040072b0 tx=0x7fa50c005880 comp rx=0 tx=0).stop 2022-12-01T09:43:31.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.872+0000 7fa52ca0f700 1 -- 172.21.15.33:0/374348772 shutdown_connections 2022-12-01T09:43:31.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.872+0000 7fa52ca0f700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 0x7fa50c014220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.872+0000 7fa52ca0f700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 0x7fa50c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.872+0000 7fa52ca0f700 1 --2- 172.21.15.33:0/374348772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa50c003df0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.872+0000 7fa52ca0f700 1 -- 172.21.15.33:0/374348772 >> 172.21.15.33:0/374348772 conn(0x7fa5280ceae0 msgr2=0x7fa5280ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:31.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.872+0000 7fa52ca0f700 1 -- 172.21.15.33:0/374348772 shutdown_connections 2022-12-01T09:43:31.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.872+0000 7fa52ca0f700 1 -- 172.21.15.33:0/374348772 wait complete. 2022-12-01T09:43:31.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.874+0000 7fa52ca0f700 1 Processor -- start 2022-12-01T09:43:31.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.874+0000 7fa52ca0f700 1 -- start start 2022-12-01T09:43:31.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa52ca0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa528158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:31.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa52ca0f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 0x7fa528158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:31.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa52ca0f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 0x7fa5281590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:31.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa52ca0f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52806fd90 con 0x7fa50c003a00 2022-12-01T09:43:31.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa52ca0f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa528158950 con 0x7fa50c005270 2022-12-01T09:43:31.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa52ca0f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5280cb260 con 0x7fa50c004850 2022-12-01T09:43:31.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa52659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa528158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:31.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa52659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa528158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50742/0 (socket says 172.21.15.33:50742) 2022-12-01T09:43:31.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa52659c700 1 -- 172.21.15.33:0/1984965976 learned_addr learned my addr 172.21.15.33:0/1984965976 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:31.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa526d9d700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 0x7fa5281590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:31.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.875+0000 7fa525d9b700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 0x7fa528158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:31.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa526d9d700 1 -- 172.21.15.33:0/1984965976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 msgr2=0x7fa528158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:31.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa526d9d700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 0x7fa528158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa526d9d700 1 -- 172.21.15.33:0/1984965976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 msgr2=0x7fa528158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:31.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa526d9d700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa528158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa526d9d700 1 -- 172.21.15.33:0/1984965976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52806f6d0 con 0x7fa50c005270 2022-12-01T09:43:31.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa52659c700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa528158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:31.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa526d9d700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 0x7fa5281590a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5280c90c0 tx=0x7fa51801be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:31.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa516ffd700 1 -- 172.21.15.33:0/1984965976 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518019a00 con 0x7fa50c005270 2022-12-01T09:43:31.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa516ffd700 1 -- 172.21.15.33:0/1984965976 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51800f040 con 0x7fa50c005270 2022-12-01T09:43:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa52ca0f700 1 -- 172.21.15.33:0/1984965976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52806f9b0 con 0x7fa50c005270 2022-12-01T09:43:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa516ffd700 1 -- 172.21.15.33:0/1984965976 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518019de0 con 0x7fa50c005270 2022-12-01T09:43:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa52ca0f700 1 -- 172.21.15.33:0/1984965976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5280cb500 con 0x7fa50c005270 2022-12-01T09:43:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa516ffd700 1 -- 172.21.15.33:0/1984965976 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fa518024440 con 0x7fa50c005270 2022-12-01T09:43:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.876+0000 7fa516ffd700 1 -- 172.21.15.33:0/1984965976 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa5180237f0 con 0x7fa50c005270 2022-12-01T09:43:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.877+0000 7fa52ca0f700 1 -- 172.21.15.33:0/1984965976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa528067420 con 0x7fa50c005270 2022-12-01T09:43:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.880+0000 7fa516ffd700 1 -- 172.21.15.33:0/1984965976 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fa51802a060 con 0x7fa50c005270 2022-12-01T09:43:31.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.958+0000 7fa52ca0f700 1 -- 172.21.15.33:0/1984965976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa528071330 con 0x7fa50c005270 2022-12-01T09:43:31.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.961+0000 7fa516ffd700 1 -- 172.21.15.33:0/1984965976 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa518032090 con 0x7fa50c005270 2022-12-01T09:43:31.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.962+0000 7fa52ca0f700 1 -- 172.21.15.33:0/1984965976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 msgr2=0x7fa5281590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:31.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.962+0000 7fa52ca0f700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 0x7fa5281590a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5280c90c0 tx=0x7fa51801be10 comp rx=0 tx=0).stop 2022-12-01T09:43:31.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.962+0000 7fa52ca0f700 1 -- 172.21.15.33:0/1984965976 shutdown_connections 2022-12-01T09:43:31.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.962+0000 7fa52ca0f700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa50c005270 0x7fa5281590a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.962+0000 7fa52ca0f700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa50c003a00 0x7fa528158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.962+0000 7fa52ca0f700 1 --2- 172.21.15.33:0/1984965976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa50c004850 0x7fa528158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:31.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.962+0000 7fa52ca0f700 1 -- 172.21.15.33:0/1984965976 >> 172.21.15.33:0/1984965976 conn(0x7fa5280ceae0 msgr2=0x7fa52815f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:31.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.962+0000 7fa52ca0f700 1 -- 172.21.15.33:0/1984965976 shutdown_connections 2022-12-01T09:43:31.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:31.962+0000 7fa52ca0f700 1 -- 172.21.15.33:0/1984965976 wait complete. 2022-12-01T09:43:31.968 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2022-12-01T09:43:31.979 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-12-01T09:43:31.980 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:31.980 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-12-01T09:43:32.010 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:32.010 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-12-01T09:43:32.077 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:32.077 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-12-01T09:43:32.078 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:32.073+0000 7f39fe24f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-12-01T09:43:32.095 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:32.092+0000 7f4d03ae8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-12-01T09:43:32.122 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-12-01T09:43:32.122 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-12-01T09:43:32.190 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:32.190 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-12-01T09:43:32.220 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:32.220 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-12-01T09:43:32.261 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:32.257+0000 7f39fe24f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-12-01T09:43:32.282 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:32.279+0000 7f4d03ae8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-12-01T09:43:32.287 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:32.287 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-12-01T09:43:32.339 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:32.336+0000 7f39fe24f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-12-01T09:43:32.356 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2022-12-01T09:43:32.356 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-12-01T09:43:32.359 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:32.356+0000 7f4d03ae8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-12-01T09:43:32.412 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:32.409+0000 7f39fe24f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-12-01T09:43:32.424 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new b2715202-f5bd-4a04-a572-5280d5a74756 0 2022-12-01T09:43:32.429 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:32.426+0000 7f4d03ae8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-12-01T09:43:32.586 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.582+0000 7fcceb3b1700 1 Processor -- start 2022-12-01T09:43:32.586 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.582+0000 7fcceb3b1700 1 -- start start 2022-12-01T09:43:32.589 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.583+0000 7fcceb3b1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcce4158970 0x7fcce415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:32.589 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.583+0000 7fcceb3b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:32.589 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.583+0000 7fcceb3b1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce415d2c0 con 0x7fcce406aaf0 2022-12-01T09:43:32.589 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcceb3b1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce4069510 con 0x7fcce4158970 2022-12-01T09:43:32.590 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcceb3b1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40697f0 con 0x7fcce40cd3b0 2022-12-01T09:43:32.590 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce914d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcce4158970 0x7fcce415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:32.590 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce894c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:32.590 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce914d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcce4158970 0x7fcce415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43562/0 (socket says 172.21.15.156:43562) 2022-12-01T09:43:32.591 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce914d700 1 -- 172.21.15.156:0/4033612924 learned_addr learned my addr 172.21.15.156:0/4033612924 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:32.591 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce914d700 1 -- 172.21.15.156:0/4033612924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 msgr2=0x7fcce406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:32.591 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce914d700 1 --2- 172.21.15.156:0/4033612924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.591 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce914d700 1 -- 172.21.15.156:0/4033612924 >> v1:172.21.15.33:6789/0 conn(0x7fcce406aaf0 legacy=0x7fcce406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.592 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce914d700 1 -- 172.21.15.156:0/4033612924 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4069ad0 con 0x7fcce4158970 2022-12-01T09:43:32.592 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce894c700 1 --2- 172.21.15.156:0/4033612924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:32.592 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fcce914d700 1 --2- 172.21.15.156:0/4033612924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 0x7fcce415cd80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcce00098f0 tx=0x7fcce0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced4411d66b04fac server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:32.592 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fccd3fff700 1 -- 172.21.15.156:0/4033612924 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0011830 con 0x7fcce4158970 2022-12-01T09:43:32.592 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fccd3fff700 1 -- 172.21.15.156:0/4033612924 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce0011990 con 0x7fcce4158970 2022-12-01T09:43:32.593 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.584+0000 7fccd3fff700 1 -- 172.21.15.156:0/4033612924 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0011d20 con 0x7fcce4158970 2022-12-01T09:43:32.593 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.585+0000 7fcceb3b1700 1 -- 172.21.15.156:0/4033612924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 msgr2=0x7fcce415cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.593 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.585+0000 7fcceb3b1700 1 --2- 172.21.15.156:0/4033612924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 0x7fcce415cd80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcce00098f0 tx=0x7fcce0009c00 comp rx=0 tx=0).stop 2022-12-01T09:43:32.594 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.585+0000 7fcceb3b1700 1 -- 172.21.15.156:0/4033612924 shutdown_connections 2022-12-01T09:43:32.594 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.585+0000 7fcceb3b1700 1 --2- 172.21.15.156:0/4033612924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 0x7fcce415cd80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.594 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.585+0000 7fcceb3b1700 1 --2- 172.21.15.156:0/4033612924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.594 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.585+0000 7fcceb3b1700 1 -- 172.21.15.156:0/4033612924 >> 172.21.15.156:0/4033612924 conn(0x7fcce40cb7e0 msgr2=0x7fcce40cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:32.595 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.585+0000 7fcceb3b1700 1 -- 172.21.15.156:0/4033612924 shutdown_connections 2022-12-01T09:43:32.595 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.585+0000 7fcceb3b1700 1 -- 172.21.15.156:0/4033612924 wait complete. 2022-12-01T09:43:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.586+0000 7fcceb3b1700 1 Processor -- start 2022-12-01T09:43:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.586+0000 7fcceb3b1700 1 -- start start 2022-12-01T09:43:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcceb3b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce406aaf0 0x7fcce40c2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcceb3b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce41f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:32.599 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcceb3b1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 0x7fcce4143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:32.599 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcceb3b1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40c4790 con 0x7fcce406aaf0 2022-12-01T09:43:32.599 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcceb3b1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce41f1860 con 0x7fcce4158970 2022-12-01T09:43:32.599 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcceb3b1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40c4180 con 0x7fcce40cd3b0 2022-12-01T09:43:32.599 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce894c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce41f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:32.600 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce894c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce41f1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:32904/0 (socket says 172.21.15.156:32904) 2022-12-01T09:43:32.600 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce894c700 1 -- 172.21.15.156:0/1535429864 learned_addr learned my addr 172.21.15.156:0/1535429864 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:32.600 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce994e700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 0x7fcce4143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:32.601 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce914d700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce406aaf0 0x7fcce40c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:32.601 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce994e700 1 -- 172.21.15.156:0/1535429864 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 msgr2=0x7fcce41f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.601 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce994e700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce41f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.601 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce994e700 1 -- 172.21.15.156:0/1535429864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce406aaf0 msgr2=0x7fcce40c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.602 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce994e700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce406aaf0 0x7fcce40c2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.602 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce994e700 1 -- 172.21.15.156:0/1535429864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40094a0 con 0x7fcce4158970 2022-12-01T09:43:32.603 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.587+0000 7fcce894c700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce41f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:32.603 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.588+0000 7fcce994e700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 0x7fcce4143ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcce406af10 tx=0x7fccdc00ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:32.603 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.588+0000 7fccd1ffb700 1 -- 172.21.15.156:0/1535429864 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc003c00 con 0x7fcce4158970 2022-12-01T09:43:32.604 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.588+0000 7fccd1ffb700 1 -- 172.21.15.156:0/1535429864 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc003d60 con 0x7fcce4158970 2022-12-01T09:43:32.604 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.588+0000 7fccd1ffb700 1 -- 172.21.15.156:0/1535429864 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00a9c0 con 0x7fcce4158970 2022-12-01T09:43:32.604 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.588+0000 7fcceb3b1700 1 -- 172.21.15.156:0/1535429864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0009550 con 0x7fcce4158970 2022-12-01T09:43:32.604 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.588+0000 7fccd1ffb700 1 -- 172.21.15.156:0/1535429864 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fccdc010050 con 0x7fcce4158970 2022-12-01T09:43:32.605 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.588+0000 7fcceb3b1700 1 -- 172.21.15.156:0/1535429864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce4144000 con 0x7fcce4158970 2022-12-01T09:43:32.605 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.588+0000 7fccd1ffb700 1 -- 172.21.15.156:0/1535429864 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fccdc0058a0 con 0x7fcce4158970 2022-12-01T09:43:32.605 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.589+0000 7fcceb3b1700 1 -- 172.21.15.156:0/1535429864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce40c48d0 con 0x7fcce4158970 2022-12-01T09:43:32.606 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.591+0000 7fccd1ffb700 1 -- 172.21.15.156:0/1535429864 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fcce40c48d0 con 0x7fcce4158970 2022-12-01T09:43:32.677 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.673+0000 7fcceb3b1700 1 -- 172.21.15.156:0/1535429864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b2715202-f5bd-4a04-a572-5280d5a74756", "id": 0} v 0) v1 -- 0x7fcce4067420 con 0x7fcce4158970 2022-12-01T09:43:32.682 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.679+0000 7fccd1ffb700 1 -- 172.21.15.156:0/1535429864 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2715202-f5bd-4a04-a572-5280d5a74756", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fccdc005410 con 0x7fcce4158970 2022-12-01T09:43:32.682 INFO:teuthology.orchestra.run.smithi156.stdout:0 2022-12-01T09:43:32.684 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.680+0000 7fcceb3b1700 1 -- 172.21.15.156:0/1535429864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 msgr2=0x7fcce4143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.684 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.680+0000 7fcceb3b1700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 0x7fcce4143ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcce406af10 tx=0x7fccdc00ce70 comp rx=0 tx=0).stop 2022-12-01T09:43:32.684 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.680+0000 7fcceb3b1700 1 -- 172.21.15.156:0/1535429864 shutdown_connections 2022-12-01T09:43:32.685 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.680+0000 7fcceb3b1700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce4158970 0x7fcce4143ac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.685 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.680+0000 7fcceb3b1700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce406aaf0 0x7fcce40c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.685 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.680+0000 7fcceb3b1700 1 --2- 172.21.15.156:0/1535429864 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcce40cd3b0 0x7fcce41f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.685 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.680+0000 7fcceb3b1700 1 -- 172.21.15.156:0/1535429864 >> 172.21.15.156:0/1535429864 conn(0x7fcce40cb7e0 msgr2=0x7fcce406fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:32.686 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.680+0000 7fcceb3b1700 1 -- 172.21.15.156:0/1535429864 shutdown_connections 2022-12-01T09:43:32.686 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.680+0000 7fcceb3b1700 1 -- 172.21.15.156:0/1535429864 wait complete. 2022-12-01T09:43:32.695 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 8969a66c-e3bf-444c-a7fc-1d988d9592cc 1 2022-12-01T09:43:32.854 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.849+0000 7f63925bb700 1 Processor -- start 2022-12-01T09:43:32.855 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.850+0000 7f63925bb700 1 -- start start 2022-12-01T09:43:32.855 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.850+0000 7f63925bb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f638c0cd2b0 0x7f638c0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:32.855 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.850+0000 7f63925bb700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c15f820 con 0x7f638c0ad990 2022-12-01T09:43:32.856 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.850+0000 7f63925bb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c0cdc30 con 0x7f638c0ce420 2022-12-01T09:43:32.856 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.850+0000 7f63925bb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0add60 con 0x7f638c0cd2b0 2022-12-01T09:43:32.856 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.850+0000 7f638b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f638c0ce420 0x7f638c15fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38626/0 (socket says 172.21.15.156:38626) 2022-12-01T09:43:32.856 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.850+0000 7f638b7fe700 1 -- 172.21.15.156:0/3394569594 learned_addr learned my addr 172.21.15.156:0/3394569594 (peer_addr_for_me v1:172.21.15.156:0/0) 2022-12-01T09:43:32.857 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.850+0000 7f6390b58700 1 --2- 172.21.15.156:0/3394569594 >> v2:172.21.15.156:3300/0 conn(0x7f638c0cd2b0 0x7f638c0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:32.857 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.851+0000 7f638affd700 1 -- 172.21.15.156:0/3394569594 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717265264 0 0) 0x7f638c0cdc30 con 0x7f638c0ce420 2022-12-01T09:43:32.857 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.851+0000 7f638affd700 1 -- 172.21.15.156:0/3394569594 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63780035b0 con 0x7f638c0ce420 2022-12-01T09:43:32.857 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.851+0000 7f6390b58700 1 -- 172.21.15.156:0/3394569594 >> v1:172.21.15.156:6789/0 conn(0x7f638c0ce420 legacy=0x7f638c15fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.858 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.851+0000 7f6390b58700 1 -- 172.21.15.156:0/3394569594 >> v1:172.21.15.33:6789/0 conn(0x7f638c0ad990 legacy=0x7f638c15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.858 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.851+0000 7f6390b58700 1 -- 172.21.15.156:0/3394569594 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c15f4d0 con 0x7f638c0cd2b0 2022-12-01T09:43:32.858 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.851+0000 7f6390b58700 1 --2- 172.21.15.156:0/3394569594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0cd2b0 0x7f638c0cd6f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6384009dc0 tx=0x7f638400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf7c3525e931248 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:32.858 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.851+0000 7f638affd700 1 -- 172.21.15.156:0/3394569594 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400e070 con 0x7f638c0cd2b0 2022-12-01T09:43:32.859 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.851+0000 7f638affd700 1 -- 172.21.15.156:0/3394569594 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638400bae0 con 0x7f638c0cd2b0 2022-12-01T09:43:32.859 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.851+0000 7f638affd700 1 -- 172.21.15.156:0/3394569594 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400be90 con 0x7f638c0cd2b0 2022-12-01T09:43:32.863 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.852+0000 7f63925bb700 1 -- 172.21.15.156:0/3394569594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0cd2b0 msgr2=0x7f638c0cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.863 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.852+0000 7f63925bb700 1 --2- 172.21.15.156:0/3394569594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0cd2b0 0x7f638c0cd6f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6384009dc0 tx=0x7f638400b330 comp rx=0 tx=0).stop 2022-12-01T09:43:32.863 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.852+0000 7f63925bb700 1 -- 172.21.15.156:0/3394569594 shutdown_connections 2022-12-01T09:43:32.864 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.852+0000 7f63925bb700 1 --2- 172.21.15.156:0/3394569594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0cd2b0 0x7f638c0cd6f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.864 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.852+0000 7f63925bb700 1 -- 172.21.15.156:0/3394569594 >> 172.21.15.156:0/3394569594 conn(0x7f638c070a30 msgr2=0x7f638c070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:32.864 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.852+0000 7f63925bb700 1 -- 172.21.15.156:0/3394569594 shutdown_connections 2022-12-01T09:43:32.864 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.852+0000 7f63925bb700 1 -- 172.21.15.156:0/3394569594 wait complete. 2022-12-01T09:43:32.865 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.853+0000 7f63925bb700 1 Processor -- start 2022-12-01T09:43:32.865 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.853+0000 7f63925bb700 1 -- start start 2022-12-01T09:43:32.865 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f63925bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f638c0ad990 0x7f638c1f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:32.865 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f63925bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f638c0cd2b0 0x7f638c15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:32.865 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f63925bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0ce420 0x7f638c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:32.866 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f63925bb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c157fb0 con 0x7f638c0cd2b0 2022-12-01T09:43:32.866 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f63925bb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c159280 con 0x7f638c0ce420 2022-12-01T09:43:32.866 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f63925bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1581e0 con 0x7f638c0ad990 2022-12-01T09:43:32.866 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f638bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f638c0ad990 0x7f638c1f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:32.867 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f6390b58700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0ce420 0x7f638c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:32.867 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f6390b58700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0ce420 0x7f638c157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43594/0 (socket says 172.21.15.156:43594) 2022-12-01T09:43:32.867 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f638bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f638c0ad990 0x7f638c1f40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:32910/0 (socket says 172.21.15.156:32910) 2022-12-01T09:43:32.867 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f6390b58700 1 -- 172.21.15.156:0/2645227225 learned_addr learned my addr 172.21.15.156:0/2645227225 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:32.868 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f638b7fe700 1 --2- 172.21.15.156:0/2645227225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f638c0cd2b0 0x7f638c15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:32.868 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f6390b58700 1 -- 172.21.15.156:0/2645227225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f638c0ad990 msgr2=0x7f638c1f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.868 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f6390b58700 1 --2- 172.21.15.156:0/2645227225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f638c0ad990 0x7f638c1f40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.868 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f6390b58700 1 -- 172.21.15.156:0/2645227225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f638c0cd2b0 msgr2=0x7f638c15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.868 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f6390b58700 1 --2- 172.21.15.156:0/2645227225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f638c0cd2b0 0x7f638c15b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.869 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.854+0000 7f6390b58700 1 -- 172.21.15.156:0/2645227225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6384009a70 con 0x7f638c0ce420 2022-12-01T09:43:32.869 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.855+0000 7f6390b58700 1 --2- 172.21.15.156:0/2645227225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0ce420 0x7f638c157a70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f638c073100 tx=0x7f6384004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:32.869 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.855+0000 7f6388ff9700 1 -- 172.21.15.156:0/2645227225 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384004550 con 0x7f638c0ce420 2022-12-01T09:43:32.869 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.855+0000 7f6388ff9700 1 -- 172.21.15.156:0/2645227225 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384020070 con 0x7f638c0ce420 2022-12-01T09:43:32.870 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.855+0000 7f6388ff9700 1 -- 172.21.15.156:0/2645227225 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384004930 con 0x7f638c0ce420 2022-12-01T09:43:32.870 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.855+0000 7f63925bb700 1 -- 172.21.15.156:0/2645227225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c1584c0 con 0x7f638c0ce420 2022-12-01T09:43:32.870 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.855+0000 7f63925bb700 1 -- 172.21.15.156:0/2645227225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c158a80 con 0x7f638c0ce420 2022-12-01T09:43:32.870 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.855+0000 7f6388ff9700 1 -- 172.21.15.156:0/2645227225 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f638402e070 con 0x7f638c0ce420 2022-12-01T09:43:32.870 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.855+0000 7f6388ff9700 1 -- 172.21.15.156:0/2645227225 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f6384022070 con 0x7f638c0ce420 2022-12-01T09:43:32.871 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.856+0000 7f63925bb700 1 -- 172.21.15.156:0/2645227225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c067420 con 0x7f638c0ce420 2022-12-01T09:43:32.871 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.858+0000 7f6388ff9700 1 -- 172.21.15.156:0/2645227225 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f638402c060 con 0x7f638c0ce420 2022-12-01T09:43:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.941+0000 7f63925bb700 1 -- 172.21.15.156:0/2645227225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8969a66c-e3bf-444c-a7fc-1d988d9592cc", "id": 1} v 0) v1 -- 0x7f638c1603c0 con 0x7f638c0ce420 2022-12-01T09:43:32.950 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.947+0000 7f6388ff9700 1 -- 172.21.15.156:0/2645227225 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8969a66c-e3bf-444c-a7fc-1d988d9592cc", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6384027a40 con 0x7f638c0ce420 2022-12-01T09:43:32.950 INFO:teuthology.orchestra.run.smithi156.stdout:1 2022-12-01T09:43:32.952 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.948+0000 7f63925bb700 1 -- 172.21.15.156:0/2645227225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0ce420 msgr2=0x7f638c157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:32.952 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.948+0000 7f63925bb700 1 --2- 172.21.15.156:0/2645227225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0ce420 0x7f638c157a70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f638c073100 tx=0x7f6384004ad0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.952 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.948+0000 7f63925bb700 1 -- 172.21.15.156:0/2645227225 shutdown_connections 2022-12-01T09:43:32.953 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.948+0000 7f63925bb700 1 --2- 172.21.15.156:0/2645227225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f638c0ce420 0x7f638c157a70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.953 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.948+0000 7f63925bb700 1 --2- 172.21.15.156:0/2645227225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f638c0ad990 0x7f638c1f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.953 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.948+0000 7f63925bb700 1 --2- 172.21.15.156:0/2645227225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f638c0cd2b0 0x7f638c15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:32.953 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.948+0000 7f63925bb700 1 -- 172.21.15.156:0/2645227225 >> 172.21.15.156:0/2645227225 conn(0x7f638c070a30 msgr2=0x7f638c06b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:32.954 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.948+0000 7f63925bb700 1 -- 172.21.15.156:0/2645227225 shutdown_connections 2022-12-01T09:43:32.954 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:32.948+0000 7f63925bb700 1 -- 172.21.15.156:0/2645227225 wait complete. 2022-12-01T09:43:32.964 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 803fa135-9f54-4f34-bd0e-bc230b4dcbd1 2 2022-12-01T09:43:32.992 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:32.989+0000 7f39fe24f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-12-01T09:43:33.035 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:33.032+0000 7f4d03ae8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-12-01T09:43:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.082+0000 7fecb267d700 1 Processor -- start 2022-12-01T09:43:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.082+0000 7fecb267d700 1 -- start start 2022-12-01T09:43:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.083+0000 7fecb267d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fecac0b5640 0x7fecac0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.093 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.083+0000 7fecb267d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fecac15d340 0x7fecac0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.093 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.083+0000 7fecb267d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecac0cf5e0 con 0x7fecac0cf180 2022-12-01T09:43:33.093 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.083+0000 7fecb267d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecac0b5a10 con 0x7fecac0b5640 2022-12-01T09:43:33.093 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.083+0000 7fecb267d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecac159c30 con 0x7fecac15d340 2022-12-01T09:43:33.094 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.083+0000 7fecab7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fecac15d340 0x7fecac0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.094 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.083+0000 7fecb0c1a700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fecac0cf180 0x7fecac0cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38630/0 (socket says 172.21.15.156:38630) 2022-12-01T09:43:33.094 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.083+0000 7fecb0c1a700 1 -- 172.21.15.156:0/122964304 learned_addr learned my addr 172.21.15.156:0/122964304 (peer_addr_for_me v1:172.21.15.156:0/0) 2022-12-01T09:43:33.094 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.083+0000 7fecabfff700 1 --2- 172.21.15.156:0/122964304 >> v2:172.21.15.33:3300/0 conn(0x7fecac0b5640 0x7fecac0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.094 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.084+0000 7fecab7fe700 1 -- 172.21.15.156:0/122964304 >> v2:172.21.15.33:3300/0 conn(0x7fecac0b5640 msgr2=0x7fecac0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:33.095 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.084+0000 7fecab7fe700 1 --2- 172.21.15.156:0/122964304 >> v2:172.21.15.33:3300/0 conn(0x7fecac0b5640 0x7fecac0b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.095 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.084+0000 7fecab7fe700 1 -- 172.21.15.156:0/122964304 >> v1:172.21.15.156:6789/0 conn(0x7fecac0cf180 legacy=0x7fecac0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.095 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.084+0000 7fecab7fe700 1 -- 172.21.15.156:0/122964304 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac06eef0 con 0x7fecac15d340 2022-12-01T09:43:33.095 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.084+0000 7fecaaffd700 1 -- 172.21.15.156:0/122964304 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857822035 0 0) 0x7fecac0cf5e0 con 0x7fecac0cf180 2022-12-01T09:43:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.084+0000 7fecab7fe700 1 --2- 172.21.15.156:0/122964304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 0x7fecac0cec40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fecac06e0d0 tx=0x7feca0009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f1bdcf140216b0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.084+0000 7fecaaffd700 1 -- 172.21.15.156:0/122964304 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011830 con 0x7fecac15d340 2022-12-01T09:43:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.084+0000 7fecaaffd700 1 -- 172.21.15.156:0/122964304 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca0011990 con 0x7fecac15d340 2022-12-01T09:43:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.084+0000 7fecaaffd700 1 -- 172.21.15.156:0/122964304 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011d20 con 0x7fecac15d340 2022-12-01T09:43:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.085+0000 7fecb267d700 1 -- 172.21.15.156:0/122964304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 msgr2=0x7fecac0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.085+0000 7fecb267d700 1 --2- 172.21.15.156:0/122964304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 0x7fecac0cec40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fecac06e0d0 tx=0x7feca0009b20 comp rx=0 tx=0).stop 2022-12-01T09:43:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.085+0000 7fecb267d700 1 -- 172.21.15.156:0/122964304 shutdown_connections 2022-12-01T09:43:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.085+0000 7fecb267d700 1 --2- 172.21.15.156:0/122964304 >> v2:172.21.15.33:3300/0 conn(0x7fecac0b5640 0x7fecac0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.085+0000 7fecb267d700 1 --2- 172.21.15.156:0/122964304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 0x7fecac0cec40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.085+0000 7fecb267d700 1 -- 172.21.15.156:0/122964304 >> 172.21.15.156:0/122964304 conn(0x7fecac06cfe0 msgr2=0x7fecac06d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.085+0000 7fecb267d700 1 -- 172.21.15.156:0/122964304 shutdown_connections 2022-12-01T09:43:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.085+0000 7fecb267d700 1 -- 172.21.15.156:0/122964304 wait complete. 2022-12-01T09:43:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.086+0000 7fecb267d700 1 Processor -- start 2022-12-01T09:43:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.086+0000 7fecb267d700 1 -- start start 2022-12-01T09:43:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb267d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecac0b5640 0x7fecac15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb267d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecac0cf180 0x7fecac15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb267d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 0x7fecac069390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb267d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac15c570 con 0x7fecac0cf180 2022-12-01T09:43:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb267d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac15b960 con 0x7fecac15d340 2022-12-01T09:43:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb267d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac15bc40 con 0x7fecac0b5640 2022-12-01T09:43:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecabfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecac0b5640 0x7fecac15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecabfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecac0b5640 0x7fecac15ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:32922/0 (socket says 172.21.15.156:32922) 2022-12-01T09:43:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb0c1a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 0x7fecac069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecabfff700 1 -- 172.21.15.156:0/20665056 learned_addr learned my addr 172.21.15.156:0/20665056 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecab7fe700 1 --2- 172.21.15.156:0/20665056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecac0cf180 0x7fecac15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb0c1a700 1 -- 172.21.15.156:0/20665056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecac0b5640 msgr2=0x7fecac15ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb0c1a700 1 --2- 172.21.15.156:0/20665056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecac0b5640 0x7fecac15ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.102 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb0c1a700 1 -- 172.21.15.156:0/20665056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecac0cf180 msgr2=0x7fecac15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.102 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb0c1a700 1 --2- 172.21.15.156:0/20665056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecac0cf180 0x7fecac15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.102 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb0c1a700 1 -- 172.21.15.156:0/20665056 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00094a0 con 0x7fecac15d340 2022-12-01T09:43:33.102 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecabfff700 1 --2- 172.21.15.156:0/20665056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecac0b5640 0x7fecac15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:33.103 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7fecb0c1a700 1 --2- 172.21.15.156:0/20665056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 0x7fecac069390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feca400cbe0 tx=0x7feca400cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:33.103 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.087+0000 7feca8ff9700 1 -- 172.21.15.156:0/20665056 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400aa40 con 0x7fecac15d340 2022-12-01T09:43:33.103 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.088+0000 7feca8ff9700 1 -- 172.21.15.156:0/20665056 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca400abc0 con 0x7fecac15d340 2022-12-01T09:43:33.103 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.088+0000 7fecb267d700 1 -- 172.21.15.156:0/20665056 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac15bf20 con 0x7fecac15d340 2022-12-01T09:43:33.103 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.088+0000 7feca8ff9700 1 -- 172.21.15.156:0/20665056 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40070d0 con 0x7fecac15d340 2022-12-01T09:43:33.104 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.088+0000 7fecb267d700 1 -- 172.21.15.156:0/20665056 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecac0b0b20 con 0x7fecac15d340 2022-12-01T09:43:33.104 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.088+0000 7feca8ff9700 1 -- 172.21.15.156:0/20665056 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7feca401a030 con 0x7fecac15d340 2022-12-01T09:43:33.104 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.088+0000 7feca8ff9700 1 -- 172.21.15.156:0/20665056 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7feca401c7d0 con 0x7fecac15d340 2022-12-01T09:43:33.104 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.089+0000 7fecb267d700 1 -- 172.21.15.156:0/20665056 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecac15c6e0 con 0x7fecac15d340 2022-12-01T09:43:33.105 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.091+0000 7feca8ff9700 1 -- 172.21.15.156:0/20665056 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7feca4018070 con 0x7fecac15d340 2022-12-01T09:43:33.108 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:33.105+0000 7f39fe24f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-12-01T09:43:33.149 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:33.146+0000 7f4d03ae8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-12-01T09:43:33.178 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.174+0000 7fecb267d700 1 -- 172.21.15.156:0/20665056 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "803fa135-9f54-4f34-bd0e-bc230b4dcbd1", "id": 2} v 0) v1 -- 0x7fecac067420 con 0x7fecac15d340 2022-12-01T09:43:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.182+0000 7feca8ff9700 1 -- 172.21.15.156:0/20665056 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "803fa135-9f54-4f34-bd0e-bc230b4dcbd1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7feca401c520 con 0x7fecac15d340 2022-12-01T09:43:33.186 INFO:teuthology.orchestra.run.smithi156.stdout:2 2022-12-01T09:43:33.188 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.183+0000 7fecb267d700 1 -- 172.21.15.156:0/20665056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 msgr2=0x7fecac069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.189 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.183+0000 7fecb267d700 1 --2- 172.21.15.156:0/20665056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 0x7fecac069390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feca400cbe0 tx=0x7feca400cef0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.189 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.183+0000 7fecb267d700 1 -- 172.21.15.156:0/20665056 shutdown_connections 2022-12-01T09:43:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.183+0000 7fecb267d700 1 --2- 172.21.15.156:0/20665056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecac15d340 0x7fecac069390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.183+0000 7fecb267d700 1 --2- 172.21.15.156:0/20665056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecac0b5640 0x7fecac15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.183+0000 7fecb267d700 1 --2- 172.21.15.156:0/20665056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecac0cf180 0x7fecac15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.183+0000 7fecb267d700 1 -- 172.21.15.156:0/20665056 >> 172.21.15.156:0/20665056 conn(0x7fecac06cfe0 msgr2=0x7fecac0b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:33.192 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:33.183+0000 7f39fe24f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-12-01T09:43:33.193 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.183+0000 7fecb267d700 1 -- 172.21.15.156:0/20665056 shutdown_connections 2022-12-01T09:43:33.193 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.183+0000 7fecb267d700 1 -- 172.21.15.156:0/20665056 wait complete. 2022-12-01T09:43:33.199 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 6dbfab54-3de3-4ffc-b3bb-ad03bd4be8a6 3 2022-12-01T09:43:33.227 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:33.224+0000 7f4d03ae8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-12-01T09:43:33.322 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:33.319+0000 7f39fe24f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-12-01T09:43:33.360 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:33.357+0000 7f4d03ae8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-12-01T09:43:33.369 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.357+0000 7fc9d6867700 1 Processor -- start 2022-12-01T09:43:33.370 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.358+0000 7fc9d6867700 1 -- start start 2022-12-01T09:43:33.370 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.358+0000 7fc9d6867700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9d00cd350 0x7fc9d00cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.370 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.358+0000 7fc9d6867700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00cdc60 con 0x7fc9d015c100 2022-12-01T09:43:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.358+0000 7fc9d6867700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00c9e00 con 0x7fc9d00c44f0 2022-12-01T09:43:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.358+0000 7fc9d6867700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00ca0e0 con 0x7fc9d00cd350 2022-12-01T09:43:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.358+0000 7fc9cffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9d00cd350 0x7fc9d00cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.358+0000 7fc9cf7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc9d00c44f0 0x7fc9d00caea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38632/0 (socket says 172.21.15.156:38632) 2022-12-01T09:43:33.372 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.359+0000 7fc9cf7fe700 1 -- 172.21.15.156:0/2635880525 learned_addr learned my addr 172.21.15.156:0/2635880525 (peer_addr_for_me v1:172.21.15.156:0/0) 2022-12-01T09:43:33.372 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.359+0000 7fc9cffff700 1 -- 172.21.15.156:0/2635880525 >> v1:172.21.15.156:6789/0 conn(0x7fc9d00c44f0 legacy=0x7fc9d00caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.372 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.359+0000 7fc9cffff700 1 -- 172.21.15.156:0/2635880525 >> v1:172.21.15.33:6789/0 conn(0x7fc9d015c100 legacy=0x7fc9d0069390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.372 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.359+0000 7fc9cffff700 1 -- 172.21.15.156:0/2635880525 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00ca3c0 con 0x7fc9d00cd350 2022-12-01T09:43:33.373 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.359+0000 7fc9cffff700 1 --2- 172.21.15.156:0/2635880525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 0x7fc9d00cd720 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009870 tx=0x7fc9c0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e960a2f9e958cbca server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:33.373 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.359+0000 7fc9ceffd700 1 -- 172.21.15.156:0/2635880525 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0011830 con 0x7fc9d00cd350 2022-12-01T09:43:33.373 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.359+0000 7fc9ceffd700 1 -- 172.21.15.156:0/2635880525 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0011990 con 0x7fc9d00cd350 2022-12-01T09:43:33.373 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.359+0000 7fc9ceffd700 1 -- 172.21.15.156:0/2635880525 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0011d20 con 0x7fc9d00cd350 2022-12-01T09:43:33.374 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.360+0000 7fc9d6867700 1 -- 172.21.15.156:0/2635880525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 msgr2=0x7fc9d00cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.374 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.360+0000 7fc9d6867700 1 --2- 172.21.15.156:0/2635880525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 0x7fc9d00cd720 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009870 tx=0x7fc9c0009b80 comp rx=0 tx=0).stop 2022-12-01T09:43:33.374 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.360+0000 7fc9d6867700 1 -- 172.21.15.156:0/2635880525 shutdown_connections 2022-12-01T09:43:33.374 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.360+0000 7fc9d6867700 1 --2- 172.21.15.156:0/2635880525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 0x7fc9d00cd720 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.375 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.360+0000 7fc9d6867700 1 -- 172.21.15.156:0/2635880525 >> 172.21.15.156:0/2635880525 conn(0x7fc9d00cb7f0 msgr2=0x7fc9d00cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:33.375 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.360+0000 7fc9d6867700 1 -- 172.21.15.156:0/2635880525 shutdown_connections 2022-12-01T09:43:33.375 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.360+0000 7fc9d6867700 1 -- 172.21.15.156:0/2635880525 wait complete. 2022-12-01T09:43:33.375 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.361+0000 7fc9d6867700 1 Processor -- start 2022-12-01T09:43:33.376 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.361+0000 7fc9d6867700 1 -- start start 2022-12-01T09:43:33.376 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d6867700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d00c44f0 0x7fc9d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.376 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d6867700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 0x7fc9d015af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.376 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d6867700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d015c100 0x7fc9d0140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.377 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d6867700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00c5e40 con 0x7fc9d00c44f0 2022-12-01T09:43:33.377 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d6867700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0159570 con 0x7fc9d00cd350 2022-12-01T09:43:33.377 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d6867700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00c6090 con 0x7fc9d015c100 2022-12-01T09:43:33.377 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9cf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 0x7fc9d015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.377 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d4e04700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d015c100 0x7fc9d0140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.378 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9cf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 0x7fc9d015af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43610/0 (socket says 172.21.15.156:43610) 2022-12-01T09:43:33.378 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9cf7fe700 1 -- 172.21.15.156:0/629157895 learned_addr learned my addr 172.21.15.156:0/629157895 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:33.378 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9cffff700 1 --2- 172.21.15.156:0/629157895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d00c44f0 0x7fc9d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.378 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d4e04700 1 -- 172.21.15.156:0/629157895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 msgr2=0x7fc9d015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.379 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d4e04700 1 --2- 172.21.15.156:0/629157895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 0x7fc9d015af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.379 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d4e04700 1 -- 172.21.15.156:0/629157895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d00c44f0 msgr2=0x7fc9d006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.379 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d4e04700 1 --2- 172.21.15.156:0/629157895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d00c44f0 0x7fc9d006d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.379 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d4e04700 1 -- 172.21.15.156:0/629157895 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00094a0 con 0x7fc9d015c100 2022-12-01T09:43:33.380 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9cf7fe700 1 --2- 172.21.15.156:0/629157895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 0x7fc9d015af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:33.380 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.362+0000 7fc9d4e04700 1 --2- 172.21.15.156:0/629157895 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d015c100 0x7fc9d0140280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800cb90 tx=0x7fc9c800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:33.380 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.363+0000 7fc9ccff9700 1 -- 172.21.15.156:0/629157895 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8003c00 con 0x7fc9d015c100 2022-12-01T09:43:33.380 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.363+0000 7fc9ccff9700 1 -- 172.21.15.156:0/629157895 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c8003d60 con 0x7fc9d015c100 2022-12-01T09:43:33.381 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.363+0000 7fc9d6867700 1 -- 172.21.15.156:0/629157895 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d00c6370 con 0x7fc9d015c100 2022-12-01T09:43:33.381 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.363+0000 7fc9ccff9700 1 -- 172.21.15.156:0/629157895 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800aa80 con 0x7fc9d015c100 2022-12-01T09:43:33.381 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.363+0000 7fc9d6867700 1 -- 172.21.15.156:0/629157895 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d014bb10 con 0x7fc9d015c100 2022-12-01T09:43:33.381 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.364+0000 7fc9ccff9700 1 -- 172.21.15.156:0/629157895 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc9c8010050 con 0x7fc9d015c100 2022-12-01T09:43:33.382 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.364+0000 7fc9d6867700 1 -- 172.21.15.156:0/629157895 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0067420 con 0x7fc9d015c100 2022-12-01T09:43:33.382 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.364+0000 7fc9ccff9700 1 -- 172.21.15.156:0/629157895 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fc9c8012420 con 0x7fc9d015c100 2022-12-01T09:43:33.382 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.367+0000 7fc9ccff9700 1 -- 172.21.15.156:0/629157895 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fc9c80050d0 con 0x7fc9d015c100 2022-12-01T09:43:33.425 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:33.422+0000 7f39fe24f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-12-01T09:43:33.454 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.451+0000 7fc9d6867700 1 -- 172.21.15.156:0/629157895 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6dbfab54-3de3-4ffc-b3bb-ad03bd4be8a6", "id": 3} v 0) v1 -- 0x7fc9d00ca6a0 con 0x7fc9d015c100 2022-12-01T09:43:33.460 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:33.458+0000 7f4d03ae8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-12-01T09:43:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.458+0000 7fc9ccff9700 1 -- 172.21.15.156:0/629157895 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6dbfab54-3de3-4ffc-b3bb-ad03bd4be8a6", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9c8005350 con 0x7fc9d015c100 2022-12-01T09:43:33.462 INFO:teuthology.orchestra.run.smithi156.stdout:3 2022-12-01T09:43:33.463 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.459+0000 7fc9d6867700 1 -- 172.21.15.156:0/629157895 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d015c100 msgr2=0x7fc9d0140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.463 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.459+0000 7fc9d6867700 1 --2- 172.21.15.156:0/629157895 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d015c100 0x7fc9d0140280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800cb90 tx=0x7fc9c800cea0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.464 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.459+0000 7fc9d6867700 1 -- 172.21.15.156:0/629157895 shutdown_connections 2022-12-01T09:43:33.464 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.459+0000 7fc9d6867700 1 --2- 172.21.15.156:0/629157895 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d015c100 0x7fc9d0140280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.464 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.459+0000 7fc9d6867700 1 --2- 172.21.15.156:0/629157895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d00c44f0 0x7fc9d006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.464 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.459+0000 7fc9d6867700 1 --2- 172.21.15.156:0/629157895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00cd350 0x7fc9d015af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.464 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.459+0000 7fc9d6867700 1 -- 172.21.15.156:0/629157895 >> 172.21.15.156:0/629157895 conn(0x7fc9d00cb7f0 msgr2=0x7fc9d006a120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:33.465 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.459+0000 7fc9d6867700 1 -- 172.21.15.156:0/629157895 shutdown_connections 2022-12-01T09:43:33.465 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.459+0000 7fc9d6867700 1 -- 172.21.15.156:0/629157895 wait complete. 2022-12-01T09:43:33.474 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 019cf437-f88c-4be4-bf75-546695321962 4 2022-12-01T09:43:33.495 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:33.492+0000 7f39fe24f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-12-01T09:43:33.529 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:33.526+0000 7f4d03ae8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-12-01T09:43:33.598 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.594+0000 7f6222c1d700 1 Processor -- start 2022-12-01T09:43:33.598 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.594+0000 7f6222c1d700 1 -- start start 2022-12-01T09:43:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.595+0000 7f6222c1d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f621c06d000 0x7f621c0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.595+0000 7f6222c1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c0cbc90 0x7f621c0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.602 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.595+0000 7f6222c1d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621c0cc630 con 0x7f621c0aef30 2022-12-01T09:43:33.602 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.595+0000 7f6222c1d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621c0b28b0 con 0x7f621c06d000 2022-12-01T09:43:33.602 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.595+0000 7f6222c1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c06d480 con 0x7f621c0cbc90 2022-12-01T09:43:33.602 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.595+0000 7f62211ba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c0cbc90 0x7f621c0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.603 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.595+0000 7f62209b9700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f621c0aef30 0x7f621c160150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38634/0 (socket says 172.21.15.156:38634) 2022-12-01T09:43:33.603 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.595+0000 7f62209b9700 1 -- 172.21.15.156:0/799034550 learned_addr learned my addr 172.21.15.156:0/799034550 (peer_addr_for_me v1:172.21.15.156:0/0) 2022-12-01T09:43:33.603 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.595+0000 7f621bfff700 1 --2- 172.21.15.156:0/799034550 >> v2:172.21.15.33:3300/0 conn(0x7f621c06d000 0x7f621c0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.603 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f621b7fe700 1 -- 172.21.15.156:0/799034550 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64514128 0 0) 0x7f621c0cc630 con 0x7f621c0aef30 2022-12-01T09:43:33.604 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f621b7fe700 1 -- 172.21.15.156:0/799034550 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62000035b0 con 0x7f621c0aef30 2022-12-01T09:43:33.604 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f62211ba700 1 -- 172.21.15.156:0/799034550 >> v2:172.21.15.33:3300/0 conn(0x7f621c06d000 msgr2=0x7f621c0b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:33.604 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f62211ba700 1 --2- 172.21.15.156:0/799034550 >> v2:172.21.15.33:3300/0 conn(0x7f621c06d000 0x7f621c0b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.604 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f62211ba700 1 -- 172.21.15.156:0/799034550 >> v1:172.21.15.156:6789/0 conn(0x7f621c0aef30 legacy=0x7f621c160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.604 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f62211ba700 1 -- 172.21.15.156:0/799034550 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c15f970 con 0x7f621c0cbc90 2022-12-01T09:43:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f62211ba700 1 --2- 172.21.15.156:0/799034550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c0cbc90 0x7f621c0cc0f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6214009d90 tx=0x7f621400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ffa044b2e79495f server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f621b7fe700 1 -- 172.21.15.156:0/799034550 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400e070 con 0x7f621c0cbc90 2022-12-01T09:43:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f621b7fe700 1 -- 172.21.15.156:0/799034550 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621400bb20 con 0x7f621c0cbc90 2022-12-01T09:43:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.596+0000 7f621b7fe700 1 -- 172.21.15.156:0/799034550 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214012430 con 0x7f621c0cbc90 2022-12-01T09:43:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.597+0000 7f6222c1d700 1 -- 172.21.15.156:0/799034550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c0cbc90 msgr2=0x7f621c0cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.597+0000 7f6222c1d700 1 --2- 172.21.15.156:0/799034550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c0cbc90 0x7f621c0cc0f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6214009d90 tx=0x7f621400b330 comp rx=0 tx=0).stop 2022-12-01T09:43:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.597+0000 7f6222c1d700 1 -- 172.21.15.156:0/799034550 shutdown_connections 2022-12-01T09:43:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.597+0000 7f6222c1d700 1 --2- 172.21.15.156:0/799034550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c0cbc90 0x7f621c0cc0f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.597+0000 7f6222c1d700 1 --2- 172.21.15.156:0/799034550 >> v2:172.21.15.33:3300/0 conn(0x7f621c06d000 0x7f621c0b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.597+0000 7f6222c1d700 1 -- 172.21.15.156:0/799034550 >> 172.21.15.156:0/799034550 conn(0x7f621c0cff30 msgr2=0x7f621c0d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.597+0000 7f6222c1d700 1 -- 172.21.15.156:0/799034550 shutdown_connections 2022-12-01T09:43:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.597+0000 7f6222c1d700 1 -- 172.21.15.156:0/799034550 wait complete. 2022-12-01T09:43:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.598+0000 7f6222c1d700 1 Processor -- start 2022-12-01T09:43:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.598+0000 7f6222c1d700 1 -- start start 2022-12-01T09:43:33.610 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f6222c1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c06d000 0x7f621c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.611 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f6222c1d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621c0aef30 0x7f621c0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.611 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f6222c1d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c0cbc90 0x7f621c1f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.611 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f6222c1d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0ae030 con 0x7f621c0cbc90 2022-12-01T09:43:33.612 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f6222c1d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0ae310 con 0x7f621c0aef30 2022-12-01T09:43:33.612 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f6222c1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0ae5f0 con 0x7f621c06d000 2022-12-01T09:43:33.612 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f62209b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c06d000 0x7f621c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.613 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f621bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621c0aef30 0x7f621c0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.613 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f62209b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c06d000 0x7f621c0ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:32948/0 (socket says 172.21.15.156:32948) 2022-12-01T09:43:33.613 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f621bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621c0aef30 0x7f621c0ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43618/0 (socket says 172.21.15.156:43618) 2022-12-01T09:43:33.613 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f62209b9700 1 -- 172.21.15.156:0/1712114606 learned_addr learned my addr 172.21.15.156:0/1712114606 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:33.614 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.599+0000 7f62211ba700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c0cbc90 0x7f621c1f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.614 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f621bfff700 1 -- 172.21.15.156:0/1712114606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c06d000 msgr2=0x7f621c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.614 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f621bfff700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c06d000 0x7f621c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.614 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f621bfff700 1 -- 172.21.15.156:0/1712114606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c0cbc90 msgr2=0x7f621c1f45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.615 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f621bfff700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c0cbc90 0x7f621c1f45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.615 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f621bfff700 1 -- 172.21.15.156:0/1712114606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214009a70 con 0x7f621c0aef30 2022-12-01T09:43:33.615 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f62209b9700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c06d000 0x7f621c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:33.615 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f62211ba700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c0cbc90 0x7f621c1f45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:33.616 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f621bfff700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621c0aef30 0x7f621c0ab8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f620800e870 tx=0x7f620800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:33.616 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f62197fa700 1 -- 172.21.15.156:0/1712114606 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208013680 con 0x7f621c0aef30 2022-12-01T09:43:33.616 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f62197fa700 1 -- 172.21.15.156:0/1712114606 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62080137e0 con 0x7f621c0aef30 2022-12-01T09:43:33.616 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f6222c1d700 1 -- 172.21.15.156:0/1712114606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c0ae8d0 con 0x7f621c0aef30 2022-12-01T09:43:33.616 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f62197fa700 1 -- 172.21.15.156:0/1712114606 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208013b90 con 0x7f621c0aef30 2022-12-01T09:43:33.617 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f6222c1d700 1 -- 172.21.15.156:0/1712114606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c0abfd0 con 0x7f621c0aef30 2022-12-01T09:43:33.617 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f62197fa700 1 -- 172.21.15.156:0/1712114606 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f6208019030 con 0x7f621c0aef30 2022-12-01T09:43:33.617 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.600+0000 7f62197fa700 1 -- 172.21.15.156:0/1712114606 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f6208006660 con 0x7f621c0aef30 2022-12-01T09:43:33.617 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.601+0000 7f6222c1d700 1 -- 172.21.15.156:0/1712114606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c06dea0 con 0x7f621c0aef30 2022-12-01T09:43:33.618 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.603+0000 7f62197fa700 1 -- 172.21.15.156:0/1712114606 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f6208021060 con 0x7f621c0aef30 2022-12-01T09:43:33.692 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.686+0000 7f6222c1d700 1 -- 172.21.15.156:0/1712114606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "019cf437-f88c-4be4-bf75-546695321962", "id": 4} v 0) v1 -- 0x7f621c067420 con 0x7f621c0aef30 2022-12-01T09:43:33.694 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.691+0000 7f62197fa700 1 -- 172.21.15.156:0/1712114606 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "019cf437-f88c-4be4-bf75-546695321962", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6208017070 con 0x7f621c0aef30 2022-12-01T09:43:33.695 INFO:teuthology.orchestra.run.smithi156.stdout:4 2022-12-01T09:43:33.696 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.692+0000 7f6222c1d700 1 -- 172.21.15.156:0/1712114606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621c0aef30 msgr2=0x7f621c0ab8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.696 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.692+0000 7f6222c1d700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621c0aef30 0x7f621c0ab8b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f620800e870 tx=0x7f620800eb80 comp rx=0 tx=0).stop 2022-12-01T09:43:33.697 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.692+0000 7f6222c1d700 1 -- 172.21.15.156:0/1712114606 shutdown_connections 2022-12-01T09:43:33.697 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.692+0000 7f6222c1d700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c0cbc90 0x7f621c1f45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.697 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.692+0000 7f6222c1d700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f621c06d000 0x7f621c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.697 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.692+0000 7f6222c1d700 1 --2- 172.21.15.156:0/1712114606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621c0aef30 0x7f621c0ab8b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.697 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.692+0000 7f6222c1d700 1 -- 172.21.15.156:0/1712114606 >> 172.21.15.156:0/1712114606 conn(0x7f621c0cff30 msgr2=0x7f621c0b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:33.698 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.692+0000 7f6222c1d700 1 -- 172.21.15.156:0/1712114606 shutdown_connections 2022-12-01T09:43:33.698 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.692+0000 7f6222c1d700 1 -- 172.21.15.156:0/1712114606 wait complete. 2022-12-01T09:43:33.707 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new cb41dbe1-2d9a-40f8-a237-ebd3dcc342e5 5 2022-12-01T09:43:33.868 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.865+0000 7fc9deaee700 1 Processor -- start 2022-12-01T09:43:33.869 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.865+0000 7fc9deaee700 1 -- start start 2022-12-01T09:43:33.878 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9deaee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9deaee700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9d80cc940 0x7fc9d8071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9deaee700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d80ce2a0 con 0x7fc9d806e680 2022-12-01T09:43:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9deaee700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d80ae810 con 0x7fc9d80cc940 2022-12-01T09:43:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9deaee700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80c5740 con 0x7fc9d815b9d0 2022-12-01T09:43:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9dc88a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9d7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9d80cc940 0x7fc9d8071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9dc88a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:32956/0 (socket says 172.21.15.156:32956) 2022-12-01T09:43:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9d7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9d80cc940 0x7fc9d8071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43630/0 (socket says 172.21.15.156:43630) 2022-12-01T09:43:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9dc88a700 1 -- 172.21.15.156:0/4267188259 learned_addr learned my addr 172.21.15.156:0/4267188259 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9dc88a700 1 -- 172.21.15.156:0/4267188259 >> v2:172.21.15.156:3300/0 conn(0x7fc9d80cc940 msgr2=0x7fc9d8071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9dc88a700 1 --2- 172.21.15.156:0/4267188259 >> v2:172.21.15.156:3300/0 conn(0x7fc9d80cc940 0x7fc9d8071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9dc88a700 1 -- 172.21.15.156:0/4267188259 >> v1:172.21.15.33:6789/0 conn(0x7fc9d806e680 legacy=0x7fc9d806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9dc88a700 1 -- 172.21.15.156:0/4267188259 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80c5c70 con 0x7fc9d815b9d0 2022-12-01T09:43:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9d7fff700 1 --2- 172.21.15.156:0/4267188259 >> v2:172.21.15.156:3300/0 conn(0x7fc9d80cc940 0x7fc9d8071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9dc88a700 1 --2- 172.21.15.156:0/4267188259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80c4b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0098f0 tx=0x7fc9cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20498ca8f83d869f server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9d77fe700 1 -- 172.21.15.156:0/4267188259 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc011830 con 0x7fc9d815b9d0 2022-12-01T09:43:33.883 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9d77fe700 1 -- 172.21.15.156:0/4267188259 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc011990 con 0x7fc9d815b9d0 2022-12-01T09:43:33.883 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.866+0000 7fc9d77fe700 1 -- 172.21.15.156:0/4267188259 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc011d20 con 0x7fc9d815b9d0 2022-12-01T09:43:33.883 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.867+0000 7fc9deaee700 1 -- 172.21.15.156:0/4267188259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 msgr2=0x7fc9d80c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.883 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.867+0000 7fc9deaee700 1 --2- 172.21.15.156:0/4267188259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80c4b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0098f0 tx=0x7fc9cc009c00 comp rx=0 tx=0).stop 2022-12-01T09:43:33.883 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.867+0000 7fc9deaee700 1 -- 172.21.15.156:0/4267188259 shutdown_connections 2022-12-01T09:43:33.884 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.867+0000 7fc9deaee700 1 --2- 172.21.15.156:0/4267188259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80c4b40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.884 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.867+0000 7fc9deaee700 1 --2- 172.21.15.156:0/4267188259 >> v2:172.21.15.156:3300/0 conn(0x7fc9d80cc940 0x7fc9d8071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.884 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.867+0000 7fc9deaee700 1 -- 172.21.15.156:0/4267188259 >> 172.21.15.156:0/4267188259 conn(0x7fc9d80cb7f0 msgr2=0x7fc9d80cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:33.884 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.867+0000 7fc9deaee700 1 -- 172.21.15.156:0/4267188259 shutdown_connections 2022-12-01T09:43:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.867+0000 7fc9deaee700 1 -- 172.21.15.156:0/4267188259 wait complete. 2022-12-01T09:43:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.868+0000 7fc9deaee700 1 Processor -- start 2022-12-01T09:43:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.868+0000 7fc9deaee700 1 -- start start 2022-12-01T09:43:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9deaee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d806e680 0x7fc9d814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9deaee700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d80cc940 0x7fc9d80b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9deaee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9deaee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d81e0ab0 con 0x7fc9d806e680 2022-12-01T09:43:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9deaee700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8150230 con 0x7fc9d80cc940 2022-12-01T09:43:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9deaee700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8150510 con 0x7fc9d815b9d0 2022-12-01T09:43:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d80cc940 0x7fc9d80b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9dd08b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d80cc940 0x7fc9d80b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43640/0 (socket says 172.21.15.156:43640) 2022-12-01T09:43:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9d7fff700 1 -- 172.21.15.156:0/566324339 learned_addr learned my addr 172.21.15.156:0/566324339 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9dc88a700 1 --2- 172.21.15.156:0/566324339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d806e680 0x7fc9d814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9dd08b700 1 -- 172.21.15.156:0/566324339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d80cc940 msgr2=0x7fc9d80b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9dd08b700 1 --2- 172.21.15.156:0/566324339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d80cc940 0x7fc9d80b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9dd08b700 1 -- 172.21.15.156:0/566324339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d806e680 msgr2=0x7fc9d814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.889 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9dd08b700 1 --2- 172.21.15.156:0/566324339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d806e680 0x7fc9d814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.889 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9dd08b700 1 -- 172.21.15.156:0/566324339 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40094a0 con 0x7fc9d815b9d0 2022-12-01T09:43:33.889 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.869+0000 7fc9d7fff700 1 --2- 172.21.15.156:0/566324339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d80cc940 0x7fc9d80b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:33.889 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.870+0000 7fc9dd08b700 1 --2- 172.21.15.156:0/566324339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80b2b30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000cb90 tx=0x7fc9d000cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:33.890 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.870+0000 7fc9d57fa700 1 -- 172.21.15.156:0/566324339 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0003c00 con 0x7fc9d815b9d0 2022-12-01T09:43:33.890 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.870+0000 7fc9d57fa700 1 -- 172.21.15.156:0/566324339 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d0003d60 con 0x7fc9d815b9d0 2022-12-01T09:43:33.890 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.870+0000 7fc9deaee700 1 -- 172.21.15.156:0/566324339 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc009550 con 0x7fc9d815b9d0 2022-12-01T09:43:33.890 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.870+0000 7fc9d57fa700 1 -- 172.21.15.156:0/566324339 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000aa80 con 0x7fc9d815b9d0 2022-12-01T09:43:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.870+0000 7fc9deaee700 1 -- 172.21.15.156:0/566324339 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d81e0fe0 con 0x7fc9d815b9d0 2022-12-01T09:43:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.870+0000 7fc9d57fa700 1 -- 172.21.15.156:0/566324339 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc9d0010050 con 0x7fc9d815b9d0 2022-12-01T09:43:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.870+0000 7fc9d57fa700 1 -- 172.21.15.156:0/566324339 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fc9d00058a0 con 0x7fc9d815b9d0 2022-12-01T09:43:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.871+0000 7fc9deaee700 1 -- 172.21.15.156:0/566324339 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d80c45e0 con 0x7fc9d815b9d0 2022-12-01T09:43:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.873+0000 7fc9d57fa700 1 -- 172.21.15.156:0/566324339 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fc9d0012420 con 0x7fc9d815b9d0 2022-12-01T09:43:33.916 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:33.913+0000 7f39fe24f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-12-01T09:43:33.927 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:33.924+0000 7f4d03ae8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-12-01T09:43:33.959 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.956+0000 7fc9deaee700 1 -- 172.21.15.156:0/566324339 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cb41dbe1-2d9a-40f8-a237-ebd3dcc342e5", "id": 5} v 0) v1 -- 0x7fc9d8067420 con 0x7fc9d815b9d0 2022-12-01T09:43:33.964 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.961+0000 7fc9d57fa700 1 -- 172.21.15.156:0/566324339 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb41dbe1-2d9a-40f8-a237-ebd3dcc342e5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9d00125c0 con 0x7fc9d815b9d0 2022-12-01T09:43:33.965 INFO:teuthology.orchestra.run.smithi156.stdout:5 2022-12-01T09:43:33.966 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.962+0000 7fc9deaee700 1 -- 172.21.15.156:0/566324339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 msgr2=0x7fc9d80b2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:33.966 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.962+0000 7fc9deaee700 1 --2- 172.21.15.156:0/566324339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80b2b30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000cb90 tx=0x7fc9d000cea0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.967 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.963+0000 7fc9deaee700 1 -- 172.21.15.156:0/566324339 shutdown_connections 2022-12-01T09:43:33.967 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.963+0000 7fc9deaee700 1 --2- 172.21.15.156:0/566324339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9d815b9d0 0x7fc9d80b2b30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.967 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.963+0000 7fc9deaee700 1 --2- 172.21.15.156:0/566324339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9d806e680 0x7fc9d814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.967 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.963+0000 7fc9deaee700 1 --2- 172.21.15.156:0/566324339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d80cc940 0x7fc9d80b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:33.968 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.963+0000 7fc9deaee700 1 -- 172.21.15.156:0/566324339 >> 172.21.15.156:0/566324339 conn(0x7fc9d80cb7f0 msgr2=0x7fc9d80c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:33.968 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.963+0000 7fc9deaee700 1 -- 172.21.15.156:0/566324339 shutdown_connections 2022-12-01T09:43:33.968 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:33.963+0000 7fc9deaee700 1 -- 172.21.15.156:0/566324339 wait complete. 2022-12-01T09:43:33.978 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 01fd4370-1453-4fb1-b80d-61ec5a062028 6 2022-12-01T09:43:34.060 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:34.056+0000 7f39fe24f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-12-01T09:43:34.067 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:34.064+0000 7f4d03ae8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-12-01T09:43:34.099 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.096+0000 7f9860701700 1 Processor -- start 2022-12-01T09:43:34.100 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.096+0000 7f9860701700 1 -- start start 2022-12-01T09:43:34.104 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f9860701700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9858158970 0x7f985815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.105 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f9860701700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f985806bf90 0x7f985806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.105 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f9860701700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985806c910 con 0x7f98580cd3b0 2022-12-01T09:43:34.105 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f9860701700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985815d2c0 con 0x7f9858158970 2022-12-01T09:43:34.106 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f9860701700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9858069510 con 0x7f985806bf90 2022-12-01T09:43:34.106 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f985dc9c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f98580cd3b0 0x7f985806a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38650/0 (socket says 172.21.15.156:38650) 2022-12-01T09:43:34.106 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f985ec9e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f985806bf90 0x7f985806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.106 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f985dc9c700 1 -- 172.21.15.156:0/3857541468 learned_addr learned my addr 172.21.15.156:0/3857541468 (peer_addr_for_me v1:172.21.15.156:0/0) 2022-12-01T09:43:34.106 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f985e49d700 1 --2- 172.21.15.156:0/3857541468 >> v2:172.21.15.33:3300/0 conn(0x7f9858158970 0x7f985815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.107 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.097+0000 7f985d49b700 1 -- 172.21.15.156:0/3857541468 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325038075 0 0) 0x7f985806c910 con 0x7f98580cd3b0 2022-12-01T09:43:34.107 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f985d49b700 1 -- 172.21.15.156:0/3857541468 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98400035b0 con 0x7f98580cd3b0 2022-12-01T09:43:34.107 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f985ec9e700 1 -- 172.21.15.156:0/3857541468 >> v2:172.21.15.33:3300/0 conn(0x7f9858158970 msgr2=0x7f985815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:34.108 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f985ec9e700 1 --2- 172.21.15.156:0/3857541468 >> v2:172.21.15.33:3300/0 conn(0x7f9858158970 0x7f985815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.108 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f985ec9e700 1 -- 172.21.15.156:0/3857541468 >> v1:172.21.15.156:6789/0 conn(0x7f98580cd3b0 legacy=0x7f985806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.108 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f985ec9e700 1 -- 172.21.15.156:0/3857541468 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580697f0 con 0x7f985806bf90 2022-12-01T09:43:34.108 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f985ec9e700 1 --2- 172.21.15.156:0/3857541468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f985806bf90 0x7f985806c3d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f985000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f23588d168862ff server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:34.109 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f985d49b700 1 -- 172.21.15.156:0/3857541468 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985000e070 con 0x7f985806bf90 2022-12-01T09:43:34.109 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f985d49b700 1 -- 172.21.15.156:0/3857541468 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985000bb20 con 0x7f985806bf90 2022-12-01T09:43:34.109 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f985d49b700 1 -- 172.21.15.156:0/3857541468 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850012430 con 0x7f985806bf90 2022-12-01T09:43:34.109 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f9860701700 1 -- 172.21.15.156:0/3857541468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f985806bf90 msgr2=0x7f985806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.110 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.098+0000 7f9860701700 1 --2- 172.21.15.156:0/3857541468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f985806bf90 0x7f985806c3d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f985000b330 comp rx=0 tx=0).stop 2022-12-01T09:43:34.110 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.099+0000 7f9860701700 1 -- 172.21.15.156:0/3857541468 shutdown_connections 2022-12-01T09:43:34.110 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.099+0000 7f9860701700 1 --2- 172.21.15.156:0/3857541468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f985806bf90 0x7f985806c3d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.110 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.099+0000 7f9860701700 1 --2- 172.21.15.156:0/3857541468 >> v2:172.21.15.33:3300/0 conn(0x7f9858158970 0x7f985815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.111 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.099+0000 7f9860701700 1 -- 172.21.15.156:0/3857541468 >> 172.21.15.156:0/3857541468 conn(0x7f98580cb7e0 msgr2=0x7f98580cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:34.111 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.099+0000 7f9860701700 1 -- 172.21.15.156:0/3857541468 shutdown_connections 2022-12-01T09:43:34.111 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.099+0000 7f9860701700 1 -- 172.21.15.156:0/3857541468 wait complete. 2022-12-01T09:43:34.112 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.100+0000 7f9860701700 1 Processor -- start 2022-12-01T09:43:34.112 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.100+0000 7f9860701700 1 -- start start 2022-12-01T09:43:34.116 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9860701700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f985806bf90 0x7f9858151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.116 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9860701700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98580cd3b0 0x7f98580c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.116 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9860701700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9858158970 0x7f9858146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.117 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9860701700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580c77f0 con 0x7f985806bf90 2022-12-01T09:43:34.117 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9860701700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580c7ad0 con 0x7f9858158970 2022-12-01T09:43:34.117 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9860701700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98580c7db0 con 0x7f98580cd3b0 2022-12-01T09:43:34.118 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985dc9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98580cd3b0 0x7f98580c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.118 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985ec9e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9858158970 0x7f9858146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.118 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985dc9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98580cd3b0 0x7f98580c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:32966/0 (socket says 172.21.15.156:32966) 2022-12-01T09:43:34.119 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985dc9c700 1 -- 172.21.15.156:0/3740009401 learned_addr learned my addr 172.21.15.156:0/3740009401 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:34.119 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985e49d700 1 --2- 172.21.15.156:0/3740009401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f985806bf90 0x7f9858151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.119 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985dc9c700 1 -- 172.21.15.156:0/3740009401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9858158970 msgr2=0x7f9858146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.119 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985dc9c700 1 --2- 172.21.15.156:0/3740009401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9858158970 0x7f9858146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.120 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985dc9c700 1 -- 172.21.15.156:0/3740009401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f985806bf90 msgr2=0x7f9858151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.120 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985dc9c700 1 --2- 172.21.15.156:0/3740009401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f985806bf90 0x7f9858151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.120 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985dc9c700 1 -- 172.21.15.156:0/3740009401 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850009a70 con 0x7f98580cd3b0 2022-12-01T09:43:34.120 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985ec9e700 1 --2- 172.21.15.156:0/3740009401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9858158970 0x7f9858146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:34.121 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f985dc9c700 1 --2- 172.21.15.156:0/3740009401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98580cd3b0 0x7f98580c6e80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9848005910 tx=0x7f984800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:34.121 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9846ffd700 1 -- 172.21.15.156:0/3740009401 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848005d70 con 0x7f98580cd3b0 2022-12-01T09:43:34.121 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9846ffd700 1 -- 172.21.15.156:0/3740009401 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98480070d0 con 0x7f98580cd3b0 2022-12-01T09:43:34.121 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9860701700 1 -- 172.21.15.156:0/3740009401 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98580c8090 con 0x7f98580cd3b0 2022-12-01T09:43:34.121 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.102+0000 7f9846ffd700 1 -- 172.21.15.156:0/3740009401 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848007460 con 0x7f98580cd3b0 2022-12-01T09:43:34.122 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.103+0000 7f9860701700 1 -- 172.21.15.156:0/3740009401 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98581524d0 con 0x7f98580cd3b0 2022-12-01T09:43:34.122 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.103+0000 7f9846ffd700 1 -- 172.21.15.156:0/3740009401 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9848019030 con 0x7f98580cd3b0 2022-12-01T09:43:34.122 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.103+0000 7f9846ffd700 1 -- 172.21.15.156:0/3740009401 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f984801b9a0 con 0x7f98580cd3b0 2022-12-01T09:43:34.122 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.103+0000 7f9860701700 1 -- 172.21.15.156:0/3740009401 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98580c85b0 con 0x7f98580cd3b0 2022-12-01T09:43:34.123 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.105+0000 7f9846ffd700 1 -- 172.21.15.156:0/3740009401 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f98580c85b0 con 0x7f98580cd3b0 2022-12-01T09:43:34.135 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:34.132+0000 7f39fe24f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-12-01T09:43:34.140 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:34.138+0000 7f4d03ae8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-12-01T09:43:34.192 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.188+0000 7f9860701700 1 -- 172.21.15.156:0/3740009401 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "01fd4370-1453-4fb1-b80d-61ec5a062028", "id": 6} v 0) v1 -- 0x7f9858152660 con 0x7f98580cd3b0 2022-12-01T09:43:34.199 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.196+0000 7f9846ffd700 1 -- 172.21.15.156:0/3740009401 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01fd4370-1453-4fb1-b80d-61ec5a062028", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9848017070 con 0x7f98580cd3b0 2022-12-01T09:43:34.200 INFO:teuthology.orchestra.run.smithi156.stdout:6 2022-12-01T09:43:34.201 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.197+0000 7f9860701700 1 -- 172.21.15.156:0/3740009401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98580cd3b0 msgr2=0x7f98580c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.202 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.197+0000 7f9860701700 1 --2- 172.21.15.156:0/3740009401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98580cd3b0 0x7f98580c6e80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9848005910 tx=0x7f984800c9e0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.202 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.197+0000 7f9860701700 1 -- 172.21.15.156:0/3740009401 shutdown_connections 2022-12-01T09:43:34.203 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.197+0000 7f9860701700 1 --2- 172.21.15.156:0/3740009401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9858158970 0x7f9858146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.203 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.197+0000 7f9860701700 1 --2- 172.21.15.156:0/3740009401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f985806bf90 0x7f9858151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.203 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.197+0000 7f9860701700 1 --2- 172.21.15.156:0/3740009401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98580cd3b0 0x7f98580c6e80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.203 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.197+0000 7f9860701700 1 -- 172.21.15.156:0/3740009401 >> 172.21.15.156:0/3740009401 conn(0x7f98580cb7e0 msgr2=0x7f98580af460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:34.204 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.197+0000 7f9860701700 1 -- 172.21.15.156:0/3740009401 shutdown_connections 2022-12-01T09:43:34.204 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.197+0000 7f9860701700 1 -- 172.21.15.156:0/3740009401 wait complete. 2022-12-01T09:43:34.213 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 411c921b-7fb3-4963-a7f7-0a1346273113 7 2022-12-01T09:43:34.310 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:34.306+0000 7f39fe24f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-12-01T09:43:34.310 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:34.308+0000 7f4d03ae8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-12-01T09:43:34.336 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.333+0000 7fb81567a700 1 Processor -- start 2022-12-01T09:43:34.336 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.333+0000 7fb81567a700 1 -- start start 2022-12-01T09:43:34.339 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.333+0000 7fb81567a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb81015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.339 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.333+0000 7fb81567a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb8101601f0 0x7fb8100cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.339 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.333+0000 7fb81567a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81015f820 con 0x7fb8100ad990 2022-12-01T09:43:34.339 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.333+0000 7fb81567a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8100add60 con 0x7fb8101601f0 2022-12-01T09:43:34.340 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.333+0000 7fb81567a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81015f4d0 con 0x7fb8100ce420 2022-12-01T09:43:34.340 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb81015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.340 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb81015fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:32968/0 (socket says 172.21.15.156:32968) 2022-12-01T09:43:34.340 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80e7fc700 1 -- 172.21.15.156:0/3581389833 learned_addr learned my addr 172.21.15.156:0/3581389833 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:34.341 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80f7fe700 1 --2- 172.21.15.156:0/3581389833 >> v2:172.21.15.33:3300/0 conn(0x7fb8101601f0 0x7fb8100cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.341 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80e7fc700 1 -- 172.21.15.156:0/3581389833 >> v2:172.21.15.33:3300/0 conn(0x7fb8101601f0 msgr2=0x7fb8100cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:34.341 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80e7fc700 1 --2- 172.21.15.156:0/3581389833 >> v2:172.21.15.33:3300/0 conn(0x7fb8101601f0 0x7fb8100cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.341 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80e7fc700 1 -- 172.21.15.156:0/3581389833 >> v1:172.21.15.33:6789/0 conn(0x7fb8100ad990 legacy=0x7fb81015be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.341 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80e7fc700 1 -- 172.21.15.156:0/3581389833 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81015c730 con 0x7fb8100ce420 2022-12-01T09:43:34.342 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80e7fc700 1 --2- 172.21.15.156:0/3581389833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb81015fcb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb8040098f0 tx=0x7fb804009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3ae46529e5f50d8 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:34.342 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80dffb700 1 -- 172.21.15.156:0/3581389833 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804011830 con 0x7fb8100ce420 2022-12-01T09:43:34.342 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80dffb700 1 -- 172.21.15.156:0/3581389833 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb804011990 con 0x7fb8100ce420 2022-12-01T09:43:34.342 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.334+0000 7fb80dffb700 1 -- 172.21.15.156:0/3581389833 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804011d20 con 0x7fb8100ce420 2022-12-01T09:43:34.343 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.335+0000 7fb81567a700 1 -- 172.21.15.156:0/3581389833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 msgr2=0x7fb81015fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.343 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.335+0000 7fb81567a700 1 --2- 172.21.15.156:0/3581389833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb81015fcb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb8040098f0 tx=0x7fb804009c00 comp rx=0 tx=0).stop 2022-12-01T09:43:34.343 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.335+0000 7fb81567a700 1 -- 172.21.15.156:0/3581389833 shutdown_connections 2022-12-01T09:43:34.343 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.335+0000 7fb81567a700 1 --2- 172.21.15.156:0/3581389833 >> v2:172.21.15.33:3300/0 conn(0x7fb8101601f0 0x7fb8100cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.343 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.335+0000 7fb81567a700 1 --2- 172.21.15.156:0/3581389833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb81015fcb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.344 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.335+0000 7fb81567a700 1 -- 172.21.15.156:0/3581389833 >> 172.21.15.156:0/3581389833 conn(0x7fb810070a30 msgr2=0x7fb810070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:34.344 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.335+0000 7fb81567a700 1 -- 172.21.15.156:0/3581389833 shutdown_connections 2022-12-01T09:43:34.344 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.335+0000 7fb81567a700 1 -- 172.21.15.156:0/3581389833 wait complete. 2022-12-01T09:43:34.347 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.337+0000 7fb81567a700 1 Processor -- start 2022-12-01T09:43:34.347 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.337+0000 7fb81567a700 1 -- start start 2022-12-01T09:43:34.347 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb81567a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8100ad990 0x7fb81006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.347 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb81567a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb8100cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.348 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb81567a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8101601f0 0x7fb8100c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.348 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb81567a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100cb930 con 0x7fb8100ad990 2022-12-01T09:43:34.348 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb81567a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100c7ff0 con 0x7fb8101601f0 2022-12-01T09:43:34.348 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb81567a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100c82d0 con 0x7fb8100ce420 2022-12-01T09:43:34.349 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb8100cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.349 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb8100cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:32982/0 (socket says 172.21.15.156:32982) 2022-12-01T09:43:34.349 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80e7fc700 1 -- 172.21.15.156:0/196509217 learned_addr learned my addr 172.21.15.156:0/196509217 (peer_addr_for_me v2:172.21.15.156:0/0) 2022-12-01T09:43:34.349 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80f7fe700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8101601f0 0x7fb8100c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.349 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80effd700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8100ad990 0x7fb81006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.350 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80f7fe700 1 -- 172.21.15.156:0/196509217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 msgr2=0x7fb8100cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.350 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80f7fe700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb8100cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.350 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80f7fe700 1 -- 172.21.15.156:0/196509217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8100ad990 msgr2=0x7fb81006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.350 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80f7fe700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8100ad990 0x7fb81006bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.351 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80f7fe700 1 -- 172.21.15.156:0/196509217 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804009550 con 0x7fb8101601f0 2022-12-01T09:43:34.351 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80e7fc700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb8100cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:34.351 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80effd700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8100ad990 0x7fb81006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:34.351 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb80f7fe700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8101601f0 0x7fb8100c7710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb81006d3b0 tx=0x7fb80800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:34.351 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb7f77fe700 1 -- 172.21.15.156:0/196509217 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800c940 con 0x7fb8101601f0 2022-12-01T09:43:34.352 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb7f77fe700 1 -- 172.21.15.156:0/196509217 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80800f040 con 0x7fb8101601f0 2022-12-01T09:43:34.352 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb7f77fe700 1 -- 172.21.15.156:0/196509217 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800cce0 con 0x7fb8101601f0 2022-12-01T09:43:34.352 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb81567a700 1 -- 172.21.15.156:0/196509217 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81014c2f0 con 0x7fb8101601f0 2022-12-01T09:43:34.352 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.338+0000 7fb81567a700 1 -- 172.21.15.156:0/196509217 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8100b12f0 con 0x7fb8101601f0 2022-12-01T09:43:34.352 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.339+0000 7fb7f77fe700 1 -- 172.21.15.156:0/196509217 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb808014480 con 0x7fb8101601f0 2022-12-01T09:43:34.353 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.339+0000 7fb7f77fe700 1 -- 172.21.15.156:0/196509217 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fb80801db00 con 0x7fb8101601f0 2022-12-01T09:43:34.353 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.340+0000 7fb81567a700 1 -- 172.21.15.156:0/196509217 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb810067420 con 0x7fb8101601f0 2022-12-01T09:43:34.353 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.342+0000 7fb7f77fe700 1 -- 172.21.15.156:0/196509217 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fb80803b6e0 con 0x7fb8101601f0 2022-12-01T09:43:34.440 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.437+0000 7fb81567a700 1 -- 172.21.15.156:0/196509217 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "411c921b-7fb3-4963-a7f7-0a1346273113", "id": 7} v 0) v1 -- 0x7fb81015ca10 con 0x7fb8101601f0 2022-12-01T09:43:34.448 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.444+0000 7fb7f77fe700 1 -- 172.21.15.156:0/196509217 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "411c921b-7fb3-4963-a7f7-0a1346273113", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb80802a070 con 0x7fb8101601f0 2022-12-01T09:43:34.449 INFO:teuthology.orchestra.run.smithi156.stdout:7 2022-12-01T09:43:34.450 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.445+0000 7fb81567a700 1 -- 172.21.15.156:0/196509217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8101601f0 msgr2=0x7fb8100c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.450 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.445+0000 7fb81567a700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8101601f0 0x7fb8100c7710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb81006d3b0 tx=0x7fb80800ee50 comp rx=0 tx=0).stop 2022-12-01T09:43:34.451 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.445+0000 7fb81567a700 1 -- 172.21.15.156:0/196509217 shutdown_connections 2022-12-01T09:43:34.451 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.445+0000 7fb81567a700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8101601f0 0x7fb8100c7710 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.451 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.445+0000 7fb81567a700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8100ad990 0x7fb81006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.452 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.445+0000 7fb81567a700 1 --2- 172.21.15.156:0/196509217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8100ce420 0x7fb8100cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.452 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.445+0000 7fb81567a700 1 -- 172.21.15.156:0/196509217 >> 172.21.15.156:0/196509217 conn(0x7fb810070a30 msgr2=0x7fb81006cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:34.452 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.445+0000 7fb81567a700 1 -- 172.21.15.156:0/196509217 shutdown_connections 2022-12-01T09:43:34.452 INFO:teuthology.orchestra.run.smithi156.stderr:2022-12-01T09:43:34.445+0000 7fb81567a700 1 -- 172.21.15.156:0/196509217 wait complete. 2022-12-01T09:43:34.458 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:34.456+0000 7f4d03ae8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-12-01T09:43:34.465 INFO:tasks.ceph.osd.0:Restarting daemon 2022-12-01T09:43:34.465 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-12-01T09:43:34.470 INFO:tasks.ceph.osd.0:Started 2022-12-01T09:43:34.470 INFO:tasks.ceph.osd.1:Restarting daemon 2022-12-01T09:43:34.471 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-12-01T09:43:34.473 INFO:tasks.ceph.osd.1:Started 2022-12-01T09:43:34.473 INFO:tasks.ceph.osd.2:Restarting daemon 2022-12-01T09:43:34.474 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-12-01T09:43:34.475 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:34.471+0000 7f39fe24f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-12-01T09:43:34.476 INFO:tasks.ceph.osd.2:Started 2022-12-01T09:43:34.477 INFO:tasks.ceph.osd.3:Restarting daemon 2022-12-01T09:43:34.477 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-12-01T09:43:34.479 INFO:tasks.ceph.osd.3:Started 2022-12-01T09:43:34.480 INFO:tasks.ceph.osd.4:Restarting daemon 2022-12-01T09:43:34.480 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-12-01T09:43:34.482 INFO:tasks.ceph.osd.4:Started 2022-12-01T09:43:34.483 INFO:tasks.ceph.osd.5:Restarting daemon 2022-12-01T09:43:34.483 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-12-01T09:43:34.486 INFO:tasks.ceph.osd.5:Started 2022-12-01T09:43:34.486 INFO:tasks.ceph.osd.6:Restarting daemon 2022-12-01T09:43:34.487 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-12-01T09:43:34.491 INFO:tasks.ceph.osd.6:Started 2022-12-01T09:43:34.491 INFO:tasks.ceph.osd.7:Restarting daemon 2022-12-01T09:43:34.492 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-12-01T09:43:34.495 INFO:tasks.ceph.osd.7:Started 2022-12-01T09:43:34.496 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-12-01T09:43:34.644 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:34.641+0000 7f4d03ae8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-12-01T09:43:34.650 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:34.647+0000 7f39fe24f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-12-01T09:43:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.647+0000 7f7c53578700 1 Processor -- start 2022-12-01T09:43:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.648+0000 7f7c53578700 1 -- start start 2022-12-01T09:43:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.648+0000 7f7c53578700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c4c159710 0x7f7c4c0b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.648+0000 7f7c53578700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 0x7f7c4c06d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.648+0000 7f7c53578700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4c0cc7a0 con 0x7f7c4c06d540 2022-12-01T09:43:34.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.648+0000 7f7c53578700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c06d9c0 con 0x7f7c4c159710 2022-12-01T09:43:34.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.648+0000 7f7c53578700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b5930 con 0x7f7c4c0b5b60 2022-12-01T09:43:34.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c51b15700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7c4c06d540 0x7f7c4c0b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57434/0 (socket says 172.21.15.33:57434) 2022-12-01T09:43:34.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c51b15700 1 -- 172.21.15.33:0/1121568029 learned_addr learned my addr 172.21.15.33:0/1121568029 (peer_addr_for_me v1:172.21.15.33:0/0) 2022-12-01T09:43:34.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c51314700 1 --2- 172.21.15.33:0/1121568029 >> v2:172.21.15.156:3300/0 conn(0x7f7c4c159710 0x7f7c4c0b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c50b13700 1 --2- 172.21.15.33:0/1121568029 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 0x7f7c4c06d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c3bfff700 1 -- 172.21.15.33:0/1121568029 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118939807 0 0) 0x7f7c4c0cc7a0 con 0x7f7c4c06d540 2022-12-01T09:43:34.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c3bfff700 1 -- 172.21.15.33:0/1121568029 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c340035b0 con 0x7f7c4c06d540 2022-12-01T09:43:34.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c51314700 1 -- 172.21.15.33:0/1121568029 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 msgr2=0x7f7c4c06d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:34.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c51314700 1 --2- 172.21.15.33:0/1121568029 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 0x7f7c4c06d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c51314700 1 -- 172.21.15.33:0/1121568029 >> v1:172.21.15.33:6789/0 conn(0x7f7c4c06d540 legacy=0x7f7c4c0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c51314700 1 -- 172.21.15.33:0/1121568029 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0cc1e0 con 0x7f7c4c159710 2022-12-01T09:43:34.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c50b13700 1 --2- 172.21.15.33:0/1121568029 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 0x7f7c4c06d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:34.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c51314700 1 --2- 172.21.15.33:0/1121568029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 0x7f7c4c0b53f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009840 tx=0x7f7c48009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f155fe3d43f8bff7 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:34.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c3bfff700 1 -- 172.21.15.33:0/1121568029 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48011830 con 0x7f7c4c159710 2022-12-01T09:43:34.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c3bfff700 1 -- 172.21.15.33:0/1121568029 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c48011990 con 0x7f7c4c159710 2022-12-01T09:43:34.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.649+0000 7f7c3bfff700 1 -- 172.21.15.33:0/1121568029 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48011d20 con 0x7f7c4c159710 2022-12-01T09:43:34.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.650+0000 7f7c53578700 1 -- 172.21.15.33:0/1121568029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 msgr2=0x7f7c4c0b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.650+0000 7f7c53578700 1 --2- 172.21.15.33:0/1121568029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 0x7f7c4c0b53f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009840 tx=0x7f7c48009b50 comp rx=0 tx=0).stop 2022-12-01T09:43:34.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.650+0000 7f7c53578700 1 -- 172.21.15.33:0/1121568029 shutdown_connections 2022-12-01T09:43:34.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.650+0000 7f7c53578700 1 --2- 172.21.15.33:0/1121568029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 0x7f7c4c0b53f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.650+0000 7f7c53578700 1 --2- 172.21.15.33:0/1121568029 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 0x7f7c4c06d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.650+0000 7f7c53578700 1 -- 172.21.15.33:0/1121568029 >> 172.21.15.33:0/1121568029 conn(0x7f7c4c0cff30 msgr2=0x7f7c4c0d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:34.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.650+0000 7f7c53578700 1 -- 172.21.15.33:0/1121568029 shutdown_connections 2022-12-01T09:43:34.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.650+0000 7f7c53578700 1 -- 172.21.15.33:0/1121568029 wait complete. 2022-12-01T09:43:34.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.651+0000 7f7c53578700 1 Processor -- start 2022-12-01T09:43:34.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.651+0000 7f7c53578700 1 -- start start 2022-12-01T09:43:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c53578700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c06d540 0x7f7c4c0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c53578700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 0x7f7c4c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c53578700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 0x7f7c4c0b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c53578700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b07b0 con 0x7f7c4c06d540 2022-12-01T09:43:34.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c53578700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0c9b20 con 0x7f7c4c159710 2022-12-01T09:43:34.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c53578700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b0440 con 0x7f7c4c0b5b60 2022-12-01T09:43:34.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c51314700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c06d540 0x7f7c4c0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c51314700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c06d540 0x7f7c4c0b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45288/0 (socket says 172.21.15.33:45288) 2022-12-01T09:43:34.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c51314700 1 -- 172.21.15.33:0/2872729382 learned_addr learned my addr 172.21.15.33:0/2872729382 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:34.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c50b13700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 0x7f7c4c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.652+0000 7f7c51b15700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 0x7f7c4c0b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:34.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c51314700 1 -- 172.21.15.33:0/2872729382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 msgr2=0x7f7c4c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c51314700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 0x7f7c4c1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c51314700 1 -- 172.21.15.33:0/2872729382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 msgr2=0x7f7c4c0b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c51314700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 0x7f7c4c0b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c51314700 1 -- 172.21.15.33:0/2872729382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0094a0 con 0x7f7c4c06d540 2022-12-01T09:43:34.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c51b15700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 0x7f7c4c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:34.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c51314700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c06d540 0x7f7c4c0b24b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009fd0 tx=0x7f7c48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:34.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c39ffb700 1 -- 172.21.15.33:0/2872729382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48004590 con 0x7f7c4c06d540 2022-12-01T09:43:34.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c39ffb700 1 -- 172.21.15.33:0/2872729382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4801e070 con 0x7f7c4c06d540 2022-12-01T09:43:34.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c53578700 1 -- 172.21.15.33:0/2872729382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c480094a0 con 0x7f7c4c06d540 2022-12-01T09:43:34.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c39ffb700 1 -- 172.21.15.33:0/2872729382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c480038e0 con 0x7f7c4c06d540 2022-12-01T09:43:34.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c53578700 1 -- 172.21.15.33:0/2872729382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c154800 con 0x7f7c4c06d540 2022-12-01T09:43:34.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c39ffb700 1 -- 172.21.15.33:0/2872729382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f7c4800f050 con 0x7f7c4c06d540 2022-12-01T09:43:34.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.653+0000 7f7c39ffb700 1 -- 172.21.15.33:0/2872729382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f7c4802ddf0 con 0x7f7c4c06d540 2022-12-01T09:43:34.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.654+0000 7f7c53578700 1 -- 172.21.15.33:0/2872729382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c067420 con 0x7f7c4c06d540 2022-12-01T09:43:34.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.656+0000 7f7c39ffb700 1 -- 172.21.15.33:0/2872729382 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f7c48020070 con 0x7f7c4c06d540 2022-12-01T09:43:34.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.726+0000 7f7c53578700 1 -- 172.21.15.33:0/2872729382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c4c0ca3d0 con 0x7f7c4c06d540 2022-12-01T09:43:34.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.727+0000 7f7c39ffb700 1 -- 172.21.15.33:0/2872729382 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7011 (secure 0 0 0) 0x7f7c48015020 con 0x7f7c4c06d540 2022-12-01T09:43:34.731 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:43:34.731 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":10,"fsid":"c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a","created":"2022-12-01T09:43:31.850283+0000","modified":"2022-12-01T09:43:34.438886+0000","last_up_change":"0.000000","last_in_change":"2022-12-01T09:43:34.438886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"b2715202-f5bd-4a04-a572-5280d5a74756","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8969a66c-e3bf-444c-a7fc-1d988d9592cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"803fa135-9f54-4f34-bd0e-bc230b4dcbd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6dbfab54-3de3-4ffc-b3bb-ad03bd4be8a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"019cf437-f88c-4be4-bf75-546695321962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cb41dbe1-2d9a-40f8-a237-ebd3dcc342e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"01fd4370-1453-4fb1-b80d-61ec5a062028","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"411c921b-7fb3-4963-a7f7-0a1346273113","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:43:34.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.728+0000 7f7c53578700 1 -- 172.21.15.33:0/2872729382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c06d540 msgr2=0x7f7c4c0b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.728+0000 7f7c53578700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c06d540 0x7f7c4c0b24b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009fd0 tx=0x7f7c48004750 comp rx=0 tx=0).stop 2022-12-01T09:43:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.728+0000 7f7c53578700 1 -- 172.21.15.33:0/2872729382 shutdown_connections 2022-12-01T09:43:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.728+0000 7f7c53578700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c4c159710 0x7f7c4c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.728+0000 7f7c53578700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c06d540 0x7f7c4c0b24b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.728+0000 7f7c53578700 1 --2- 172.21.15.33:0/2872729382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c4c0b5b60 0x7f7c4c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.728+0000 7f7c53578700 1 -- 172.21.15.33:0/2872729382 >> 172.21.15.33:0/2872729382 conn(0x7f7c4c0cff30 msgr2=0x7f7c4c157f00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.728+0000 7f7c53578700 1 -- 172.21.15.33:0/2872729382 shutdown_connections 2022-12-01T09:43:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:34.728+0000 7f7c53578700 1 -- 172.21.15.33:0/2872729382 wait complete. 2022-12-01T09:43:34.745 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-12-01T09:43:34.747 INFO:tasks.ceph:Waiting for OSDs to come up 2022-12-01T09:43:34.893 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:34.890+0000 7f4d03ae8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-12-01T09:43:34.894 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:34.891+0000 7f39fe24f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-12-01T09:43:35.030 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:35.026+0000 7f39fe24f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-12-01T09:43:35.033 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:35.030+0000 7f4d03ae8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-12-01T09:43:35.094 INFO:tasks.ceph.osd.2.smithi033.stderr:2022-12-01T09:43:35.091+0000 7fac36fee5c0 -1 Falling back to public interface 2022-12-01T09:43:35.103 INFO:tasks.ceph.osd.1.smithi033.stderr:2022-12-01T09:43:35.100+0000 7facdf30c5c0 -1 Falling back to public interface 2022-12-01T09:43:35.104 INFO:tasks.ceph.osd.4.smithi156.stderr:2022-12-01T09:43:35.100+0000 7f09a33b05c0 -1 Falling back to public interface 2022-12-01T09:43:35.104 INFO:tasks.ceph.osd.0.smithi033.stderr:2022-12-01T09:43:35.101+0000 7fb8eefb25c0 -1 Falling back to public interface 2022-12-01T09:43:35.105 INFO:tasks.ceph.osd.6.smithi156.stderr:2022-12-01T09:43:35.102+0000 7f574f3975c0 -1 Falling back to public interface 2022-12-01T09:43:35.109 INFO:tasks.ceph.osd.5.smithi156.stderr:2022-12-01T09:43:35.106+0000 7fa8338e45c0 -1 Falling back to public interface 2022-12-01T09:43:35.110 INFO:tasks.ceph.osd.7.smithi156.stderr:2022-12-01T09:43:35.106+0000 7f11016c35c0 -1 Falling back to public interface 2022-12-01T09:43:35.110 INFO:tasks.ceph.osd.3.smithi033.stderr:2022-12-01T09:43:35.107+0000 7f51885ba5c0 -1 Falling back to public interface 2022-12-01T09:43:35.554 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-12-01T09:43:35.641 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:35.638+0000 7f39fe24f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-12-01T09:43:35.661 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:35.659+0000 7f4d03ae8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-12-01T09:43:35.670 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.667+0000 7fb4aadf6700 1 Processor -- start 2022-12-01T09:43:35.670 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.667+0000 7fb4aadf6700 1 -- start start 2022-12-01T09:43:35.674 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4aadf6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 0x7fb4a415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:35.674 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4aadf6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb4a4070570 0x7fb4a406a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:35.674 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4aadf6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a415d100 con 0x7fb4a41580d0 2022-12-01T09:43:35.674 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4aadf6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a406ad50 con 0x7fb4a4070570 2022-12-01T09:43:35.675 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4aadf6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40cd260 con 0x7fb4a40701a0 2022-12-01T09:43:35.675 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4a3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb4a4070570 0x7fb4a406a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:35.675 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4a3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb4a4070570 0x7fb4a406a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45300/0 (socket says 172.21.15.33:45300) 2022-12-01T09:43:35.675 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4a3fff700 1 -- 172.21.15.33:0/3496599471 learned_addr learned my addr 172.21.15.33:0/3496599471 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:35.676 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4a8b92700 1 --2- 172.21.15.33:0/3496599471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 0x7fb4a415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:35.676 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4a3fff700 1 -- 172.21.15.33:0/3496599471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 msgr2=0x7fb4a415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:35.676 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4a3fff700 1 --2- 172.21.15.33:0/3496599471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 0x7fb4a415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:35.677 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4a37fe700 1 -- 172.21.15.33:0/3496599471 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745911485 0 0) 0x7fb49c001490 con 0x7fb4a41580d0 2022-12-01T09:43:35.677 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4a3fff700 1 -- 172.21.15.33:0/3496599471 >> v1:172.21.15.156:6789/0 conn(0x7fb4a41580d0 legacy=0x7fb4a41584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:35.677 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.668+0000 7fb4a3fff700 1 -- 172.21.15.33:0/3496599471 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4069770 con 0x7fb4a4070570 2022-12-01T09:43:35.677 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4a3fff700 1 --2- 172.21.15.33:0/3496599471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a4070570 0x7fb4a406a810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4900098f0 tx=0x7fb490009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886bdf77228ad4e0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:35.678 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4a37fe700 1 -- 172.21.15.33:0/3496599471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490011830 con 0x7fb4a4070570 2022-12-01T09:43:35.678 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4a37fe700 1 -- 172.21.15.33:0/3496599471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490011990 con 0x7fb4a4070570 2022-12-01T09:43:35.678 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4a37fe700 1 -- 172.21.15.33:0/3496599471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490011d20 con 0x7fb4a4070570 2022-12-01T09:43:35.678 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4aadf6700 1 -- 172.21.15.33:0/3496599471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a4070570 msgr2=0x7fb4a406a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:35.678 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4aadf6700 1 --2- 172.21.15.33:0/3496599471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a4070570 0x7fb4a406a810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4900098f0 tx=0x7fb490009c00 comp rx=0 tx=0).stop 2022-12-01T09:43:35.679 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4aadf6700 1 -- 172.21.15.33:0/3496599471 shutdown_connections 2022-12-01T09:43:35.679 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4aadf6700 1 --2- 172.21.15.33:0/3496599471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 0x7fb4a415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:35.679 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4aadf6700 1 --2- 172.21.15.33:0/3496599471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a4070570 0x7fb4a406a810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:35.679 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4aadf6700 1 -- 172.21.15.33:0/3496599471 >> 172.21.15.33:0/3496599471 conn(0x7fb4a40b1640 msgr2=0x7fb4a40cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:35.680 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4aadf6700 1 -- 172.21.15.33:0/3496599471 shutdown_connections 2022-12-01T09:43:35.680 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.669+0000 7fb4aadf6700 1 -- 172.21.15.33:0/3496599471 wait complete. 2022-12-01T09:43:35.680 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.671+0000 7fb4aadf6700 1 Processor -- start 2022-12-01T09:43:35.680 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.671+0000 7fb4aadf6700 1 -- start start 2022-12-01T09:43:35.684 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.671+0000 7fb4aadf6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 0x7fb4a40cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:35.684 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.671+0000 7fb4aadf6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a4070570 0x7fb4a414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:35.684 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4aadf6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a41580d0 0x7fb4a40a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:35.684 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4aadf6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40cc010 con 0x7fb4a41580d0 2022-12-01T09:43:35.685 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4aadf6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40cb390 con 0x7fb4a4070570 2022-12-01T09:43:35.685 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4aadf6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40cb670 con 0x7fb4a40701a0 2022-12-01T09:43:35.685 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a9393700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a41580d0 0x7fb4a40a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:35.685 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a4070570 0x7fb4a414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:35.686 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a9393700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a41580d0 0x7fb4a40a7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45316/0 (socket says 172.21.15.33:45316) 2022-12-01T09:43:35.686 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a9393700 1 -- 172.21.15.33:0/1251339767 learned_addr learned my addr 172.21.15.33:0/1251339767 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:35.686 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a8b92700 1 --2- 172.21.15.33:0/1251339767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 0x7fb4a40cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:35.687 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a3fff700 1 -- 172.21.15.33:0/1251339767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 msgr2=0x7fb4a40cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:35.687 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a3fff700 1 --2- 172.21.15.33:0/1251339767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 0x7fb4a40cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:35.687 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a3fff700 1 -- 172.21.15.33:0/1251339767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a41580d0 msgr2=0x7fb4a40a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:35.688 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a3fff700 1 --2- 172.21.15.33:0/1251339767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a41580d0 0x7fb4a40a7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:35.688 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a3fff700 1 -- 172.21.15.33:0/1251339767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490009550 con 0x7fb4a4070570 2022-12-01T09:43:35.688 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a9393700 1 --2- 172.21.15.33:0/1251339767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a41580d0 0x7fb4a40a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:35.688 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a3fff700 1 --2- 172.21.15.33:0/1251339767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a4070570 0x7fb4a414d290 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb490016000 tx=0x7fb490004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:35.689 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a17fa700 1 -- 172.21.15.33:0/1251339767 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490004300 con 0x7fb4a4070570 2022-12-01T09:43:35.689 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a17fa700 1 -- 172.21.15.33:0/1251339767 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49001f070 con 0x7fb4a4070570 2022-12-01T09:43:35.689 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4aadf6700 1 -- 172.21.15.33:0/1251339767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a40cb950 con 0x7fb4a4070570 2022-12-01T09:43:35.689 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4a17fa700 1 -- 172.21.15.33:0/1251339767 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900036a0 con 0x7fb4a4070570 2022-12-01T09:43:35.690 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.672+0000 7fb4aadf6700 1 -- 172.21.15.33:0/1251339767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a40a83a0 con 0x7fb4a4070570 2022-12-01T09:43:35.690 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.673+0000 7fb4a17fa700 1 -- 172.21.15.33:0/1251339767 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb49002a020 con 0x7fb4a4070570 2022-12-01T09:43:35.690 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.673+0000 7fb4a17fa700 1 -- 172.21.15.33:0/1251339767 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fb49001a5e0 con 0x7fb4a4070570 2022-12-01T09:43:35.690 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.673+0000 7fb4aadf6700 1 -- 172.21.15.33:0/1251339767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a40cc150 con 0x7fb4a4070570 2022-12-01T09:43:35.690 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.676+0000 7fb4a17fa700 1 -- 172.21.15.33:0/1251339767 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fb4a40cc150 con 0x7fb4a4070570 2022-12-01T09:43:35.749 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.747+0000 7fb4aadf6700 1 -- 172.21.15.33:0/1251339767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4a4067420 con 0x7fb4a4070570 2022-12-01T09:43:35.750 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.747+0000 7fb4a17fa700 1 -- 172.21.15.33:0/1251339767 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7011 (secure 0 0 0) 0x7fb490015020 con 0x7fb4a4070570 2022-12-01T09:43:35.751 INFO:teuthology.misc.health.smithi033.stdout: 2022-12-01T09:43:35.751 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":10,"fsid":"c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a","created":"2022-12-01T09:43:31.850283+0000","modified":"2022-12-01T09:43:34.438886+0000","last_up_change":"0.000000","last_in_change":"2022-12-01T09:43:34.438886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"b2715202-f5bd-4a04-a572-5280d5a74756","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8969a66c-e3bf-444c-a7fc-1d988d9592cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"803fa135-9f54-4f34-bd0e-bc230b4dcbd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6dbfab54-3de3-4ffc-b3bb-ad03bd4be8a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"019cf437-f88c-4be4-bf75-546695321962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cb41dbe1-2d9a-40f8-a237-ebd3dcc342e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"01fd4370-1453-4fb1-b80d-61ec5a062028","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"411c921b-7fb3-4963-a7f7-0a1346273113","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:43:35.752 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.748+0000 7fb4aadf6700 1 -- 172.21.15.33:0/1251339767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a4070570 msgr2=0x7fb4a414d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:35.753 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.748+0000 7fb4aadf6700 1 --2- 172.21.15.33:0/1251339767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a4070570 0x7fb4a414d290 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb490016000 tx=0x7fb490004750 comp rx=0 tx=0).stop 2022-12-01T09:43:35.753 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.748+0000 7fb4aadf6700 1 -- 172.21.15.33:0/1251339767 shutdown_connections 2022-12-01T09:43:35.753 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.748+0000 7fb4aadf6700 1 --2- 172.21.15.33:0/1251339767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a41580d0 0x7fb4a40a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:35.753 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.748+0000 7fb4aadf6700 1 --2- 172.21.15.33:0/1251339767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a40701a0 0x7fb4a40cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:35.754 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.748+0000 7fb4aadf6700 1 --2- 172.21.15.33:0/1251339767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a4070570 0x7fb4a414d290 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:35.754 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.748+0000 7fb4aadf6700 1 -- 172.21.15.33:0/1251339767 >> 172.21.15.33:0/1251339767 conn(0x7fb4a40b1640 msgr2=0x7fb4a40b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:35.754 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.748+0000 7fb4aadf6700 1 -- 172.21.15.33:0/1251339767 shutdown_connections 2022-12-01T09:43:35.754 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:35.748+0000 7fb4aadf6700 1 -- 172.21.15.33:0/1251339767 wait complete. 2022-12-01T09:43:35.762 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-12-01T09:43:35.857 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:35.854+0000 7f39fe24f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-12-01T09:43:35.887 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:35.884+0000 7f4d03ae8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-12-01T09:43:36.608 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:36.605+0000 7f39fe24f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-12-01T09:43:36.682 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:36.676+0000 7f39fe24f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-12-01T09:43:36.738 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:36.735+0000 7f4d03ae8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-12-01T09:43:36.813 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:36.810+0000 7f4d03ae8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-12-01T09:43:37.204 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:37.200+0000 7f39fe24f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-12-01T09:43:37.288 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:37.279+0000 7f39fe24f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-12-01T09:43:37.371 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:37.368+0000 7f4d03ae8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-12-01T09:43:37.453 INFO:tasks.ceph.mgr.y.smithi033.stderr:2022-12-01T09:43:37.451+0000 7f4d03ae8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-12-01T09:43:38.308 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:38.304+0000 7f39bbfb3700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-12-01T09:43:38.308 INFO:tasks.ceph.mgr.x.smithi156.stderr:2022-12-01T09:43:38.304+0000 7f39bbfb3700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-12-01T09:43:38.556 INFO:tasks.ceph.osd.2.smithi033.stderr:2022-12-01T09:43:38.553+0000 7fac36fee5c0 -1 osd.2 0 log_to_monitors true 2022-12-01T09:43:38.609 INFO:tasks.ceph.osd.6.smithi156.stderr:2022-12-01T09:43:38.605+0000 7f574f3975c0 -1 osd.6 0 log_to_monitors true 2022-12-01T09:43:38.618 INFO:tasks.ceph.osd.3.smithi033.stderr:2022-12-01T09:43:38.616+0000 7f51885ba5c0 -1 osd.3 0 log_to_monitors true 2022-12-01T09:43:38.629 INFO:tasks.ceph.osd.0.smithi033.stderr:2022-12-01T09:43:38.627+0000 7fb8eefb25c0 -1 osd.0 0 log_to_monitors true 2022-12-01T09:43:38.634 INFO:tasks.ceph.osd.1.smithi033.stderr:2022-12-01T09:43:38.632+0000 7facdf30c5c0 -1 osd.1 0 log_to_monitors true 2022-12-01T09:43:38.639 INFO:tasks.ceph.osd.7.smithi156.stderr:2022-12-01T09:43:38.635+0000 7f11016c35c0 -1 osd.7 0 log_to_monitors true 2022-12-01T09:43:38.645 INFO:tasks.ceph.osd.4.smithi156.stderr:2022-12-01T09:43:38.641+0000 7f09a33b05c0 -1 osd.4 0 log_to_monitors true 2022-12-01T09:43:38.656 INFO:tasks.ceph.osd.5.smithi156.stderr:2022-12-01T09:43:38.652+0000 7fa8338e45c0 -1 osd.5 0 log_to_monitors true 2022-12-01T09:43:41.648 INFO:tasks.ceph.osd.5.smithi156.stderr:2022-12-01T09:43:41.641+0000 7fa82748c700 -1 osd.5 0 waiting for initial osdmap 2022-12-01T09:43:41.652 INFO:tasks.ceph.osd.6.smithi156.stderr:2022-12-01T09:43:41.648+0000 7f5742f3f700 -1 osd.6 0 waiting for initial osdmap 2022-12-01T09:43:41.658 INFO:tasks.ceph.osd.7.smithi156.stderr:2022-12-01T09:43:41.654+0000 7f10f526b700 -1 osd.7 0 waiting for initial osdmap 2022-12-01T09:43:41.659 INFO:tasks.ceph.osd.5.smithi156.stderr:2022-12-01T09:43:41.655+0000 7fa81f867700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:43:41.666 INFO:tasks.ceph.osd.6.smithi156.stderr:2022-12-01T09:43:41.662+0000 7f573b31a700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:43:41.668 INFO:tasks.ceph.osd.4.smithi156.stderr:2022-12-01T09:43:41.664+0000 7f0996f58700 -1 osd.4 0 waiting for initial osdmap 2022-12-01T09:43:41.679 INFO:tasks.ceph.osd.4.smithi156.stderr:2022-12-01T09:43:41.675+0000 7f098f333700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:43:41.691 INFO:tasks.ceph.osd.7.smithi156.stderr:2022-12-01T09:43:41.687+0000 7f10ed646700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:43:42.392 INFO:tasks.ceph.osd.0.smithi033.stderr:2022-12-01T09:43:42.389+0000 7fb8e2b5a700 -1 osd.0 0 waiting for initial osdmap 2022-12-01T09:43:42.396 INFO:tasks.ceph.osd.1.smithi033.stderr:2022-12-01T09:43:42.393+0000 7facd2eb4700 -1 osd.1 0 waiting for initial osdmap 2022-12-01T09:43:42.403 INFO:tasks.ceph.osd.2.smithi033.stderr:2022-12-01T09:43:42.400+0000 7fac2ab96700 -1 osd.2 0 waiting for initial osdmap 2022-12-01T09:43:42.410 INFO:tasks.ceph.osd.1.smithi033.stderr:2022-12-01T09:43:42.408+0000 7faccb28f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:43:42.412 INFO:tasks.ceph.osd.0.smithi033.stderr:2022-12-01T09:43:42.410+0000 7fb8daf35700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:43:42.420 INFO:tasks.ceph.osd.2.smithi033.stderr:2022-12-01T09:43:42.418+0000 7fac22f71700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:43:42.423 INFO:tasks.ceph.osd.3.smithi033.stderr:2022-12-01T09:43:42.421+0000 7f517c162700 -1 osd.3 0 waiting for initial osdmap 2022-12-01T09:43:42.439 INFO:tasks.ceph.osd.3.smithi033.stderr:2022-12-01T09:43:42.436+0000 7f517453d700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-12-01T09:43:42.570 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-12-01T09:43:42.692 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.689+0000 7f833218e700 1 Processor -- start 2022-12-01T09:43:42.692 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.689+0000 7f833218e700 1 -- start start 2022-12-01T09:43:42.696 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f833218e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:42.697 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f833218e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f832c06dc70 0x7f832c0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:42.697 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f833218e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c158360 con 0x7f832c0b04d0 2022-12-01T09:43:42.697 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f833218e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c0b0970 con 0x7f832c06dc70 2022-12-01T09:43:42.698 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f833218e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0c8b60 con 0x7f832c157f90 2022-12-01T09:43:42.698 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:42.699 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c0ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.33:51816/0 (socket says 172.21.15.33:51816) 2022-12-01T09:43:42.699 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f832b7fe700 1 -- 172.21.15.33:0/2382667966 learned_addr learned my addr 172.21.15.33:0/2382667966 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:42.700 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f832affd700 1 --2- 172.21.15.33:0/2382667966 >> v2:172.21.15.156:3300/0 conn(0x7f832c06dc70 0x7f832c0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:42.700 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f832b7fe700 1 -- 172.21.15.33:0/2382667966 >> v2:172.21.15.156:3300/0 conn(0x7f832c06dc70 msgr2=0x7f832c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:42.700 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f832b7fe700 1 --2- 172.21.15.33:0/2382667966 >> v2:172.21.15.156:3300/0 conn(0x7f832c06dc70 0x7f832c0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.701 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f832a7fc700 1 -- 172.21.15.33:0/2382667966 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197689398 0 0) 0x7f8324001490 con 0x7f832c0b04d0 2022-12-01T09:43:42.701 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f832b7fe700 1 -- 172.21.15.33:0/2382667966 >> v1:172.21.15.156:6789/0 conn(0x7f832c0b04d0 legacy=0x7f832c15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:42.702 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.690+0000 7f832b7fe700 1 -- 172.21.15.33:0/2382667966 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c0c8db0 con 0x7f832c157f90 2022-12-01T09:43:42.702 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f832b7fe700 1 --2- 172.21.15.33:0/2382667966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c0ca6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f831c00bb90 tx=0x7f831c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88acb2efe17ee11d server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:42.703 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f832a7fc700 1 -- 172.21.15.33:0/2382667966 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00dd30 con 0x7f832c157f90 2022-12-01T09:43:42.703 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f832a7fc700 1 -- 172.21.15.33:0/2382667966 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00de90 con 0x7f832c157f90 2022-12-01T09:43:42.704 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f832a7fc700 1 -- 172.21.15.33:0/2382667966 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c010690 con 0x7f832c157f90 2022-12-01T09:43:42.704 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f833218e700 1 -- 172.21.15.33:0/2382667966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 msgr2=0x7f832c0ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:42.705 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f833218e700 1 --2- 172.21.15.33:0/2382667966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c0ca6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f831c00bb90 tx=0x7f831c00bea0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.705 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f833218e700 1 -- 172.21.15.33:0/2382667966 shutdown_connections 2022-12-01T09:43:42.706 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f833218e700 1 --2- 172.21.15.33:0/2382667966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c0ca6c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.706 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f833218e700 1 --2- 172.21.15.33:0/2382667966 >> v2:172.21.15.156:3300/0 conn(0x7f832c06dc70 0x7f832c0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.706 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f833218e700 1 -- 172.21.15.33:0/2382667966 >> 172.21.15.33:0/2382667966 conn(0x7f832c06c260 msgr2=0x7f832c0caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:42.707 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f833218e700 1 -- 172.21.15.33:0/2382667966 shutdown_connections 2022-12-01T09:43:42.707 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.691+0000 7f833218e700 1 -- 172.21.15.33:0/2382667966 wait complete. 2022-12-01T09:43:42.708 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.693+0000 7f833218e700 1 Processor -- start 2022-12-01T09:43:42.708 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.693+0000 7f833218e700 1 -- start start 2022-12-01T09:43:42.714 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f833218e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f832c06dc70 0x7f832c14fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:42.715 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f833218e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f832c0b04d0 0x7f832c15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:42.715 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f833218e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:42.716 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f833218e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c070c40 con 0x7f832c06dc70 2022-12-01T09:43:42.716 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f833218e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c150530 con 0x7f832c0b04d0 2022-12-01T09:43:42.717 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f833218e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c156de0 con 0x7f832c157f90 2022-12-01T09:43:42.717 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f832c06dc70 0x7f832c14fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:42.717 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f832c06dc70 0x7f832c14fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55328/0 (socket says 172.21.15.33:55328) 2022-12-01T09:43:42.718 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f832b7fe700 1 -- 172.21.15.33:0/3386928009 learned_addr learned my addr 172.21.15.33:0/3386928009 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:42.718 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f832affd700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f832c0b04d0 0x7f832c15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:42.719 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.694+0000 7f832bfff700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:42.719 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f832b7fe700 1 -- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 msgr2=0x7f832c15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:42.720 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f832b7fe700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.720 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f832b7fe700 1 -- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f832c0b04d0 msgr2=0x7f832c15a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:42.720 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f832b7fe700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f832c0b04d0 0x7f832c15a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.729 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f832b7fe700 1 -- 172.21.15.33:0/3386928009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c00b7f0 con 0x7f832c06dc70 2022-12-01T09:43:42.729 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f832affd700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f832c0b04d0 0x7f832c15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:43:42.730 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f832b7fe700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f832c06dc70 0x7f832c14fb50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f831c000c00 tx=0x7f831c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:42.730 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f8313fff700 1 -- 172.21.15.33:0/3386928009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c01f070 con 0x7f832c06dc70 2022-12-01T09:43:42.730 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f8313fff700 1 -- 172.21.15.33:0/3386928009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c003970 con 0x7f832c06dc70 2022-12-01T09:43:42.730 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c070680 con 0x7f832c06dc70 2022-12-01T09:43:42.731 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f8313fff700 1 -- 172.21.15.33:0/3386928009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c003ce0 con 0x7f832c06dc70 2022-12-01T09:43:42.731 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.695+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c150090 con 0x7f832c06dc70 2022-12-01T09:43:42.731 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.696+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c150300 con 0x7f832c06dc70 2022-12-01T09:43:42.731 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.696+0000 7f8313fff700 1 -- 172.21.15.33:0/3386928009 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f831c019400 con 0x7f832c06dc70 2022-12-01T09:43:42.732 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.697+0000 7f8313fff700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f830c066540 0x7f830c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:42.732 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.697+0000 7f8313fff700 1 -- 172.21.15.33:0/3386928009 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f831c086680 con 0x7f832c06dc70 2022-12-01T09:43:42.732 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.697+0000 7f832affd700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f830c066540 0x7f830c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:42.732 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.697+0000 7f832affd700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f830c066540 0x7f830c0689f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f832c0ade70 tx=0x7f8320008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:42.732 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.701+0000 7f8313fff700 1 -- 172.21.15.33:0/3386928009 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f832c150300 con 0x7f832c06dc70 2022-12-01T09:43:42.892 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.889+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f832c150300 con 0x7f832c06dc70 2022-12-01T09:43:42.893 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.890+0000 7f8313fff700 1 -- 172.21.15.33:0/3386928009 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10490 (secure 0 0 0) 0x7f832c150300 con 0x7f832c06dc70 2022-12-01T09:43:42.894 INFO:teuthology.misc.health.smithi033.stdout: 2022-12-01T09:43:42.895 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":13,"fsid":"c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a","created":"2022-12-01T09:43:31.850283+0000","modified":"2022-12-01T09:43:42.656197+0000","last_up_change":"2022-12-01T09:43:42.656197+0000","last_in_change":"2022-12-01T09:43:34.438886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"b2715202-f5bd-4a04-a572-5280d5a74756","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":112288},{"type":"v1","addr":"172.21.15.33:6815","nonce":112288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":112288},{"type":"v1","addr":"172.21.15.33:6819","nonce":112288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":112288},{"type":"v1","addr":"172.21.15.33:6823","nonce":112288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":112288},{"type":"v1","addr":"172.21.15.33:6821","nonce":112288}]},"public_addr":"172.21.15.33:6815/112288","cluster_addr":"172.21.15.33:6819/112288","heartbeat_back_addr":"172.21.15.33:6823/112288","heartbeat_front_addr":"172.21.15.33:6821/112288","state":["exists","up"]},{"osd":1,"uuid":"8969a66c-e3bf-444c-a7fc-1d988d9592cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":112289},{"type":"v1","addr":"172.21.15.33:6809","nonce":112289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":112289},{"type":"v1","addr":"172.21.15.33:6811","nonce":112289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":112289},{"type":"v1","addr":"172.21.15.33:6818","nonce":112289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":112289},{"type":"v1","addr":"172.21.15.33:6813","nonce":112289}]},"public_addr":"172.21.15.33:6809/112289","cluster_addr":"172.21.15.33:6811/112289","heartbeat_back_addr":"172.21.15.33:6818/112289","heartbeat_front_addr":"172.21.15.33:6813/112289","state":["exists","up"]},{"osd":2,"uuid":"803fa135-9f54-4f34-bd0e-bc230b4dcbd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":112287},{"type":"v1","addr":"172.21.15.33:6801","nonce":112287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":112287},{"type":"v1","addr":"172.21.15.33:6803","nonce":112287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":112287},{"type":"v1","addr":"172.21.15.33:6807","nonce":112287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":112287},{"type":"v1","addr":"172.21.15.33:6805","nonce":112287}]},"public_addr":"172.21.15.33:6801/112287","cluster_addr":"172.21.15.33:6803/112287","heartbeat_back_addr":"172.21.15.33:6807/112287","heartbeat_front_addr":"172.21.15.33:6805/112287","state":["exists","up"]},{"osd":3,"uuid":"6dbfab54-3de3-4ffc-b3bb-ad03bd4be8a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":112290},{"type":"v1","addr":"172.21.15.33:6825","nonce":112290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":112290},{"type":"v1","addr":"172.21.15.33:6827","nonce":112290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":112290},{"type":"v1","addr":"172.21.15.33:6831","nonce":112290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":112290},{"type":"v1","addr":"172.21.15.33:6829","nonce":112290}]},"public_addr":"172.21.15.33:6825/112290","cluster_addr":"172.21.15.33:6827/112290","heartbeat_back_addr":"172.21.15.33:6831/112290","heartbeat_front_addr":"172.21.15.33:6829/112290","state":["exists","up"]},{"osd":4,"uuid":"019cf437-f88c-4be4-bf75-546695321962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":112449},{"type":"v1","addr":"172.21.15.156:6801","nonce":112449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":112449},{"type":"v1","addr":"172.21.15.156:6803","nonce":112449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":112449},{"type":"v1","addr":"172.21.15.156:6807","nonce":112449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":112449},{"type":"v1","addr":"172.21.15.156:6805","nonce":112449}]},"public_addr":"172.21.15.156:6801/112449","cluster_addr":"172.21.15.156:6803/112449","heartbeat_back_addr":"172.21.15.156:6807/112449","heartbeat_front_addr":"172.21.15.156:6805/112449","state":["exists","up"]},{"osd":5,"uuid":"cb41dbe1-2d9a-40f8-a237-ebd3dcc342e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":112452},{"type":"v1","addr":"172.21.15.156:6819","nonce":112452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6821","nonce":112452},{"type":"v1","addr":"172.21.15.156:6823","nonce":112452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6829","nonce":112452},{"type":"v1","addr":"172.21.15.156:6831","nonce":112452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6825","nonce":112452},{"type":"v1","addr":"172.21.15.156:6827","nonce":112452}]},"public_addr":"172.21.15.156:6819/112452","cluster_addr":"172.21.15.156:6823/112452","heartbeat_back_addr":"172.21.15.156:6831/112452","heartbeat_front_addr":"172.21.15.156:6827/112452","state":["exists","up"]},{"osd":6,"uuid":"01fd4370-1453-4fb1-b80d-61ec5a062028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":112450},{"type":"v1","addr":"172.21.15.156:6809","nonce":112450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":112450},{"type":"v1","addr":"172.21.15.156:6811","nonce":112450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":112450},{"type":"v1","addr":"172.21.15.156:6815","nonce":112450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":112450},{"type":"v1","addr":"172.21.15.156:6813","nonce":112450}]},"public_addr":"172.21.15.156:6809/112450","cluster_addr":"172.21.15.156:6811/112450","heartbeat_back_addr":"172.21.15.156:6815/112450","heartbeat_front_addr":"172.21.15.156:6813/112450","state":["exists","up"]},{"osd":7,"uuid":"411c921b-7fb3-4963-a7f7-0a1346273113","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":112451},{"type":"v1","addr":"172.21.15.156:6818","nonce":112451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":112451},{"type":"v1","addr":"172.21.15.156:6822","nonce":112451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":112451},{"type":"v1","addr":"172.21.15.156:6830","nonce":112451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":112451},{"type":"v1","addr":"172.21.15.156:6826","nonce":112451}]},"public_addr":"172.21.15.156:6818/112451","cluster_addr":"172.21.15.156:6822/112451","heartbeat_back_addr":"172.21.15.156:6830/112451","heartbeat_front_addr":"172.21.15.156:6826/112451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:43:42.897 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.891+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f830c066540 msgr2=0x7f830c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:42.897 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.891+0000 7f833218e700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f830c066540 0x7f830c0689f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f832c0ade70 tx=0x7f8320008040 comp rx=0 tx=0).stop 2022-12-01T09:43:42.898 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f832c06dc70 msgr2=0x7f832c14fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:42.898 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f832c06dc70 0x7f832c14fb50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f831c000c00 tx=0x7f831c004750 comp rx=0 tx=0).stop 2022-12-01T09:43:42.898 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 shutdown_connections 2022-12-01T09:43:42.899 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f830c066540 0x7f830c0689f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.899 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f832c157f90 0x7f832c15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.900 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f832c06dc70 0x7f832c14fb50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.900 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 --2- 172.21.15.33:0/3386928009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f832c0b04d0 0x7f832c15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:42.901 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 >> 172.21.15.33:0/3386928009 conn(0x7f832c06c260 msgr2=0x7f832c153910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:42.901 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 shutdown_connections 2022-12-01T09:43:42.901 INFO:teuthology.misc.health.smithi033.stderr:2022-12-01T09:43:42.892+0000 7f833218e700 1 -- 172.21.15.33:0/3386928009 wait complete. 2022-12-01T09:43:42.906 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-12-01T09:43:42.906 INFO:tasks.ceph:Creating RBD pool 2022-12-01T09:43:42.907 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd pool create rbd 8 2022-12-01T09:43:43.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.029+0000 7fd30ecff700 1 Processor -- start 2022-12-01T09:43:43.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.029+0000 7fd30ecff700 1 -- start start 2022-12-01T09:43:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.030+0000 7fd30ecff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd308070f60 0x7fd30806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.030+0000 7fd30ecff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd308071f60 0x7fd3080723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.030+0000 7fd30ecff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30815c250 con 0x7fd30815be80 2022-12-01T09:43:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.030+0000 7fd30ecff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd308070b40 con 0x7fd308071f60 2022-12-01T09:43:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.030+0000 7fd30ecff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080ce580 con 0x7fd308070f60 2022-12-01T09:43:43.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.030+0000 7fd30d29c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd308071f60 0x7fd3080723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.030+0000 7fd307fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd308070f60 0x7fd30806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.030+0000 7fd30d29c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd308071f60 0x7fd3080723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55344/0 (socket says 172.21.15.33:55344) 2022-12-01T09:43:43.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.030+0000 7fd30d29c700 1 -- 172.21.15.33:0/1792977817 learned_addr learned my addr 172.21.15.33:0/1792977817 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:43.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30d29c700 1 -- 172.21.15.33:0/1792977817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd308070f60 msgr2=0x7fd30806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30d29c700 1 --2- 172.21.15.33:0/1792977817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd308070f60 0x7fd30806a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30d29c700 1 -- 172.21.15.33:0/1792977817 >> v1:172.21.15.156:6789/0 conn(0x7fd30815be80 legacy=0x7fd3080cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30d29c700 1 -- 172.21.15.33:0/1792977817 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3080728f0 con 0x7fd308071f60 2022-12-01T09:43:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd307fff700 1 --2- 172.21.15.33:0/1792977817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd308070f60 0x7fd30806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30d29c700 1 --2- 172.21.15.33:0/1792977817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308071f60 0x7fd3080723b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd300009e50 tx=0x7fd30000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38c0e8591ee4f0b server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd3077fe700 1 -- 172.21.15.33:0/1792977817 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000e070 con 0x7fd308071f60 2022-12-01T09:43:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd3077fe700 1 -- 172.21.15.33:0/1792977817 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30000b910 con 0x7fd308071f60 2022-12-01T09:43:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd3077fe700 1 -- 172.21.15.33:0/1792977817 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000bcc0 con 0x7fd308071f60 2022-12-01T09:43:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30ecff700 1 -- 172.21.15.33:0/1792977817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308071f60 msgr2=0x7fd3080723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30ecff700 1 --2- 172.21.15.33:0/1792977817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308071f60 0x7fd3080723b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd300009e50 tx=0x7fd30000b330 comp rx=0 tx=0).stop 2022-12-01T09:43:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30ecff700 1 -- 172.21.15.33:0/1792977817 shutdown_connections 2022-12-01T09:43:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30ecff700 1 --2- 172.21.15.33:0/1792977817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308071f60 0x7fd3080723b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30ecff700 1 --2- 172.21.15.33:0/1792977817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd308070f60 0x7fd30806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30ecff700 1 -- 172.21.15.33:0/1792977817 >> 172.21.15.33:0/1792977817 conn(0x7fd3080cb7e0 msgr2=0x7fd3080cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:43.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30ecff700 1 -- 172.21.15.33:0/1792977817 shutdown_connections 2022-12-01T09:43:43.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.031+0000 7fd30ecff700 1 -- 172.21.15.33:0/1792977817 wait complete. 2022-12-01T09:43:43.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.033+0000 7fd30ecff700 1 Processor -- start 2022-12-01T09:43:43.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.033+0000 7fd30ecff700 1 -- start start 2022-12-01T09:43:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.033+0000 7fd30ecff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308070f60 0x7fd30815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.033+0000 7fd30ecff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd308071f60 0x7fd308157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ecff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30815be80 0x7fd3080ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ecff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308158110 con 0x7fd308070f60 2022-12-01T09:43:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ecff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30815f210 con 0x7fd308071f60 2022-12-01T09:43:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ecff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080c6890 con 0x7fd30815be80 2022-12-01T09:43:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ca9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308070f60 0x7fd30815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ca9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308070f60 0x7fd30815eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55352/0 (socket says 172.21.15.33:55352) 2022-12-01T09:43:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ca9b700 1 -- 172.21.15.33:0/3798367061 learned_addr learned my addr 172.21.15.33:0/3798367061 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd307fff700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd308071f60 0x7fd308157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30d29c700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30815be80 0x7fd3080ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ca9b700 1 -- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30815be80 msgr2=0x7fd3080ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ca9b700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30815be80 0x7fd3080ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ca9b700 1 -- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd308071f60 msgr2=0x7fd308157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ca9b700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd308071f60 0x7fd308157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ca9b700 1 -- 172.21.15.33:0/3798367061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f40094a0 con 0x7fd308070f60 2022-12-01T09:43:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ca9b700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308070f60 0x7fd30815eba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c480 tx=0x7fd2fc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd3057fa700 1 -- 172.21.15.33:0/3798367061 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0052d0 con 0x7fd308070f60 2022-12-01T09:43:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd3057fa700 1 -- 172.21.15.33:0/3798367061 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc005430 con 0x7fd308070f60 2022-12-01T09:43:43.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd300009b30 con 0x7fd308070f60 2022-12-01T09:43:43.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd3057fa700 1 -- 172.21.15.33:0/3798367061 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0038c0 con 0x7fd308070f60 2022-12-01T09:43:43.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.034+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3080cac20 con 0x7fd308070f60 2022-12-01T09:43:43.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.035+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3080c6a40 con 0x7fd308070f60 2022-12-01T09:43:43.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.036+0000 7fd3057fa700 1 -- 172.21.15.33:0/3798367061 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7fd2fc019030 con 0x7fd308070f60 2022-12-01T09:43:43.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.036+0000 7fd3057fa700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fd2f0066540 0x7fd2f00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.036+0000 7fd3057fa700 1 -- 172.21.15.33:0/3798367061 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fd2fc0820e0 con 0x7fd308070f60 2022-12-01T09:43:43.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.036+0000 7fd307fff700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fd2f0066540 0x7fd2f00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.037+0000 7fd307fff700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fd2f0066540 0x7fd2f00689f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd3080c5780 tx=0x7fd2f4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:43.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.040+0000 7fd3057fa700 1 -- 172.21.15.33:0/3798367061 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7fd3080c6a40 con 0x7fd308070f60 2022-12-01T09:43:43.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.234+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd3080c6a00 con 0x7fd308070f60 2022-12-01T09:43:43.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.661+0000 7fd3057fa700 1 -- 172.21.15.33:0/3798367061 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd2fc04fe70 con 0x7fd308070f60 2022-12-01T09:43:43.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fd2f0066540 msgr2=0x7fd2f00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fd2f0066540 0x7fd2f00689f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd3080c5780 tx=0x7fd2f4009210 comp rx=0 tx=0).stop 2022-12-01T09:43:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308070f60 msgr2=0x7fd30815eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308070f60 0x7fd30815eba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c480 tx=0x7fd2fc00c790 comp rx=0 tx=0).stop 2022-12-01T09:43:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 shutdown_connections 2022-12-01T09:43:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fd2f0066540 0x7fd2f00689f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30815be80 0x7fd3080ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd308070f60 0x7fd30815eba0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 --2- 172.21.15.33:0/3798367061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd308071f60 0x7fd308157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 >> 172.21.15.33:0/3798367061 conn(0x7fd3080cb7e0 msgr2=0x7fd30815b360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 shutdown_connections 2022-12-01T09:43:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.664+0000 7fd30ecff700 1 -- 172.21.15.33:0/3798367061 wait complete. 2022-12-01T09:43:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'rbd' created 2022-12-01T09:43:43.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-12-01T09:43:43.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.804+0000 7f6ba7bed700 1 Processor -- start 2022-12-01T09:43:43.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.804+0000 7f6ba7bed700 1 -- start start 2022-12-01T09:43:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba7bed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba015c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba7bed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ba015e760 0x7f6ba0165440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba7bed700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba015d2c0 con 0x7f6ba00ce210 2022-12-01T09:43:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba7bed700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba015ce80 con 0x7f6ba015e760 2022-12-01T09:43:43.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba7bed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00ce680 con 0x7f6ba00cea70 2022-12-01T09:43:43.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba5989700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba015c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba618a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ba015e760 0x7f6ba0165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba5989700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba015c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.33:51842/0 (socket says 172.21.15.33:51842) 2022-12-01T09:43:43.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba5989700 1 -- 172.21.15.33:0/3079111108 learned_addr learned my addr 172.21.15.33:0/3079111108 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:43.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.805+0000 7f6ba5188700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6ba00ce210 0x7f6ba00cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.33:45870/0 (socket says 172.21.15.33:45870) 2022-12-01T09:43:43.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba618a700 1 -- 172.21.15.33:0/3079111108 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 msgr2=0x7f6ba015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:43.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba618a700 1 --2- 172.21.15.33:0/3079111108 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba015c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba618a700 1 -- 172.21.15.33:0/3079111108 >> v1:172.21.15.156:6789/0 conn(0x7f6ba00ce210 legacy=0x7f6ba00cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba618a700 1 -- 172.21.15.33:0/3079111108 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba015cfe0 con 0x7f6ba015e760 2022-12-01T09:43:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba4987700 1 -- 172.21.15.33:0/3079111108 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185658822 0 0) 0x7f6ba015d2c0 con 0x7f6ba00ce210 2022-12-01T09:43:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba5989700 1 --2- 172.21.15.33:0/3079111108 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba015c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba618a700 1 --2- 172.21.15.33:0/3079111108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba015e760 0x7f6ba0165440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009d90 tx=0x7f6b9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8581087f9eaa986 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba4987700 1 -- 172.21.15.33:0/3079111108 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800e070 con 0x7f6ba015e760 2022-12-01T09:43:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba4987700 1 -- 172.21.15.33:0/3079111108 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9800bb20 con 0x7f6ba015e760 2022-12-01T09:43:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba4987700 1 -- 172.21.15.33:0/3079111108 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98012430 con 0x7f6ba015e760 2022-12-01T09:43:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba7bed700 1 -- 172.21.15.33:0/3079111108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba015e760 msgr2=0x7f6ba0165440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.806+0000 7f6ba7bed700 1 --2- 172.21.15.33:0/3079111108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba015e760 0x7f6ba0165440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009d90 tx=0x7f6b9800b330 comp rx=0 tx=0).stop 2022-12-01T09:43:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.807+0000 7f6ba7bed700 1 -- 172.21.15.33:0/3079111108 shutdown_connections 2022-12-01T09:43:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.807+0000 7f6ba7bed700 1 --2- 172.21.15.33:0/3079111108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba015e760 0x7f6ba0165440 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.807+0000 7f6ba7bed700 1 --2- 172.21.15.33:0/3079111108 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba015c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.807+0000 7f6ba7bed700 1 -- 172.21.15.33:0/3079111108 >> 172.21.15.33:0/3079111108 conn(0x7f6ba006f9b0 msgr2=0x7f6ba006fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.807+0000 7f6ba7bed700 1 -- 172.21.15.33:0/3079111108 shutdown_connections 2022-12-01T09:43:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.807+0000 7f6ba7bed700 1 -- 172.21.15.33:0/3079111108 wait complete. 2022-12-01T09:43:43.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.808+0000 7f6ba7bed700 1 Processor -- start 2022-12-01T09:43:43.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.808+0000 7f6ba7bed700 1 -- start start 2022-12-01T09:43:43.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba7bed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ba00ce210 0x7f6ba0153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba7bed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba00d1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba7bed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba015e760 0x7f6ba014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba7bed700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00d16d0 con 0x7f6ba00ce210 2022-12-01T09:43:43.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba7bed700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00d0d00 con 0x7f6ba015e760 2022-12-01T09:43:43.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba7bed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00d00f0 con 0x7f6ba00cea70 2022-12-01T09:43:43.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba5989700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ba00ce210 0x7f6ba0153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba5989700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ba00ce210 0x7f6ba0153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55366/0 (socket says 172.21.15.33:55366) 2022-12-01T09:43:43.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba5989700 1 -- 172.21.15.33:0/365088599 learned_addr learned my addr 172.21.15.33:0/365088599 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:43.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba5188700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba00d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.809+0000 7f6ba618a700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba015e760 0x7f6ba014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6ba5989700 1 -- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 msgr2=0x7f6ba00d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6ba5989700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba00d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6ba5989700 1 -- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba015e760 msgr2=0x7f6ba014a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:43.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6ba5989700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba015e760 0x7f6ba014a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:43.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6ba5989700 1 -- 172.21.15.33:0/365088599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90009550 con 0x7f6ba00ce210 2022-12-01T09:43:43.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6ba5989700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ba00ce210 0x7f6ba0153a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000ec10 tx=0x7f6b9000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:43.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6b8e7fc700 1 -- 172.21.15.33:0/365088599 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000c850 con 0x7f6ba00ce210 2022-12-01T09:43:43.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6b8e7fc700 1 -- 172.21.15.33:0/365088599 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9000c9b0 con 0x7f6ba00ce210 2022-12-01T09:43:43.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6b8e7fc700 1 -- 172.21.15.33:0/365088599 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000cd40 con 0x7f6ba00ce210 2022-12-01T09:43:43.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b98009a70 con 0x7f6ba00ce210 2022-12-01T09:43:43.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.810+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba00d06b0 con 0x7f6ba00ce210 2022-12-01T09:43:43.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.811+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba0067420 con 0x7f6ba00ce210 2022-12-01T09:43:43.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.811+0000 7f6b8e7fc700 1 -- 172.21.15.33:0/365088599 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f6b90019030 con 0x7f6ba00ce210 2022-12-01T09:43:43.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.812+0000 7f6b8e7fc700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f6b80066570 0x7f6b80068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:43.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.812+0000 7f6b8e7fc700 1 -- 172.21.15.33:0/365088599 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f6b900832e0 con 0x7f6ba00ce210 2022-12-01T09:43:43.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.812+0000 7f6ba5188700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f6b80066570 0x7f6b80068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:43.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.812+0000 7f6ba5188700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f6b80066570 0x7f6b80068a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00d1c00 tx=0x7f6b9c007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:43.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:43.817+0000 7f6b8e7fc700 1 -- 172.21.15.33:0/365088599 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f6b90050db0 con 0x7f6ba00ce210 2022-12-01T09:43:44.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.008+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6ba00cc850 con 0x7f6ba00ce210 2022-12-01T09:43:44.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.665+0000 7f6b8e7fc700 1 -- 172.21.15.33:0/365088599 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6b9000cea0 con 0x7f6ba00ce210 2022-12-01T09:43:44.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f6b80066570 msgr2=0x7f6b80068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:44.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f6b80066570 0x7f6b80068a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00d1c00 tx=0x7f6b9c007e70 comp rx=0 tx=0).stop 2022-12-01T09:43:44.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ba00ce210 msgr2=0x7f6ba0153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:44.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ba00ce210 0x7f6ba0153a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000ec10 tx=0x7f6b9000ef20 comp rx=0 tx=0).stop 2022-12-01T09:43:44.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 shutdown_connections 2022-12-01T09:43:44.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f6b80066570 0x7f6b80068a20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:44.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba015e760 0x7f6ba014a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ba00ce210 0x7f6ba0153a90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 --2- 172.21.15.33:0/365088599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ba00cea70 0x7f6ba00d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 >> 172.21.15.33:0/365088599 conn(0x7f6ba006f9b0 msgr2=0x7f6ba006fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:44.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 shutdown_connections 2022-12-01T09:43:44.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.668+0000 7f6ba7bed700 1 -- 172.21.15.33:0/365088599 wait complete. 2022-12-01T09:43:44.676 INFO:teuthology.orchestra.run.smithi033.stderr:enabled application 'rbd' on pool 'rbd' 2022-12-01T09:43:44.687 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-12-01T09:43:44.688 INFO:tasks.ceph.mds.a:Restarting daemon 2022-12-01T09:43:44.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-12-01T09:43:44.691 INFO:tasks.ceph.mds.a:Started 2022-12-01T09:43:44.692 INFO:tasks.ceph.mds.c:Restarting daemon 2022-12-01T09:43:44.692 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-12-01T09:43:44.694 INFO:tasks.ceph.mds.c:Started 2022-12-01T09:43:44.695 INFO:tasks.ceph.mds.b:Restarting daemon 2022-12-01T09:43:44.695 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-12-01T09:43:44.697 INFO:tasks.ceph.mds.b:Started 2022-12-01T09:43:44.698 INFO:tasks.ceph.mds.d:Restarting daemon 2022-12-01T09:43:44.698 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-12-01T09:43:44.701 INFO:tasks.ceph.mds.d:Started 2022-12-01T09:43:44.701 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-12-01T09:43:44.702 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-12-01T09:43:44.789 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2022-12-01T09:43:44.790 INFO:tasks.ceph.mds.d.smithi156.stdout:starting mds.d at 2022-12-01T09:43:44.793 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2022-12-01T09:43:44.794 INFO:tasks.ceph.mds.b.smithi156.stdout:starting mds.b at 2022-12-01T09:43:44.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.844+0000 7f5aaebc8700 1 Processor -- start 2022-12-01T09:43:44.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.844+0000 7f5aaebc8700 1 -- start start 2022-12-01T09:43:44.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aaebc8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ce420 0x7f5aa815fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:44.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aaebc8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5aa81601f0 0x7f5aa80cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:44.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aaebc8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa815f820 con 0x7f5aa80ad990 2022-12-01T09:43:44.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aaebc8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa80add60 con 0x7f5aa81601f0 2022-12-01T09:43:44.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aaebc8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa815f4d0 con 0x7f5aa80ce420 2022-12-01T09:43:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aad165700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5aa81601f0 0x7f5aa80cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aad165700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5aa81601f0 0x7f5aa80cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55390/0 (socket says 172.21.15.33:55390) 2022-12-01T09:43:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aad165700 1 -- 172.21.15.33:0/1943825946 learned_addr learned my addr 172.21.15.33:0/1943825946 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:44.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aac964700 1 --1- 172.21.15.33:0/1943825946 >> v1:172.21.15.156:6789/0 conn(0x7f5aa80ad990 0x7f5aa815be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.33:45894/0 (socket says 172.21.15.33:45894) 2022-12-01T09:43:44.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aa7fff700 1 --2- 172.21.15.33:0/1943825946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ce420 0x7f5aa815fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:44.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aad165700 1 -- 172.21.15.33:0/1943825946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ce420 msgr2=0x7f5aa815fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:44.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aad165700 1 --2- 172.21.15.33:0/1943825946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ce420 0x7f5aa815fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:44.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aad165700 1 -- 172.21.15.33:0/1943825946 >> v1:172.21.15.156:6789/0 conn(0x7f5aa80ad990 legacy=0x7f5aa815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:44.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aad165700 1 -- 172.21.15.33:0/1943825946 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa815c730 con 0x7f5aa81601f0 2022-12-01T09:43:44.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.845+0000 7f5aa77fe700 1 -- 172.21.15.33:0/1943825946 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152388965 0 0) 0x7f5aa815f820 con 0x7f5aa80ad990 2022-12-01T09:43:44.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aad165700 1 --2- 172.21.15.33:0/1943825946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 0x7f5aa80cd2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009e50 tx=0x7f5aa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b8659e514ee520 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:44.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aa77fe700 1 -- 172.21.15.33:0/1943825946 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000e070 con 0x7f5aa81601f0 2022-12-01T09:43:44.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aa77fe700 1 -- 172.21.15.33:0/1943825946 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa000b910 con 0x7f5aa81601f0 2022-12-01T09:43:44.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aa77fe700 1 -- 172.21.15.33:0/1943825946 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000bcc0 con 0x7f5aa81601f0 2022-12-01T09:43:44.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aaebc8700 1 -- 172.21.15.33:0/1943825946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 msgr2=0x7f5aa80cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:44.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aaebc8700 1 --2- 172.21.15.33:0/1943825946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 0x7f5aa80cd2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009e50 tx=0x7f5aa000b330 comp rx=0 tx=0).stop 2022-12-01T09:43:44.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aaebc8700 1 -- 172.21.15.33:0/1943825946 shutdown_connections 2022-12-01T09:43:44.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aaebc8700 1 --2- 172.21.15.33:0/1943825946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 0x7f5aa80cd2b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:44.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aaebc8700 1 --2- 172.21.15.33:0/1943825946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ce420 0x7f5aa815fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:44.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aaebc8700 1 -- 172.21.15.33:0/1943825946 >> 172.21.15.33:0/1943825946 conn(0x7f5aa8070a30 msgr2=0x7f5aa8070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:44.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aaebc8700 1 -- 172.21.15.33:0/1943825946 shutdown_connections 2022-12-01T09:43:44.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.846+0000 7f5aaebc8700 1 -- 172.21.15.33:0/1943825946 wait complete. 2022-12-01T09:43:44.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.847+0000 7f5aaebc8700 1 Processor -- start 2022-12-01T09:43:44.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.848+0000 7f5aaebc8700 1 -- start start 2022-12-01T09:43:44.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.848+0000 7f5aaebc8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ad990 0x7f5aa81f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:44.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.848+0000 7f5aaebc8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aa80ce420 0x7f5aa80c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:44.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.848+0000 7f5aaebc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 0x7f5aa806c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:44.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.848+0000 7f5aaebc8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80c31f0 con 0x7f5aa81601f0 2022-12-01T09:43:44.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.848+0000 7f5aaebc8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80c6860 con 0x7f5aa80ce420 2022-12-01T09:43:44.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.848+0000 7f5aaebc8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80c6b40 con 0x7f5aa80ad990 2022-12-01T09:43:44.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aad165700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 0x7f5aa806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:44.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aad165700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 0x7f5aa806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55394/0 (socket says 172.21.15.33:55394) 2022-12-01T09:43:44.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aad165700 1 -- 172.21.15.33:0/3618001696 learned_addr learned my addr 172.21.15.33:0/3618001696 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:44.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aa7fff700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aa80ce420 0x7f5aa80c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:44.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aac964700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ad990 0x7f5aa81f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:44.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aad165700 1 -- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ad990 msgr2=0x7f5aa81f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:44.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aad165700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ad990 0x7f5aa81f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:44.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aad165700 1 -- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aa80ce420 msgr2=0x7f5aa80c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:44.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aad165700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aa80ce420 0x7f5aa80c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:44.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aad165700 1 -- 172.21.15.33:0/3618001696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0009b30 con 0x7f5aa81601f0 2022-12-01T09:43:44.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aa7fff700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aa80ce420 0x7f5aa80c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:43:44.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aad165700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 0x7f5aa806c630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8073100 tx=0x7f5aa0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:44.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aa57fa700 1 -- 172.21.15.33:0/3618001696 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00099b0 con 0x7f5aa81601f0 2022-12-01T09:43:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aa57fa700 1 -- 172.21.15.33:0/3618001696 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa00092e0 con 0x7f5aa81601f0 2022-12-01T09:43:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa80c6e20 con 0x7f5aa81601f0 2022-12-01T09:43:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aa57fa700 1 -- 172.21.15.33:0/3618001696 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa001c640 con 0x7f5aa81601f0 2022-12-01T09:43:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.849+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa81f4500 con 0x7f5aa81601f0 2022-12-01T09:43:44.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.850+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa815b860 con 0x7f5aa81601f0 2022-12-01T09:43:44.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.851+0000 7f5aa57fa700 1 -- 172.21.15.33:0/3618001696 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f5aa002c070 con 0x7f5aa81601f0 2022-12-01T09:43:44.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.852+0000 7f5aa57fa700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5a90066540 0x7f5a900689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:44.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.852+0000 7f5aa57fa700 1 -- 172.21.15.33:0/3618001696 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5aa0084f40 con 0x7f5aa81601f0 2022-12-01T09:43:44.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.852+0000 7f5aac964700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5a90066540 0x7f5a900689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:44.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.852+0000 7f5aac964700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5a90066540 0x7f5a900689f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c000fb0 tx=0x7f5a9c007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:44.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:44.857+0000 7f5aa57fa700 1 -- 172.21.15.33:0/3618001696 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f5aa00b5be0 con 0x7f5aa81601f0 2022-12-01T09:43:45.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.053+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5aa8072a90 con 0x7f5aa81601f0 2022-12-01T09:43:45.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.054+0000 7f5aa57fa700 1 -- 172.21.15.33:0/3618001696 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13768 (secure 0 0 0) 0x7f5aa0052990 con 0x7f5aa81601f0 2022-12-01T09:43:45.058 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:43:45.058 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":15,"fsid":"c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a","created":"2022-12-01T09:43:31.850283+0000","modified":"2022-12-01T09:43:44.659641+0000","last_up_change":"2022-12-01T09:43:42.656197+0000","last_in_change":"2022-12-01T09:43:34.438886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-12-01T09:43:43.264461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-12-01T09:43:43.355191+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b2715202-f5bd-4a04-a572-5280d5a74756","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":112288},{"type":"v1","addr":"172.21.15.33:6815","nonce":112288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":112288},{"type":"v1","addr":"172.21.15.33:6819","nonce":112288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":112288},{"type":"v1","addr":"172.21.15.33:6823","nonce":112288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":112288},{"type":"v1","addr":"172.21.15.33:6821","nonce":112288}]},"public_addr":"172.21.15.33:6815/112288","cluster_addr":"172.21.15.33:6819/112288","heartbeat_back_addr":"172.21.15.33:6823/112288","heartbeat_front_addr":"172.21.15.33:6821/112288","state":["exists","up"]},{"osd":1,"uuid":"8969a66c-e3bf-444c-a7fc-1d988d9592cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":112289},{"type":"v1","addr":"172.21.15.33:6809","nonce":112289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":112289},{"type":"v1","addr":"172.21.15.33:6811","nonce":112289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":112289},{"type":"v1","addr":"172.21.15.33:6818","nonce":112289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":112289},{"type":"v1","addr":"172.21.15.33:6813","nonce":112289}]},"public_addr":"172.21.15.33:6809/112289","cluster_addr":"172.21.15.33:6811/112289","heartbeat_back_addr":"172.21.15.33:6818/112289","heartbeat_front_addr":"172.21.15.33:6813/112289","state":["exists","up"]},{"osd":2,"uuid":"803fa135-9f54-4f34-bd0e-bc230b4dcbd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":112287},{"type":"v1","addr":"172.21.15.33:6801","nonce":112287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":112287},{"type":"v1","addr":"172.21.15.33:6803","nonce":112287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":112287},{"type":"v1","addr":"172.21.15.33:6807","nonce":112287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":112287},{"type":"v1","addr":"172.21.15.33:6805","nonce":112287}]},"public_addr":"172.21.15.33:6801/112287","cluster_addr":"172.21.15.33:6803/112287","heartbeat_back_addr":"172.21.15.33:6807/112287","heartbeat_front_addr":"172.21.15.33:6805/112287","state":["exists","up"]},{"osd":3,"uuid":"6dbfab54-3de3-4ffc-b3bb-ad03bd4be8a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":112290},{"type":"v1","addr":"172.21.15.33:6825","nonce":112290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":112290},{"type":"v1","addr":"172.21.15.33:6827","nonce":112290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":112290},{"type":"v1","addr":"172.21.15.33:6831","nonce":112290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":112290},{"type":"v1","addr":"172.21.15.33:6829","nonce":112290}]},"public_addr":"172.21.15.33:6825/112290","cluster_addr":"172.21.15.33:6827/112290","heartbeat_back_addr":"172.21.15.33:6831/112290","heartbeat_front_addr":"172.21.15.33:6829/112290","state":["exists","up"]},{"osd":4,"uuid":"019cf437-f88c-4be4-bf75-546695321962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":112449},{"type":"v1","addr":"172.21.15.156:6801","nonce":112449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":112449},{"type":"v1","addr":"172.21.15.156:6803","nonce":112449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":112449},{"type":"v1","addr":"172.21.15.156:6807","nonce":112449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":112449},{"type":"v1","addr":"172.21.15.156:6805","nonce":112449}]},"public_addr":"172.21.15.156:6801/112449","cluster_addr":"172.21.15.156:6803/112449","heartbeat_back_addr":"172.21.15.156:6807/112449","heartbeat_front_addr":"172.21.15.156:6805/112449","state":["exists","up"]},{"osd":5,"uuid":"cb41dbe1-2d9a-40f8-a237-ebd3dcc342e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":112452},{"type":"v1","addr":"172.21.15.156:6819","nonce":112452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6821","nonce":112452},{"type":"v1","addr":"172.21.15.156:6823","nonce":112452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6829","nonce":112452},{"type":"v1","addr":"172.21.15.156:6831","nonce":112452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6825","nonce":112452},{"type":"v1","addr":"172.21.15.156:6827","nonce":112452}]},"public_addr":"172.21.15.156:6819/112452","cluster_addr":"172.21.15.156:6823/112452","heartbeat_back_addr":"172.21.15.156:6831/112452","heartbeat_front_addr":"172.21.15.156:6827/112452","state":["exists","up"]},{"osd":6,"uuid":"01fd4370-1453-4fb1-b80d-61ec5a062028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":112450},{"type":"v1","addr":"172.21.15.156:6809","nonce":112450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":112450},{"type":"v1","addr":"172.21.15.156:6811","nonce":112450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":112450},{"type":"v1","addr":"172.21.15.156:6815","nonce":112450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":112450},{"type":"v1","addr":"172.21.15.156:6813","nonce":112450}]},"public_addr":"172.21.15.156:6809/112450","cluster_addr":"172.21.15.156:6811/112450","heartbeat_back_addr":"172.21.15.156:6815/112450","heartbeat_front_addr":"172.21.15.156:6813/112450","state":["exists","up"]},{"osd":7,"uuid":"411c921b-7fb3-4963-a7f7-0a1346273113","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":112451},{"type":"v1","addr":"172.21.15.156:6818","nonce":112451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":112451},{"type":"v1","addr":"172.21.15.156:6822","nonce":112451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":112451},{"type":"v1","addr":"172.21.15.156:6830","nonce":112451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":112451},{"type":"v1","addr":"172.21.15.156:6826","nonce":112451}]},"public_addr":"172.21.15.156:6818/112451","cluster_addr":"172.21.15.156:6822/112451","heartbeat_back_addr":"172.21.15.156:6830/112451","heartbeat_front_addr":"172.21.15.156:6826/112451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.669107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.609948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.589158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.626716+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.647255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.652882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.609289+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.659879+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:43:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5a90066540 msgr2=0x7f5a900689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5a90066540 0x7f5a900689f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c000fb0 tx=0x7f5a9c007bd0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 msgr2=0x7f5aa806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 0x7f5aa806c630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8073100 tx=0x7f5aa0004ad0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 shutdown_connections 2022-12-01T09:43:45.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5a90066540 0x7f5a900689f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aa81601f0 0x7f5aa806c630 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aa80ad990 0x7f5aa81f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 --2- 172.21.15.33:0/3618001696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aa80ce420 0x7f5aa80c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 >> 172.21.15.33:0/3618001696 conn(0x7f5aa8070a30 msgr2=0x7f5aa815e760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:45.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 shutdown_connections 2022-12-01T09:43:45.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.057+0000 7f5aaebc8700 1 -- 172.21.15.33:0/3618001696 wait complete. 2022-12-01T09:43:45.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-12-01T09:43:43.264461+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2022-12-01T09:43:43.355191+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-12-01T09:43:45.074 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-12-01T09:43:45.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.201+0000 7ff066966700 1 Processor -- start 2022-12-01T09:43:45.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.201+0000 7ff066966700 1 -- start start 2022-12-01T09:43:45.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff066966700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0600b3ae0 0x7ff0600b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff066966700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff06015fdc0 0x7ff06006f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff066966700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600cc950 con 0x7ff0600d1540 2022-12-01T09:43:45.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff066966700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600cc6b0 con 0x7ff0600b3ae0 2022-12-01T09:43:45.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff066966700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600ccde0 con 0x7ff06015fdc0 2022-12-01T09:43:45.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff05ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0600b3ae0 0x7ff0600b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff064f03700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff0600d1540 0x7ff06006fef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59006/0 (socket says 172.21.15.33:59006) 2022-12-01T09:43:45.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff064f03700 1 -- 172.21.15.33:0/623975569 learned_addr learned my addr 172.21.15.33:0/623975569 (peer_addr_for_me v1:172.21.15.33:0/0) 2022-12-01T09:43:45.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff05f7fe700 1 --2- 172.21.15.33:0/623975569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff06015fdc0 0x7ff06006f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff05ffff700 1 -- 172.21.15.33:0/623975569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff06015fdc0 msgr2=0x7ff06006f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:45.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff05ffff700 1 --2- 172.21.15.33:0/623975569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff06015fdc0 0x7ff06006f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff05ffff700 1 -- 172.21.15.33:0/623975569 >> v1:172.21.15.33:6789/0 conn(0x7ff0600d1540 legacy=0x7ff06006fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff05ffff700 1 -- 172.21.15.33:0/623975569 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0601602c0 con 0x7ff0600b3ae0 2022-12-01T09:43:45.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff05effd700 1 -- 172.21.15.33:0/623975569 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628275244 0 0) 0x7ff0600cc950 con 0x7ff0600d1540 2022-12-01T09:43:45.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.202+0000 7ff05ffff700 1 --2- 172.21.15.33:0/623975569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0600b3ae0 0x7ff0600b3eb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff050009840 tx=0x7ff050009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80886222f1a75b8 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:45.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff05effd700 1 -- 172.21.15.33:0/623975569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050011830 con 0x7ff0600b3ae0 2022-12-01T09:43:45.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff05effd700 1 -- 172.21.15.33:0/623975569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050011990 con 0x7ff0600b3ae0 2022-12-01T09:43:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff05effd700 1 -- 172.21.15.33:0/623975569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050011d20 con 0x7ff0600b3ae0 2022-12-01T09:43:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff066966700 1 -- 172.21.15.33:0/623975569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0600b3ae0 msgr2=0x7ff0600b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff066966700 1 --2- 172.21.15.33:0/623975569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0600b3ae0 0x7ff0600b3eb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff050009840 tx=0x7ff050009b50 comp rx=0 tx=0).stop 2022-12-01T09:43:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff066966700 1 -- 172.21.15.33:0/623975569 shutdown_connections 2022-12-01T09:43:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff066966700 1 --2- 172.21.15.33:0/623975569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0600b3ae0 0x7ff0600b3eb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff066966700 1 --2- 172.21.15.33:0/623975569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff06015fdc0 0x7ff06006f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff066966700 1 -- 172.21.15.33:0/623975569 >> 172.21.15.33:0/623975569 conn(0x7ff0600ceae0 msgr2=0x7ff0600ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff066966700 1 -- 172.21.15.33:0/623975569 shutdown_connections 2022-12-01T09:43:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.203+0000 7ff066966700 1 -- 172.21.15.33:0/623975569 wait complete. 2022-12-01T09:43:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.205+0000 7ff066966700 1 Processor -- start 2022-12-01T09:43:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.205+0000 7ff066966700 1 -- start start 2022-12-01T09:43:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff066966700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0600b3ae0 0x7ff0600cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff066966700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0600d1540 0x7ff06014d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff066966700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff06015fdc0 0x7ff0600c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff066966700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600ca500 con 0x7ff06015fdc0 2022-12-01T09:43:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff066966700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06014d830 con 0x7ff0600d1540 2022-12-01T09:43:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff066966700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600c9980 con 0x7ff0600b3ae0 2022-12-01T09:43:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff064f03700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff06015fdc0 0x7ff0600c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff064f03700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff06015fdc0 0x7ff0600c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55416/0 (socket says 172.21.15.33:55416) 2022-12-01T09:43:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff064f03700 1 -- 172.21.15.33:0/2743624415 learned_addr learned my addr 172.21.15.33:0/2743624415 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff05f7fe700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0600d1540 0x7ff06014d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff05ffff700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0600b3ae0 0x7ff0600cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff064f03700 1 -- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0600b3ae0 msgr2=0x7ff0600cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff064f03700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0600b3ae0 0x7ff0600cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff064f03700 1 -- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0600d1540 msgr2=0x7ff06014d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff064f03700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0600d1540 0x7ff06014d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff064f03700 1 -- 172.21.15.33:0/2743624415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500094a0 con 0x7ff06015fdc0 2022-12-01T09:43:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff05f7fe700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0600d1540 0x7ff06014d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:43:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff064f03700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff06015fdc0 0x7ff0600c9130 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff05800cba0 tx=0x7ff05800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.206+0000 7ff05cff9700 1 -- 172.21.15.33:0/2743624415 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800ab80 con 0x7ff06015fdc0 2022-12-01T09:43:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.207+0000 7ff05cff9700 1 -- 172.21.15.33:0/2743624415 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800ad00 con 0x7ff06015fdc0 2022-12-01T09:43:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.207+0000 7ff05cff9700 1 -- 172.21.15.33:0/2743624415 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058007310 con 0x7ff06015fdc0 2022-12-01T09:43:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.207+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0600c9c60 con 0x7ff06015fdc0 2022-12-01T09:43:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.207+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0600ca220 con 0x7ff06015fdc0 2022-12-01T09:43:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.208+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff060067420 con 0x7ff06015fdc0 2022-12-01T09:43:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.208+0000 7ff05cff9700 1 -- 172.21.15.33:0/2743624415 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7ff058010070 con 0x7ff06015fdc0 2022-12-01T09:43:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.208+0000 7ff05cff9700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7ff040066540 0x7ff0400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.209+0000 7ff05cff9700 1 -- 172.21.15.33:0/2743624415 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff058082da0 con 0x7ff06015fdc0 2022-12-01T09:43:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.213+0000 7ff05cff9700 1 -- 172.21.15.33:0/2743624415 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7ff0580507f0 con 0x7ff06015fdc0 2022-12-01T09:43:45.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.234+0000 7ff05ffff700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7ff040066540 0x7ff0400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.235+0000 7ff05ffff700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7ff040066540 0x7ff0400689f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff050009fd0 tx=0x7ff05001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:45.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.401+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff060071330 con 0x7ff06015fdc0 2022-12-01T09:43:45.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.402+0000 7ff05cff9700 1 -- 172.21.15.33:0/2743624415 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff058018070 con 0x7ff06015fdc0 2022-12-01T09:43:45.405 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 8 2022-12-01T09:43:45.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7ff040066540 msgr2=0x7ff0400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7ff040066540 0x7ff0400689f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff050009fd0 tx=0x7ff05001c040 comp rx=0 tx=0).stop 2022-12-01T09:43:45.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff06015fdc0 msgr2=0x7ff0600c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff06015fdc0 0x7ff0600c9130 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff05800cba0 tx=0x7ff05800cf60 comp rx=0 tx=0).stop 2022-12-01T09:43:45.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 shutdown_connections 2022-12-01T09:43:45.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7ff040066540 0x7ff0400689f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff06015fdc0 0x7ff0600c9130 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0600b3ae0 0x7ff0600cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 --2- 172.21.15.33:0/2743624415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0600d1540 0x7ff06014d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 >> 172.21.15.33:0/2743624415 conn(0x7ff0600ceae0 msgr2=0x7ff0600b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 shutdown_connections 2022-12-01T09:43:45.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.404+0000 7ff066966700 1 -- 172.21.15.33:0/2743624415 wait complete. 2022-12-01T09:43:45.420 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-12-01T09:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.545+0000 7f8bbc15e700 1 Processor -- start 2022-12-01T09:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.545+0000 7f8bbc15e700 1 -- start start 2022-12-01T09:43:45.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.546+0000 7f8bbc15e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8bb415be80 0x7f8bb406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.546+0000 7f8bbc15e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 0x7f8bb40723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.546+0000 7f8bbc15e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb415c250 con 0x7f8bb4070f60 2022-12-01T09:43:45.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.546+0000 7f8bbc15e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb4070b40 con 0x7f8bb415be80 2022-12-01T09:43:45.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.546+0000 7f8bbc15e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4072920 con 0x7f8bb4071f60 2022-12-01T09:43:45.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.546+0000 7f8bba6fb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 0x7f8bb40723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.546+0000 7f8bb9efa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8bb415be80 0x7f8bb406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.546+0000 7f8bb96f9700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8bb4070f60 0x7f8bb40cde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.33:45896/0 (socket says 172.21.15.33:45896) 2022-12-01T09:43:45.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.546+0000 7f8bb96f9700 1 -- 172.21.15.33:0/2585837495 learned_addr learned my addr 172.21.15.33:0/2585837495 (peer_addr_for_me v1:172.21.15.33:0/0) 2022-12-01T09:43:45.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb8ef8700 1 -- 172.21.15.33:0/2585837495 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950503993 0 0) 0x7f8ba4001110 con 0x7f8bb4070f60 2022-12-01T09:43:45.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb8ef8700 1 -- 172.21.15.33:0/2585837495 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b9c0035b0 con 0x7f8bb4070f60 2022-12-01T09:43:45.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb9efa700 1 -- 172.21.15.33:0/2585837495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 msgr2=0x7f8bb40723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:45.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb9efa700 1 --2- 172.21.15.33:0/2585837495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 0x7f8bb40723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb9efa700 1 -- 172.21.15.33:0/2585837495 >> v1:172.21.15.156:6789/0 conn(0x7f8bb4070f60 legacy=0x7f8bb40cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb9efa700 1 -- 172.21.15.33:0/2585837495 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40ce580 con 0x7f8bb415be80 2022-12-01T09:43:45.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bba6fb700 1 --2- 172.21.15.33:0/2585837495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 0x7f8bb40723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:45.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb9efa700 1 --2- 172.21.15.33:0/2585837495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 0x7f8bb406a9b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009840 tx=0x7f8bb0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c8f38a6cb95d34 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:45.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb8ef8700 1 -- 172.21.15.33:0/2585837495 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0011830 con 0x7f8bb415be80 2022-12-01T09:43:45.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb8ef8700 1 -- 172.21.15.33:0/2585837495 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb0011990 con 0x7f8bb415be80 2022-12-01T09:43:45.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.547+0000 7f8bb8ef8700 1 -- 172.21.15.33:0/2585837495 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0011d20 con 0x7f8bb415be80 2022-12-01T09:43:45.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.548+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2585837495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 msgr2=0x7f8bb406a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.548+0000 7f8bbc15e700 1 --2- 172.21.15.33:0/2585837495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 0x7f8bb406a9b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009840 tx=0x7f8bb0009b50 comp rx=0 tx=0).stop 2022-12-01T09:43:45.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.548+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2585837495 shutdown_connections 2022-12-01T09:43:45.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.548+0000 7f8bbc15e700 1 --2- 172.21.15.33:0/2585837495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 0x7f8bb40723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.548+0000 7f8bbc15e700 1 --2- 172.21.15.33:0/2585837495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 0x7f8bb406a9b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.548+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2585837495 >> 172.21.15.33:0/2585837495 conn(0x7f8bb40cb7e0 msgr2=0x7f8bb40cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.548+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2585837495 shutdown_connections 2022-12-01T09:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.548+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2585837495 wait complete. 2022-12-01T09:43:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.549+0000 7f8bbc15e700 1 Processor -- start 2022-12-01T09:43:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.549+0000 7f8bbc15e700 1 -- start start 2022-12-01T09:43:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bbc15e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb4070f60 0x7f8bb40ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bbc15e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 0x7f8bb40ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bbc15e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 0x7f8bb41e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bbc15e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41f1680 con 0x7f8bb4070f60 2022-12-01T09:43:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bbc15e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41f1960 con 0x7f8bb415be80 2022-12-01T09:43:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bbc15e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41f1c40 con 0x7f8bb4071f60 2022-12-01T09:43:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bba6fb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 0x7f8bb41e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bb96f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 0x7f8bb40ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bb9efa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb4070f60 0x7f8bb40ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bba6fb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 0x7f8bb41e5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.33:39288/0 (socket says 172.21.15.33:39288) 2022-12-01T09:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bba6fb700 1 -- 172.21.15.33:0/2238240562 learned_addr learned my addr 172.21.15.33:0/2238240562 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bba6fb700 1 -- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 msgr2=0x7f8bb40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bba6fb700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 0x7f8bb40ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bba6fb700 1 -- 172.21.15.33:0/2238240562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb4070f60 msgr2=0x7f8bb40ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bba6fb700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb4070f60 0x7f8bb40ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bba6fb700 1 -- 172.21.15.33:0/2238240562 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac009a70 con 0x7f8bb415be80 2022-12-01T09:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8bba6fb700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 0x7f8bb41e5c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00efc0 tx=0x7f8bac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.550+0000 7f8ba27fc700 1 -- 172.21.15.33:0/2238240562 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00ca90 con 0x7f8bb415be80 2022-12-01T09:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.551+0000 7f8ba27fc700 1 -- 172.21.15.33:0/2238240562 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac00f040 con 0x7f8bb415be80 2022-12-01T09:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.551+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb00094a0 con 0x7f8bb415be80 2022-12-01T09:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.551+0000 7f8ba27fc700 1 -- 172.21.15.33:0/2238240562 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00ce10 con 0x7f8bb415be80 2022-12-01T09:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.551+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb41f2200 con 0x7f8bb415be80 2022-12-01T09:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.551+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4067420 con 0x7f8bb415be80 2022-12-01T09:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.552+0000 7f8ba27fc700 1 -- 172.21.15.33:0/2238240562 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f8bac014480 con 0x7f8bb415be80 2022-12-01T09:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.553+0000 7f8ba27fc700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f8b94066540 0x7f8b940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.553+0000 7f8ba27fc700 1 -- 172.21.15.33:0/2238240562 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8bac083c30 con 0x7f8bb415be80 2022-12-01T09:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.553+0000 7f8bb9efa700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f8b94066540 0x7f8b940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.553+0000 7f8bb9efa700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f8b94066540 0x7f8b940689f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0000c00 tx=0x7f8bb0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.557+0000 7f8ba27fc700 1 -- 172.21.15.33:0/2238240562 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f8bac051590 con 0x7f8bb415be80 2022-12-01T09:43:45.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.749+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bb40af9f0 con 0x7f8bb415be80 2022-12-01T09:43:45.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.750+0000 7f8ba27fc700 1 -- 172.21.15.33:0/2238240562 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bac009d70 con 0x7f8bb415be80 2022-12-01T09:43:45.753 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2022-12-01T09:43:45.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f8b94066540 msgr2=0x7f8b940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f8b94066540 0x7f8b940689f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0000c00 tx=0x7f8bb0008030 comp rx=0 tx=0).stop 2022-12-01T09:43:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 msgr2=0x7f8bb41e5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 0x7f8bb41e5c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00efc0 tx=0x7f8bac00c3a0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 shutdown_connections 2022-12-01T09:43:45.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f8b94066540 0x7f8b940689f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb415be80 0x7f8bb41e5c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb4070f60 0x7f8bb40ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 --2- 172.21.15.33:0/2238240562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb4071f60 0x7f8bb40ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 >> 172.21.15.33:0/2238240562 conn(0x7f8bb40cb7e0 msgr2=0x7f8bb415a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:45.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 shutdown_connections 2022-12-01T09:43:45.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.752+0000 7f8bbc15e700 1 -- 172.21.15.33:0/2238240562 wait complete. 2022-12-01T09:43:45.768 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-12-01T09:43:45.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.890+0000 7f30d82c9700 1 Processor -- start 2022-12-01T09:43:45.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.890+0000 7f30d82c9700 1 -- start start 2022-12-01T09:43:45.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d82c9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f30d015bb60 0x7f30d00cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d82c9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f30d00d0370 0x7f30d00b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d82c9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d00b4f30 con 0x7f30d00d2040 2022-12-01T09:43:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d82c9700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d00d0b20 con 0x7f30d00d0370 2022-12-01T09:43:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d82c9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d00d0e00 con 0x7f30d015bb60 2022-12-01T09:43:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d6866700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f30d00d0370 0x7f30d00b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d6866700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f30d00d0370 0x7f30d00b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55432/0 (socket says 172.21.15.33:55432) 2022-12-01T09:43:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d6866700 1 -- 172.21.15.33:0/290643236 learned_addr learned my addr 172.21.15.33:0/290643236 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d5864700 1 --2- 172.21.15.33:0/290643236 >> v2:172.21.15.156:3300/0 conn(0x7f30d015bb60 0x7f30d00cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d6866700 1 -- 172.21.15.33:0/290643236 >> v2:172.21.15.156:3300/0 conn(0x7f30d015bb60 msgr2=0x7f30d00cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.891+0000 7f30d6866700 1 --2- 172.21.15.33:0/290643236 >> v2:172.21.15.156:3300/0 conn(0x7f30d015bb60 0x7f30d00cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d6866700 1 -- 172.21.15.33:0/290643236 >> v1:172.21.15.156:6789/0 conn(0x7f30d00d2040 legacy=0x7f30d00d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d6866700 1 -- 172.21.15.33:0/290643236 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d00d10e0 con 0x7f30d00d0370 2022-12-01T09:43:45.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d6866700 1 --2- 172.21.15.33:0/290643236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 0x7f30d00b56f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f30d00b4c50 tx=0x7f30c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787cac96205caad7 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:45.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d5063700 1 -- 172.21.15.33:0/290643236 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800e070 con 0x7f30d00d0370 2022-12-01T09:43:45.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d5063700 1 -- 172.21.15.33:0/290643236 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c800b910 con 0x7f30d00d0370 2022-12-01T09:43:45.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d5063700 1 -- 172.21.15.33:0/290643236 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800bcc0 con 0x7f30d00d0370 2022-12-01T09:43:45.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d82c9700 1 -- 172.21.15.33:0/290643236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 msgr2=0x7f30d00b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d82c9700 1 --2- 172.21.15.33:0/290643236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 0x7f30d00b56f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f30d00b4c50 tx=0x7f30c800b330 comp rx=0 tx=0).stop 2022-12-01T09:43:45.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d82c9700 1 -- 172.21.15.33:0/290643236 shutdown_connections 2022-12-01T09:43:45.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d82c9700 1 --2- 172.21.15.33:0/290643236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 0x7f30d00b56f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d82c9700 1 --2- 172.21.15.33:0/290643236 >> v2:172.21.15.156:3300/0 conn(0x7f30d015bb60 0x7f30d00cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d82c9700 1 -- 172.21.15.33:0/290643236 >> 172.21.15.33:0/290643236 conn(0x7f30d006f9b0 msgr2=0x7f30d006fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:45.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d82c9700 1 -- 172.21.15.33:0/290643236 shutdown_connections 2022-12-01T09:43:45.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.892+0000 7f30d82c9700 1 -- 172.21.15.33:0/290643236 wait complete. 2022-12-01T09:43:45.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d82c9700 1 Processor -- start 2022-12-01T09:43:45.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d82c9700 1 -- start start 2022-12-01T09:43:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d82c9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 0x7f30d014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d82c9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00d2040 0x7f30d00c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d82c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d015bb60 0x7f30d01e4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d82c9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d015c5e0 con 0x7f30d00d0370 2022-12-01T09:43:45.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d82c9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d015c020 con 0x7f30d00d2040 2022-12-01T09:43:45.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d82c9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d015c300 con 0x7f30d015bb60 2022-12-01T09:43:45.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d6065700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 0x7f30d014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d6065700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 0x7f30d014c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55446/0 (socket says 172.21.15.33:55446) 2022-12-01T09:43:45.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.894+0000 7f30d6065700 1 -- 172.21.15.33:0/2498906480 learned_addr learned my addr 172.21.15.33:0/2498906480 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:45.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d5864700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00d2040 0x7f30d00c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d6866700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d015bb60 0x7f30d01e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d6065700 1 -- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d015bb60 msgr2=0x7f30d01e4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d6065700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d015bb60 0x7f30d01e4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d6065700 1 -- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00d2040 msgr2=0x7f30d00c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:45.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d6065700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00d2040 0x7f30d00c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:45.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d6065700 1 -- 172.21.15.33:0/2498906480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c8009b30 con 0x7f30d00d0370 2022-12-01T09:43:45.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d5864700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00d2040 0x7f30d00c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:43:45.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d6065700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 0x7f30d014c650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c4e0 tx=0x7f30cc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:45.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30c2ffd700 1 -- 172.21.15.33:0/2498906480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0052d0 con 0x7f30d00d0370 2022-12-01T09:43:45.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30c2ffd700 1 -- 172.21.15.33:0/2498906480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc005430 con 0x7f30d00d0370 2022-12-01T09:43:45.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30c2ffd700 1 -- 172.21.15.33:0/2498906480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0038c0 con 0x7f30d00d0370 2022-12-01T09:43:45.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d0153a90 con 0x7f30d00d0370 2022-12-01T09:43:45.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.895+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d00c8de0 con 0x7f30d00d0370 2022-12-01T09:43:45.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.896+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d0067420 con 0x7f30d00d0370 2022-12-01T09:43:45.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.896+0000 7f30c2ffd700 1 -- 172.21.15.33:0/2498906480 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f30cc019030 con 0x7f30d00d0370 2022-12-01T09:43:45.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.897+0000 7f30c2ffd700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f30b0066540 0x7f30b00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:45.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.897+0000 7f30c2ffd700 1 -- 172.21.15.33:0/2498906480 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f30cc082800 con 0x7f30d00d0370 2022-12-01T09:43:45.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.897+0000 7f30d5864700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f30b0066540 0x7f30b00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:45.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.897+0000 7f30d5864700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f30b0066540 0x7f30b00689f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30d01f57f0 tx=0x7f30c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:45.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:45.901+0000 7f30c2ffd700 1 -- 172.21.15.33:0/2498906480 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f30cc0501c0 con 0x7f30d00d0370 2022-12-01T09:43:46.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.130+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30d00b51d0 con 0x7f30d00d0370 2022-12-01T09:43:46.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.130+0000 7f30c2ffd700 1 -- 172.21.15.33:0/2498906480 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f30cc017de0 con 0x7f30d00d0370 2022-12-01T09:43:46.134 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:43:46.134 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3497205517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3497205517},{"type":"v1","addr":"172.21.15.156:6835","nonce":3497205517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/3730199364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3730199364},{"type":"v1","addr":"172.21.15.33:6833","nonce":3730199364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2288150434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2288150434},{"type":"v1","addr":"172.21.15.33:6835","nonce":2288150434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/1420800162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1420800162},{"type":"v1","addr":"172.21.15.156:6837","nonce":1420800162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2022-12-01T09:43:46.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f30b0066540 msgr2=0x7f30b00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f30b0066540 0x7f30b00689f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f30d01f57f0 tx=0x7f30c4008040 comp rx=0 tx=0).stop 2022-12-01T09:43:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 msgr2=0x7f30d014c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 0x7f30d014c650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c4e0 tx=0x7f30cc00c8a0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 shutdown_connections 2022-12-01T09:43:46.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f30b0066540 0x7f30b00689f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30d015bb60 0x7f30d01e4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d00d0370 0x7f30d014c650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 --2- 172.21.15.33:0/2498906480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30d00d2040 0x7f30d00c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 >> 172.21.15.33:0/2498906480 conn(0x7f30d006f9b0 msgr2=0x7f30d00cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:46.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 shutdown_connections 2022-12-01T09:43:46.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.132+0000 7f30d82c9700 1 -- 172.21.15.33:0/2498906480 wait complete. 2022-12-01T09:43:46.138 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 3 2022-12-01T09:43:46.148 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-12-01T09:43:46.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.269+0000 7f949a43f700 1 Processor -- start 2022-12-01T09:43:46.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.269+0000 7f949a43f700 1 -- start start 2022-12-01T09:43:46.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f949a43f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 0x7f94940c5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f949a43f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9494071f60 0x7f94940723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f949a43f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94940c5c80 con 0x7f9494159580 2022-12-01T09:43:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f949a43f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9494072920 con 0x7f9494071f60 2022-12-01T09:43:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f949a43f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94940cb640 con 0x7f949406e3f0 2022-12-01T09:43:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f94989dc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9494071f60 0x7f94940723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f9493fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9494159580 0x7f949406a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59016/0 (socket says 172.21.15.33:59016) 2022-12-01T09:43:46.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f94989dc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9494071f60 0x7f94940723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55448/0 (socket says 172.21.15.33:55448) 2022-12-01T09:43:46.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f9493fff700 1 -- 172.21.15.33:0/3761065519 learned_addr learned my addr 172.21.15.33:0/3761065519 (peer_addr_for_me v1:172.21.15.33:0/0) 2022-12-01T09:43:46.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f94937fe700 1 --2- 172.21.15.33:0/3761065519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 0x7f94940c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f94989dc700 1 -- 172.21.15.33:0/3761065519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 msgr2=0x7f94940c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:46.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f94989dc700 1 --2- 172.21.15.33:0/3761065519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 0x7f94940c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f94989dc700 1 -- 172.21.15.33:0/3761065519 >> v1:172.21.15.33:6789/0 conn(0x7f9494159580 legacy=0x7f949406a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f94989dc700 1 -- 172.21.15.33:0/3761065519 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949406e860 con 0x7f9494071f60 2022-12-01T09:43:46.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f9492ffd700 1 -- 172.21.15.33:0/3761065519 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522885311 0 0) 0x7f9484001110 con 0x7f9494159580 2022-12-01T09:43:46.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f94989dc700 1 --2- 172.21.15.33:0/3761065519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 0x7f94940723e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f948c009d90 tx=0x7f948c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5d9eb57b4815e5 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:46.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f9492ffd700 1 -- 172.21.15.33:0/3761065519 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00e070 con 0x7f9494071f60 2022-12-01T09:43:46.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f9492ffd700 1 -- 172.21.15.33:0/3761065519 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c00bb20 con 0x7f9494071f60 2022-12-01T09:43:46.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.270+0000 7f9492ffd700 1 -- 172.21.15.33:0/3761065519 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c012430 con 0x7f9494071f60 2022-12-01T09:43:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.271+0000 7f949a43f700 1 -- 172.21.15.33:0/3761065519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 msgr2=0x7f94940723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.271+0000 7f949a43f700 1 --2- 172.21.15.33:0/3761065519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 0x7f94940723e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f948c009d90 tx=0x7f948c00b330 comp rx=0 tx=0).stop 2022-12-01T09:43:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.271+0000 7f949a43f700 1 -- 172.21.15.33:0/3761065519 shutdown_connections 2022-12-01T09:43:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.271+0000 7f949a43f700 1 --2- 172.21.15.33:0/3761065519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 0x7f94940723e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.271+0000 7f949a43f700 1 --2- 172.21.15.33:0/3761065519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 0x7f94940c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.271+0000 7f949a43f700 1 -- 172.21.15.33:0/3761065519 >> 172.21.15.33:0/3761065519 conn(0x7f94940cb7f0 msgr2=0x7f94940cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.271+0000 7f949a43f700 1 -- 172.21.15.33:0/3761065519 shutdown_connections 2022-12-01T09:43:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.271+0000 7f949a43f700 1 -- 172.21.15.33:0/3761065519 wait complete. 2022-12-01T09:43:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.272+0000 7f949a43f700 1 Processor -- start 2022-12-01T09:43:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.272+0000 7f949a43f700 1 -- start start 2022-12-01T09:43:46.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f949a43f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 0x7f94941456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f949a43f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 0x7f9494151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f949a43f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494159580 0x7f9494151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f949a43f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94941eecf0 con 0x7f9494071f60 2022-12-01T09:43:46.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f949a43f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9494145bf0 con 0x7f9494159580 2022-12-01T09:43:46.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f949a43f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949415a1d0 con 0x7f949406e3f0 2022-12-01T09:43:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f94937fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 0x7f9494151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f94937fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 0x7f9494151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55454/0 (socket says 172.21.15.33:55454) 2022-12-01T09:43:46.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f94937fe700 1 -- 172.21.15.33:0/4228322988 learned_addr learned my addr 172.21.15.33:0/4228322988 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:46.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f9493fff700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 0x7f94941456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f94989dc700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494159580 0x7f9494151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f94937fe700 1 -- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 msgr2=0x7f94941456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.273+0000 7f94937fe700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 0x7f94941456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.274+0000 7f94937fe700 1 -- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494159580 msgr2=0x7f9494151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.274+0000 7f94937fe700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494159580 0x7f9494151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.274+0000 7f94937fe700 1 -- 172.21.15.33:0/4228322988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c009a70 con 0x7f9494071f60 2022-12-01T09:43:46.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.274+0000 7f94937fe700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 0x7f9494151690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f948800e9b0 tx=0x7f948800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:46.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.274+0000 7f9490ff9700 1 -- 172.21.15.33:0/4228322988 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488009710 con 0x7f9494071f60 2022-12-01T09:43:46.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.274+0000 7f9490ff9700 1 -- 172.21.15.33:0/4228322988 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948800ee50 con 0x7f9494071f60 2022-12-01T09:43:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.274+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9494152200 con 0x7f9494071f60 2022-12-01T09:43:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.274+0000 7f9490ff9700 1 -- 172.21.15.33:0/4228322988 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800c9f0 con 0x7f9494071f60 2022-12-01T09:43:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.274+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9494159b80 con 0x7f9494071f60 2022-12-01T09:43:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.275+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949415a340 con 0x7f9494071f60 2022-12-01T09:43:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.275+0000 7f9490ff9700 1 -- 172.21.15.33:0/4228322988 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7f9488019030 con 0x7f9494071f60 2022-12-01T09:43:46.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.276+0000 7f9490ff9700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9474066540 0x7f94740689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.276+0000 7f9490ff9700 1 -- 172.21.15.33:0/4228322988 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9488083170 con 0x7f9494071f60 2022-12-01T09:43:46.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.276+0000 7f9493fff700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9474066540 0x7f94740689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.276+0000 7f9493fff700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9474066540 0x7f94740689f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9484000f60 tx=0x7f9484007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.280+0000 7f9490ff9700 1 -- 172.21.15.33:0/4228322988 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f9488050c20 con 0x7f9494071f60 2022-12-01T09:43:46.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.316+0000 7f9490ff9700 1 -- 172.21.15.33:0/4228322988 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f9488050ff0 con 0x7f9494071f60 2022-12-01T09:43:46.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.471+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9494067420 con 0x7f9494071f60 2022-12-01T09:43:46.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.471+0000 7f9490ff9700 1 -- 172.21.15.33:0/4228322988 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13742 (secure 0 0 0) 0x7f948805d7f0 con 0x7f9494071f60 2022-12-01T09:43:46.475 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:43:46.475 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"fsid":"c3d5dea1-bb1d-49ac-b6bb-0512d6409e9a","created":"2022-12-01T09:43:31.850283+0000","modified":"2022-12-01T09:43:45.668836+0000","last_up_change":"2022-12-01T09:43:42.656197+0000","last_in_change":"2022-12-01T09:43:34.438886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-12-01T09:43:43.264461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-12-01T09:43:43.355191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b2715202-f5bd-4a04-a572-5280d5a74756","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":112288},{"type":"v1","addr":"172.21.15.33:6815","nonce":112288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":112288},{"type":"v1","addr":"172.21.15.33:6819","nonce":112288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":112288},{"type":"v1","addr":"172.21.15.33:6823","nonce":112288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":112288},{"type":"v1","addr":"172.21.15.33:6821","nonce":112288}]},"public_addr":"172.21.15.33:6815/112288","cluster_addr":"172.21.15.33:6819/112288","heartbeat_back_addr":"172.21.15.33:6823/112288","heartbeat_front_addr":"172.21.15.33:6821/112288","state":["exists","up"]},{"osd":1,"uuid":"8969a66c-e3bf-444c-a7fc-1d988d9592cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":112289},{"type":"v1","addr":"172.21.15.33:6809","nonce":112289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":112289},{"type":"v1","addr":"172.21.15.33:6811","nonce":112289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":112289},{"type":"v1","addr":"172.21.15.33:6818","nonce":112289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":112289},{"type":"v1","addr":"172.21.15.33:6813","nonce":112289}]},"public_addr":"172.21.15.33:6809/112289","cluster_addr":"172.21.15.33:6811/112289","heartbeat_back_addr":"172.21.15.33:6818/112289","heartbeat_front_addr":"172.21.15.33:6813/112289","state":["exists","up"]},{"osd":2,"uuid":"803fa135-9f54-4f34-bd0e-bc230b4dcbd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":112287},{"type":"v1","addr":"172.21.15.33:6801","nonce":112287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":112287},{"type":"v1","addr":"172.21.15.33:6803","nonce":112287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":112287},{"type":"v1","addr":"172.21.15.33:6807","nonce":112287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":112287},{"type":"v1","addr":"172.21.15.33:6805","nonce":112287}]},"public_addr":"172.21.15.33:6801/112287","cluster_addr":"172.21.15.33:6803/112287","heartbeat_back_addr":"172.21.15.33:6807/112287","heartbeat_front_addr":"172.21.15.33:6805/112287","state":["exists","up"]},{"osd":3,"uuid":"6dbfab54-3de3-4ffc-b3bb-ad03bd4be8a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":112290},{"type":"v1","addr":"172.21.15.33:6825","nonce":112290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":112290},{"type":"v1","addr":"172.21.15.33:6827","nonce":112290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":112290},{"type":"v1","addr":"172.21.15.33:6831","nonce":112290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":112290},{"type":"v1","addr":"172.21.15.33:6829","nonce":112290}]},"public_addr":"172.21.15.33:6825/112290","cluster_addr":"172.21.15.33:6827/112290","heartbeat_back_addr":"172.21.15.33:6831/112290","heartbeat_front_addr":"172.21.15.33:6829/112290","state":["exists","up"]},{"osd":4,"uuid":"019cf437-f88c-4be4-bf75-546695321962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":112449},{"type":"v1","addr":"172.21.15.156:6801","nonce":112449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":112449},{"type":"v1","addr":"172.21.15.156:6803","nonce":112449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":112449},{"type":"v1","addr":"172.21.15.156:6807","nonce":112449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":112449},{"type":"v1","addr":"172.21.15.156:6805","nonce":112449}]},"public_addr":"172.21.15.156:6801/112449","cluster_addr":"172.21.15.156:6803/112449","heartbeat_back_addr":"172.21.15.156:6807/112449","heartbeat_front_addr":"172.21.15.156:6805/112449","state":["exists","up"]},{"osd":5,"uuid":"cb41dbe1-2d9a-40f8-a237-ebd3dcc342e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":112452},{"type":"v1","addr":"172.21.15.156:6819","nonce":112452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6821","nonce":112452},{"type":"v1","addr":"172.21.15.156:6823","nonce":112452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6829","nonce":112452},{"type":"v1","addr":"172.21.15.156:6831","nonce":112452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6825","nonce":112452},{"type":"v1","addr":"172.21.15.156:6827","nonce":112452}]},"public_addr":"172.21.15.156:6819/112452","cluster_addr":"172.21.15.156:6823/112452","heartbeat_back_addr":"172.21.15.156:6831/112452","heartbeat_front_addr":"172.21.15.156:6827/112452","state":["exists","up"]},{"osd":6,"uuid":"01fd4370-1453-4fb1-b80d-61ec5a062028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":112450},{"type":"v1","addr":"172.21.15.156:6809","nonce":112450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":112450},{"type":"v1","addr":"172.21.15.156:6811","nonce":112450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":112450},{"type":"v1","addr":"172.21.15.156:6815","nonce":112450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":112450},{"type":"v1","addr":"172.21.15.156:6813","nonce":112450}]},"public_addr":"172.21.15.156:6809/112450","cluster_addr":"172.21.15.156:6811/112450","heartbeat_back_addr":"172.21.15.156:6815/112450","heartbeat_front_addr":"172.21.15.156:6813/112450","state":["exists","up"]},{"osd":7,"uuid":"411c921b-7fb3-4963-a7f7-0a1346273113","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":112451},{"type":"v1","addr":"172.21.15.156:6818","nonce":112451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":112451},{"type":"v1","addr":"172.21.15.156:6822","nonce":112451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":112451},{"type":"v1","addr":"172.21.15.156:6830","nonce":112451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":112451},{"type":"v1","addr":"172.21.15.156:6826","nonce":112451}]},"public_addr":"172.21.15.156:6818/112451","cluster_addr":"172.21.15.156:6822/112451","heartbeat_back_addr":"172.21.15.156:6830/112451","heartbeat_front_addr":"172.21.15.156:6826/112451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.669107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.609948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.589158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.626716+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.647255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.652882+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.609289+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-12-01T09:43:39.659879+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-12-01T09:43:46.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9474066540 msgr2=0x7f94740689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9474066540 0x7f94740689f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9484000f60 tx=0x7f9484007e70 comp rx=0 tx=0).stop 2022-12-01T09:43:46.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 msgr2=0x7f9494151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 0x7f9494151690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f948800e9b0 tx=0x7f948800ecc0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 shutdown_connections 2022-12-01T09:43:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9474066540 0x7f94740689f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494159580 0x7f9494151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949406e3f0 0x7f94941456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 --2- 172.21.15.33:0/4228322988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9494071f60 0x7f9494151690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.473+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 >> 172.21.15.33:0/4228322988 conn(0x7f94940cb7f0 msgr2=0x7f94940b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.474+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 shutdown_connections 2022-12-01T09:43:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.474+0000 7f949a43f700 1 -- 172.21.15.33:0/4228322988 wait complete. 2022-12-01T09:43:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-12-01T09:43:43.264461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2022-12-01T09:43:43.355191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-12-01T09:43:46.489 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-12-01T09:43:46.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.613+0000 7f2510e29700 1 Processor -- start 2022-12-01T09:43:46.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.613+0000 7f2510e29700 1 -- start start 2022-12-01T09:43:46.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.614+0000 7f2510e29700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f250c0cd2b0 0x7f250c0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.614+0000 7f2510e29700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c15f820 con 0x7f250c0ad990 2022-12-01T09:43:46.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.614+0000 7f2510e29700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c0cdc30 con 0x7f250c0ce420 2022-12-01T09:43:46.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.614+0000 7f2510e29700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250c0add60 con 0x7f250c0cd2b0 2022-12-01T09:43:46.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.614+0000 7f250a59c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f250c0ad990 0x7f250c15be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59024/0 (socket says 172.21.15.33:59024) 2022-12-01T09:43:46.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.614+0000 7f250a59c700 1 -- 172.21.15.33:0/2067899876 learned_addr learned my addr 172.21.15.33:0/2067899876 (peer_addr_for_me v1:172.21.15.33:0/0) 2022-12-01T09:43:46.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250ad9d700 1 --2- 172.21.15.33:0/2067899876 >> v2:172.21.15.156:3300/0 conn(0x7f250c0cd2b0 0x7f250c0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350546085 0 0) 0x7f250c15f820 con 0x7f250c0ad990 2022-12-01T09:43:46.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24ec0035b0 con 0x7f250c0ad990 2022-12-01T09:43:46.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 137716064 0 0) 0x7f24ec0035b0 con 0x7f250c0ad990 2022-12-01T09:43:46.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 >> v2:172.21.15.156:3300/0 conn(0x7f250c0cd2b0 msgr2=0x7f250c0cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 --2- 172.21.15.33:0/2067899876 >> v2:172.21.15.156:3300/0 conn(0x7f250c0cd2b0 0x7f250c0cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 >> v1:172.21.15.156:6789/0 conn(0x7f250c0ce420 legacy=0x7f250c15fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c15f4d0 con 0x7f250c0ad990 2022-12-01T09:43:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3904297037 0 0) 0x7f24fc0017f0 con 0x7f250c0ad990 2022-12-01T09:43:46.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 >> v1:172.21.15.33:6789/0 conn(0x7f250c0ad990 legacy=0x7f250c15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24ec003a00 0x7f24ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24ec0043f0 0x7f24ec0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24ec0050b0 0x7f24ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0add60 con 0x7f24ec003a00 2022-12-01T09:43:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec00c000 con 0x7f24ec0043f0 2022-12-01T09:43:46.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec00c1c0 con 0x7f24ec0050b0 2022-12-01T09:43:46.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250ad9d700 1 --2- 172.21.15.33:0/2067899876 >> v2:172.21.15.156:3300/0 conn(0x7f250c0cd2b0 0x7f250c0cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:46.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250a59c700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24ec003a00 0x7f24ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f2509d9b700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24ec0043f0 0x7f24ec0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250ad9d700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24ec0050b0 0x7f24ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250a59c700 1 -- 172.21.15.33:0/2067899876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24ec0050b0 msgr2=0x7f24ec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:46.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250a59c700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24ec0050b0 0x7f24ec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250a59c700 1 -- 172.21.15.33:0/2067899876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24ec0043f0 msgr2=0x7f24ec0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250a59c700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24ec0043f0 0x7f24ec0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250a59c700 1 -- 172.21.15.33:0/2067899876 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0035b0 con 0x7f24ec003a00 2022-12-01T09:43:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250ad9d700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24ec0050b0 0x7f24ec00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-12-01T09:43:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.615+0000 7f250ad9d700 1 -- 172.21.15.33:0/2067899876 reap_dead start 2022-12-01T09:43:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f250a59c700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24ec003a00 0x7f24ec003dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00c240 tx=0x7f24ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5beda875afe87901 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00cde0 con 0x7f24ec003a00 2022-12-01T09:43:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc0070d0 con 0x7f24ec003a00 2022-12-01T09:43:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f250959a700 1 -- 172.21.15.33:0/2067899876 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc007480 con 0x7f24ec003a00 2022-12-01T09:43:46.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f2510e29700 1 -- 172.21.15.33:0/2067899876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24ec003a00 msgr2=0x7f24ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f2510e29700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24ec003a00 0x7f24ec003dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00c240 tx=0x7f24ec005880 comp rx=0 tx=0).stop 2022-12-01T09:43:46.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f2510e29700 1 -- 172.21.15.33:0/2067899876 shutdown_connections 2022-12-01T09:43:46.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f2510e29700 1 --2- 172.21.15.33:0/2067899876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24ec003a00 0x7f24ec003dd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f2510e29700 1 -- 172.21.15.33:0/2067899876 >> 172.21.15.33:0/2067899876 conn(0x7f250c070a30 msgr2=0x7f250c070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:46.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f2510e29700 1 -- 172.21.15.33:0/2067899876 shutdown_connections 2022-12-01T09:43:46.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.616+0000 7f2510e29700 1 -- 172.21.15.33:0/2067899876 wait complete. 2022-12-01T09:43:46.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.618+0000 7f2510e29700 1 Processor -- start 2022-12-01T09:43:46.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.618+0000 7f2510e29700 1 -- start start 2022-12-01T09:43:46.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2510e29700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24ec003a00 0x7f250c097340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2510e29700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f250c151c80 0x7f250c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2510e29700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f250c159eb0 0x7f250c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2510e29700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0c2c50 con 0x7f250c151c80 2022-12-01T09:43:46.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2510e29700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c15a860 con 0x7f24ec003a00 2022-12-01T09:43:46.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2510e29700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c15afd0 con 0x7f250c159eb0 2022-12-01T09:43:46.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2509d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f250c151c80 0x7f250c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2509d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f250c151c80 0x7f250c15aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55464/0 (socket says 172.21.15.33:55464) 2022-12-01T09:43:46.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2509d9b700 1 -- 172.21.15.33:0/3828559637 learned_addr learned my addr 172.21.15.33:0/3828559637 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:46.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f250a59c700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24ec003a00 0x7f250c097340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f250ad9d700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f250c159eb0 0x7f250c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2509d9b700 1 -- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f250c159eb0 msgr2=0x7f250c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2509d9b700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f250c159eb0 0x7f250c15a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2509d9b700 1 -- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24ec003a00 msgr2=0x7f250c097340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2509d9b700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24ec003a00 0x7f250c097340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2509d9b700 1 -- 172.21.15.33:0/3828559637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c1520f0 con 0x7f250c151c80 2022-12-01T09:43:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f250ad9d700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f250c159eb0 0x7f250c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:43:46.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2509d9b700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f250c151c80 0x7f250c15aa90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24f400e650 tx=0x7f24f400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:46.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2502ffd700 1 -- 172.21.15.33:0/3828559637 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40052e0 con 0x7f250c151c80 2022-12-01T09:43:46.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2502ffd700 1 -- 172.21.15.33:0/3828559637 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f4005440 con 0x7f250c151c80 2022-12-01T09:43:46.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c0c1fd0 con 0x7f250c151c80 2022-12-01T09:43:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2502ffd700 1 -- 172.21.15.33:0/3828559637 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40038c0 con 0x7f250c151c80 2022-12-01T09:43:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.619+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c0c2590 con 0x7f250c151c80 2022-12-01T09:43:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.620+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c067420 con 0x7f250c151c80 2022-12-01T09:43:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.621+0000 7f2502ffd700 1 -- 172.21.15.33:0/3828559637 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f24f401b030 con 0x7f250c151c80 2022-12-01T09:43:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.621+0000 7f2502ffd700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f24f0066590 0x7f24f0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.621+0000 7f2502ffd700 1 -- 172.21.15.33:0/3828559637 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f24f4082ac0 con 0x7f250c151c80 2022-12-01T09:43:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.621+0000 7f250a59c700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f24f0066590 0x7f24f0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.622+0000 7f250a59c700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f24f0066590 0x7f24f0068a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000c00 tx=0x7f24fc007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.626+0000 7f2502ffd700 1 -- 172.21.15.33:0/3828559637 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f24f40505e0 con 0x7f250c151c80 2022-12-01T09:43:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.815+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f250c15c730 con 0x7f250c151c80 2022-12-01T09:43:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.815+0000 7f2502ffd700 1 -- 172.21.15.33:0/3828559637 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f24f40190a0 con 0x7f250c151c80 2022-12-01T09:43:46.819 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 8 2022-12-01T09:43:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f24f0066590 msgr2=0x7f24f0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f24f0066590 0x7f24f0068a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000c00 tx=0x7f24fc007000 comp rx=0 tx=0).stop 2022-12-01T09:43:46.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f250c151c80 msgr2=0x7f250c15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f250c151c80 0x7f250c15aa90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24f400e650 tx=0x7f24f400e960 comp rx=0 tx=0).stop 2022-12-01T09:43:46.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 shutdown_connections 2022-12-01T09:43:46.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f24f0066590 0x7f24f0068a40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24ec003a00 0x7f250c097340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f250c159eb0 0x7f250c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 --2- 172.21.15.33:0/3828559637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f250c151c80 0x7f250c15aa90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 >> 172.21.15.33:0/3828559637 conn(0x7f250c070a30 msgr2=0x7f250c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 shutdown_connections 2022-12-01T09:43:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.817+0000 7f2510e29700 1 -- 172.21.15.33:0/3828559637 wait complete. 2022-12-01T09:43:46.833 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-12-01T09:43:46.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.957+0000 7f5f19b7d700 1 Processor -- start 2022-12-01T09:43:46.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.957+0000 7f5f19b7d700 1 -- start start 2022-12-01T09:43:46.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f19b7d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5f140d2040 0x7f5f140d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f19b7d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f140d0540 0x7f5f140b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f19b7d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f140b4f30 con 0x7f5f1415bb60 2022-12-01T09:43:46.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f19b7d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140d2950 con 0x7f5f140d2040 2022-12-01T09:43:46.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f19b7d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140d0b20 con 0x7f5f140d0540 2022-12-01T09:43:46.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f137fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5f140d2040 0x7f5f140d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f12ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5f1415bb60 0x7f5f140cfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59026/0 (socket says 172.21.15.33:59026) 2022-12-01T09:43:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f12ffd700 1 -- 172.21.15.33:0/3954395633 learned_addr learned my addr 172.21.15.33:0/3954395633 (peer_addr_for_me v1:172.21.15.33:0/0) 2022-12-01T09:43:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f13fff700 1 --2- 172.21.15.33:0/3954395633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f140d0540 0x7f5f140b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f137fe700 1 -- 172.21.15.33:0/3954395633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f140d0540 msgr2=0x7f5f140b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f137fe700 1 --2- 172.21.15.33:0/3954395633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f140d0540 0x7f5f140b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f137fe700 1 -- 172.21.15.33:0/3954395633 >> v1:172.21.15.33:6789/0 conn(0x7f5f1415bb60 legacy=0x7f5f140cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f127fc700 1 -- 172.21.15.33:0/3954395633 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338403833 0 0) 0x7f5f140b4f30 con 0x7f5f1415bb60 2022-12-01T09:43:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f137fe700 1 -- 172.21.15.33:0/3954395633 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140d0e00 con 0x7f5f140d2040 2022-12-01T09:43:46.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f137fe700 1 --2- 172.21.15.33:0/3954395633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d2040 0x7f5f140d2410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009d90 tx=0x7f5f0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e54c3ef84cfcaa server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:46.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f127fc700 1 -- 172.21.15.33:0/3954395633 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400e070 con 0x7f5f140d2040 2022-12-01T09:43:46.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f127fc700 1 -- 172.21.15.33:0/3954395633 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0400bbd0 con 0x7f5f140d2040 2022-12-01T09:43:46.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.958+0000 7f5f127fc700 1 -- 172.21.15.33:0/3954395633 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04012430 con 0x7f5f140d2040 2022-12-01T09:43:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.959+0000 7f5f19b7d700 1 -- 172.21.15.33:0/3954395633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d2040 msgr2=0x7f5f140d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.959+0000 7f5f19b7d700 1 --2- 172.21.15.33:0/3954395633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d2040 0x7f5f140d2410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009d90 tx=0x7f5f0400b330 comp rx=0 tx=0).stop 2022-12-01T09:43:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.959+0000 7f5f19b7d700 1 -- 172.21.15.33:0/3954395633 shutdown_connections 2022-12-01T09:43:46.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.959+0000 7f5f19b7d700 1 --2- 172.21.15.33:0/3954395633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f140d0540 0x7f5f140b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.959+0000 7f5f19b7d700 1 --2- 172.21.15.33:0/3954395633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d2040 0x7f5f140d2410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.959+0000 7f5f19b7d700 1 -- 172.21.15.33:0/3954395633 >> 172.21.15.33:0/3954395633 conn(0x7f5f1406f9b0 msgr2=0x7f5f1406fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:46.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.959+0000 7f5f19b7d700 1 -- 172.21.15.33:0/3954395633 shutdown_connections 2022-12-01T09:43:46.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.959+0000 7f5f19b7d700 1 -- 172.21.15.33:0/3954395633 wait complete. 2022-12-01T09:43:46.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.960+0000 7f5f19b7d700 1 Processor -- start 2022-12-01T09:43:46.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.960+0000 7f5f19b7d700 1 -- start start 2022-12-01T09:43:46.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f19b7d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d0540 0x7f5f14155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f19b7d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f140d2040 0x7f5f140c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f19b7d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f1415bb60 0x7f5f140caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f19b7d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140c9b00 con 0x7f5f140d0540 2022-12-01T09:43:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f19b7d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140c9de0 con 0x7f5f140d2040 2022-12-01T09:43:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f19b7d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140ca0c0 con 0x7f5f1415bb60 2022-12-01T09:43:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d0540 0x7f5f14155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d0540 0x7f5f14155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55486/0 (socket says 172.21.15.33:55486) 2022-12-01T09:43:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f137fe700 1 -- 172.21.15.33:0/199246544 learned_addr learned my addr 172.21.15.33:0/199246544 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f13fff700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f1415bb60 0x7f5f140caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f12ffd700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f140d2040 0x7f5f140c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f137fe700 1 -- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f1415bb60 msgr2=0x7f5f140caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f137fe700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f1415bb60 0x7f5f140caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f137fe700 1 -- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f140d2040 msgr2=0x7f5f140c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f137fe700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f140d2040 0x7f5f140c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.961+0000 7f5f137fe700 1 -- 172.21.15.33:0/199246544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f04009a70 con 0x7f5f140d0540 2022-12-01T09:43:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.962+0000 7f5f137fe700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d0540 0x7f5f14155860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f04014040 tx=0x7f5f04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.962+0000 7f5efbfff700 1 -- 172.21.15.33:0/199246544 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04012430 con 0x7f5f140d0540 2022-12-01T09:43:46.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.962+0000 7f5efbfff700 1 -- 172.21.15.33:0/199246544 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04020070 con 0x7f5f140d0540 2022-12-01T09:43:46.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.962+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f140ca3a0 con 0x7f5f140d0540 2022-12-01T09:43:46.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.962+0000 7f5efbfff700 1 -- 172.21.15.33:0/199246544 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04012ea0 con 0x7f5f140d0540 2022-12-01T09:43:46.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.962+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f14147ac0 con 0x7f5f140d0540 2022-12-01T09:43:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.963+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f140ca860 con 0x7f5f140d0540 2022-12-01T09:43:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.963+0000 7f5efbfff700 1 -- 172.21.15.33:0/199246544 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f5f04004280 con 0x7f5f140d0540 2022-12-01T09:43:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.964+0000 7f5efbfff700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5ef4066590 0x7f5ef4068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.964+0000 7f5efbfff700 1 -- 172.21.15.33:0/199246544 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5f04022070 con 0x7f5f140d0540 2022-12-01T09:43:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.964+0000 7f5f12ffd700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5ef4066590 0x7f5ef4068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.964+0000 7f5f12ffd700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5ef4066590 0x7f5ef4068a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f140ccd40 tx=0x7f5f08007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:46.968+0000 7f5efbfff700 1 -- 172.21.15.33:0/199246544 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f5f04053340 con 0x7f5f140d0540 2022-12-01T09:43:47.115 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-12-01T09:43:47.118 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-12-01T09:43:47.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.156+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f14067420 con 0x7f5f140d0540 2022-12-01T09:43:47.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.156+0000 7f5efbfff700 1 -- 172.21.15.33:0/199246544 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f04056960 con 0x7f5f140d0540 2022-12-01T09:43:47.160 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2022-12-01T09:43:47.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5ef4066590 msgr2=0x7f5ef4068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5ef4066590 0x7f5ef4068a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f140ccd40 tx=0x7f5f08007e70 comp rx=0 tx=0).stop 2022-12-01T09:43:47.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d0540 msgr2=0x7f5f14155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d0540 0x7f5f14155860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f04014040 tx=0x7f5f04004ad0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 shutdown_connections 2022-12-01T09:43:47.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f5ef4066590 0x7f5ef4068a40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f1415bb60 0x7f5f140caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f140d0540 0x7f5f14155860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 --2- 172.21.15.33:0/199246544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f140d2040 0x7f5f140c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 >> 172.21.15.33:0/199246544 conn(0x7f5f1406f9b0 msgr2=0x7f5f140b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:47.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 shutdown_connections 2022-12-01T09:43:47.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.158+0000 7f5f19b7d700 1 -- 172.21.15.33:0/199246544 wait complete. 2022-12-01T09:43:47.174 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-12-01T09:43:47.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.335+0000 7fbb2a6ae700 1 Processor -- start 2022-12-01T09:43:47.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.335+0000 7fbb2a6ae700 1 -- start start 2022-12-01T09:43:47.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb2a6ae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 0x7fbb2415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb2a6ae700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbb240cd3b0 0x7fbb2406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb2a6ae700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2415d2c0 con 0x7fbb2406aaf0 2022-12-01T09:43:47.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb2a6ae700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb24069510 con 0x7fbb240cd3b0 2022-12-01T09:43:47.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb2a6ae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240697f0 con 0x7fbb24158970 2022-12-01T09:43:47.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb237fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbb240cd3b0 0x7fbb2406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb237fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbb240cd3b0 0x7fbb2406a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55488/0 (socket says 172.21.15.33:55488) 2022-12-01T09:43:47.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb237fe700 1 -- 172.21.15.33:0/14410555 learned_addr learned my addr 172.21.15.33:0/14410555 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:47.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb23fff700 1 --2- 172.21.15.33:0/14410555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 0x7fbb2415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb237fe700 1 -- 172.21.15.33:0/14410555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 msgr2=0x7fbb2415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb237fe700 1 --2- 172.21.15.33:0/14410555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 0x7fbb2415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb237fe700 1 -- 172.21.15.33:0/14410555 >> v1:172.21.15.156:6789/0 conn(0x7fbb2406aaf0 legacy=0x7fbb2406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb237fe700 1 -- 172.21.15.33:0/14410555 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb24069ad0 con 0x7fbb240cd3b0 2022-12-01T09:43:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb237fe700 1 --2- 172.21.15.33:0/14410555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 0x7fbb2406a5b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00bb90 tx=0x7fbb0c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a948d0ad356c18 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.336+0000 7fbb22ffd700 1 -- 172.21.15.33:0/14410555 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00dd10 con 0x7fbb240cd3b0 2022-12-01T09:43:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb22ffd700 1 -- 172.21.15.33:0/14410555 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c00de70 con 0x7fbb240cd3b0 2022-12-01T09:43:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb22ffd700 1 -- 172.21.15.33:0/14410555 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c004230 con 0x7fbb240cd3b0 2022-12-01T09:43:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/14410555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 msgr2=0x7fbb2406a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb2a6ae700 1 --2- 172.21.15.33:0/14410555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 0x7fbb2406a5b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00bb90 tx=0x7fbb0c00bea0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/14410555 shutdown_connections 2022-12-01T09:43:47.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb2a6ae700 1 --2- 172.21.15.33:0/14410555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 0x7fbb2415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb2a6ae700 1 --2- 172.21.15.33:0/14410555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 0x7fbb2406a5b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/14410555 >> 172.21.15.33:0/14410555 conn(0x7fbb240cb7e0 msgr2=0x7fbb240cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:47.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/14410555 shutdown_connections 2022-12-01T09:43:47.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.337+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/14410555 wait complete. 2022-12-01T09:43:47.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.339+0000 7fbb2a6ae700 1 Processor -- start 2022-12-01T09:43:47.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.339+0000 7fbb2a6ae700 1 -- start start 2022-12-01T09:43:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb2a6ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2406aaf0 0x7fbb2414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb2a6ae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 0x7fbb24156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb2a6ae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 0x7fbb241569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb2a6ae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2414b7f0 con 0x7fbb240cd3b0 2022-12-01T09:43:47.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb2a6ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb24150810 con 0x7fbb2406aaf0 2022-12-01T09:43:47.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb2a6ae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb24150af0 con 0x7fbb24158970 2022-12-01T09:43:47.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 0x7fbb24156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 0x7fbb24156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55490/0 (socket says 172.21.15.33:55490) 2022-12-01T09:43:47.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb237fe700 1 -- 172.21.15.33:0/3216352895 learned_addr learned my addr 172.21.15.33:0/3216352895 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:47.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb23fff700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2406aaf0 0x7fbb2414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb28c4b700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 0x7fbb241569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb237fe700 1 -- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 msgr2=0x7fbb241569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb237fe700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 0x7fbb241569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb237fe700 1 -- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2406aaf0 msgr2=0x7fbb2414fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb237fe700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2406aaf0 0x7fbb2414fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb237fe700 1 -- 172.21.15.33:0/3216352895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c00b7f0 con 0x7fbb240cd3b0 2022-12-01T09:43:47.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb237fe700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 0x7fbb24156490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00b340 tx=0x7fbb0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.340+0000 7fbb20ff9700 1 -- 172.21.15.33:0/3216352895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c020070 con 0x7fbb240cd3b0 2022-12-01T09:43:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.341+0000 7fbb20ff9700 1 -- 172.21.15.33:0/3216352895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c003a70 con 0x7fbb240cd3b0 2022-12-01T09:43:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.341+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb24150dd0 con 0x7fbb240cd3b0 2022-12-01T09:43:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.341+0000 7fbb20ff9700 1 -- 172.21.15.33:0/3216352895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c003de0 con 0x7fbb240cd3b0 2022-12-01T09:43:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.341+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb24151390 con 0x7fbb240cd3b0 2022-12-01T09:43:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.341+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb24151580 con 0x7fbb240cd3b0 2022-12-01T09:43:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.342+0000 7fbb20ff9700 1 -- 172.21.15.33:0/3216352895 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fbb0c024410 con 0x7fbb240cd3b0 2022-12-01T09:43:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.342+0000 7fbb20ff9700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fbb08066590 0x7fbb08068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.342+0000 7fbb20ff9700 1 -- 172.21.15.33:0/3216352895 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbb0c086b40 con 0x7fbb240cd3b0 2022-12-01T09:43:47.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.343+0000 7fbb23fff700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fbb08066590 0x7fbb08068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.343+0000 7fbb23fff700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fbb08066590 0x7fbb08068a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb14006fd0 tx=0x7fbb14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:47.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.347+0000 7fbb20ff9700 1 -- 172.21.15.33:0/3216352895 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7fbb0c054540 con 0x7fbb240cd3b0 2022-12-01T09:43:47.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.537+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbb24067420 con 0x7fbb240cd3b0 2022-12-01T09:43:47.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.537+0000 7fbb20ff9700 1 -- 172.21.15.33:0/3216352895 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7fbb0c057b60 con 0x7fbb240cd3b0 2022-12-01T09:43:47.541 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-12-01T09:43:47.541 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2022-12-01T09:43:47.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2022-12-01T09:43:47.542 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2022-12-01T09:43:47.542 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": "rbd" 2022-12-01T09:43:47.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-12-01T09:43:47.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2022-12-01T09:43:47.543 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 2, 2022-12-01T09:43:47.543 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2022-12-01T09:43:47.543 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-12-01T09:43:47.543 INFO:teuthology.orchestra.run.smithi033.stdout:] 2022-12-01T09:43:47.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.539+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fbb08066590 msgr2=0x7fbb08068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.539+0000 7fbb2a6ae700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fbb08066590 0x7fbb08068a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb14006fd0 tx=0x7fbb14008040 comp rx=0 tx=0).stop 2022-12-01T09:43:47.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.539+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 msgr2=0x7fbb24156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.539+0000 7fbb2a6ae700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 0x7fbb24156490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00b340 tx=0x7fbb0c004750 comp rx=0 tx=0).stop 2022-12-01T09:43:47.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.540+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 shutdown_connections 2022-12-01T09:43:47.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.540+0000 7fbb2a6ae700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7fbb08066590 0x7fbb08068a40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.540+0000 7fbb2a6ae700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2406aaf0 0x7fbb2414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.540+0000 7fbb2a6ae700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb24158970 0x7fbb241569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.540+0000 7fbb2a6ae700 1 --2- 172.21.15.33:0/3216352895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb240cd3b0 0x7fbb24156490 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.540+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 >> 172.21.15.33:0/3216352895 conn(0x7fbb240cb7e0 msgr2=0x7fbb24070910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:47.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.540+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 shutdown_connections 2022-12-01T09:43:47.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.540+0000 7fbb2a6ae700 1 -- 172.21.15.33:0/3216352895 wait complete. 2022-12-01T09:43:47.555 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-12-01T09:43:47.555 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-12-01T09:43:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.680+0000 7f9872b20700 1 Processor -- start 2022-12-01T09:43:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.680+0000 7f9872b20700 1 -- start start 2022-12-01T09:43:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f9872b20700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f986c0cd2b0 0x7f986c0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f9872b20700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f986c0ceb60 0x7f986c166640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f9872b20700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c15fdd0 con 0x7f986c0cd680 2022-12-01T09:43:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f9872b20700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c15be90 con 0x7f986c0cd2b0 2022-12-01T09:43:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f9872b20700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c06c000 con 0x7f986c0ceb60 2022-12-01T09:43:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f98708bc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f986c0cd2b0 0x7f986c0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f98708bc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f986c0cd2b0 0x7f986c0ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55496/0 (socket says 172.21.15.33:55496) 2022-12-01T09:43:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f98708bc700 1 -- 172.21.15.33:0/1565180261 learned_addr learned my addr 172.21.15.33:0/1565180261 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f98710bd700 1 --2- 172.21.15.33:0/1565180261 >> v2:172.21.15.156:3300/0 conn(0x7f986c0ceb60 0x7f986c166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f98708bc700 1 -- 172.21.15.33:0/1565180261 >> v2:172.21.15.156:3300/0 conn(0x7f986c0ceb60 msgr2=0x7f986c166640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f98708bc700 1 --2- 172.21.15.33:0/1565180261 >> v2:172.21.15.156:3300/0 conn(0x7f986c0ceb60 0x7f986c166640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f98708bc700 1 -- 172.21.15.33:0/1565180261 >> v1:172.21.15.156:6789/0 conn(0x7f986c0cd680 legacy=0x7f986c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.681+0000 7f98708bc700 1 -- 172.21.15.33:0/1565180261 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c15f4e0 con 0x7f986c0cd2b0 2022-12-01T09:43:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f98708bc700 1 --2- 172.21.15.33:0/1565180261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd2b0 0x7f986c0ccaa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f986c0cbf00 tx=0x7f9860009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d8e9b5504edacf server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f986b7fe700 1 -- 172.21.15.33:0/1565180261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860005e30 con 0x7f986c0cd2b0 2022-12-01T09:43:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f986b7fe700 1 -- 172.21.15.33:0/1565180261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860004030 con 0x7f986c0cd2b0 2022-12-01T09:43:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f986b7fe700 1 -- 172.21.15.33:0/1565180261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98600043e0 con 0x7f986c0cd2b0 2022-12-01T09:43:47.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f9872b20700 1 -- 172.21.15.33:0/1565180261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd2b0 msgr2=0x7f986c0ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f9872b20700 1 --2- 172.21.15.33:0/1565180261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd2b0 0x7f986c0ccaa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f986c0cbf00 tx=0x7f9860009bd0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f9872b20700 1 -- 172.21.15.33:0/1565180261 shutdown_connections 2022-12-01T09:43:47.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f9872b20700 1 --2- 172.21.15.33:0/1565180261 >> v2:172.21.15.156:3300/0 conn(0x7f986c0ceb60 0x7f986c166640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f9872b20700 1 --2- 172.21.15.33:0/1565180261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd2b0 0x7f986c0ccaa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f9872b20700 1 -- 172.21.15.33:0/1565180261 >> 172.21.15.33:0/1565180261 conn(0x7f986c070a30 msgr2=0x7f986c070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f9872b20700 1 -- 172.21.15.33:0/1565180261 shutdown_connections 2022-12-01T09:43:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.682+0000 7f9872b20700 1 -- 172.21.15.33:0/1565180261 wait complete. 2022-12-01T09:43:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.684+0000 7f9872b20700 1 Processor -- start 2022-12-01T09:43:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.684+0000 7f9872b20700 1 -- start start 2022-12-01T09:43:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.684+0000 7f9872b20700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f986c0cd2b0 0x7f986c14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.684+0000 7f9872b20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd680 0x7f986c0979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.684+0000 7f9872b20700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f986c0ceb60 0x7f986c0adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.684+0000 7f9872b20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c097f30 con 0x7f986c0cd680 2022-12-01T09:43:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.684+0000 7f9872b20700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0b25e0 con 0x7f986c0ceb60 2022-12-01T09:43:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.684+0000 7f9872b20700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0b28c0 con 0x7f986c0cd2b0 2022-12-01T09:43:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f986bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd680 0x7f986c0979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f986bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd680 0x7f986c0979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55512/0 (socket says 172.21.15.33:55512) 2022-12-01T09:43:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f986bfff700 1 -- 172.21.15.33:0/3448350435 learned_addr learned my addr 172.21.15.33:0/3448350435 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f98710bd700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f986c0ceb60 0x7f986c0adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f98708bc700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f986c0cd2b0 0x7f986c14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f986bfff700 1 -- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f986c0cd2b0 msgr2=0x7f986c14bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f986bfff700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f986c0cd2b0 0x7f986c14bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f986bfff700 1 -- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f986c0ceb60 msgr2=0x7f986c0adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f986bfff700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f986c0ceb60 0x7f986c0adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f986bfff700 1 -- 172.21.15.33:0/3448350435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9860009500 con 0x7f986c0cd680 2022-12-01T09:43:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f98708bc700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f986c0cd2b0 0x7f986c14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-12-01T09:43:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f986bfff700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd680 0x7f986c0979f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f985800c4e0 tx=0x7f985800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f98697fa700 1 -- 172.21.15.33:0/3448350435 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98580052d0 con 0x7f986c0cd680 2022-12-01T09:43:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f98697fa700 1 -- 172.21.15.33:0/3448350435 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9858005430 con 0x7f986c0cd680 2022-12-01T09:43:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c0b2ba0 con 0x7f986c0cd680 2022-12-01T09:43:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f98697fa700 1 -- 172.21.15.33:0/3448350435 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98580038c0 con 0x7f986c0cd680 2022-12-01T09:43:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.685+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c0b3160 con 0x7f986c0cd680 2022-12-01T09:43:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.686+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c0b3380 con 0x7f986c0cd680 2022-12-01T09:43:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.687+0000 7f98697fa700 1 -- 172.21.15.33:0/3448350435 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f9858019030 con 0x7f986c0cd680 2022-12-01T09:43:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.687+0000 7f98697fa700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9854066590 0x7f9854068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.687+0000 7f98697fa700 1 -- 172.21.15.33:0/3448350435 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f98580827a0 con 0x7f986c0cd680 2022-12-01T09:43:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.687+0000 7f98708bc700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9854066590 0x7f9854068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.688+0000 7f98708bc700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9854066590 0x7f9854068a40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9860014040 tx=0x7f9860008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:47.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.693+0000 7f98697fa700 1 -- 172.21.15.33:0/3448350435 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170950 (secure 0 0 0) 0x7f9858050200 con 0x7f986c0cd680 2022-12-01T09:43:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:47.884+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f986c067420 con 0x7f986c0cd680 2022-12-01T09:43:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.698+0000 7f98697fa700 1 -- 172.21.15.33:0/3448350435 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9858053820 con 0x7f986c0cd680 2022-12-01T09:43:48.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9854066590 msgr2=0x7f9854068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:48.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9854066590 0x7f9854068a40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9860014040 tx=0x7f9860008070 comp rx=0 tx=0).stop 2022-12-01T09:43:48.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd680 msgr2=0x7f986c0979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:48.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd680 0x7f986c0979f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f985800c4e0 tx=0x7f985800c7f0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 shutdown_connections 2022-12-01T09:43:48.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:6832/111742,v1:172.21.15.156:6833/111742] conn(0x7f9854066590 0x7f9854068a40 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9860014040 tx=0x7f9860008070 comp rx=0 tx=0).stop 2022-12-01T09:43:48.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f986c0ceb60 0x7f986c0adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f986c0cd2b0 0x7f986c14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 --2- 172.21.15.33:0/3448350435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0cd680 0x7f986c0979f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.704+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 >> 172.21.15.33:0/3448350435 conn(0x7f986c070a30 msgr2=0x7f986c0ac940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:48.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.705+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 shutdown_connections 2022-12-01T09:43:48.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.705+0000 7f9872b20700 1 -- 172.21.15.33:0/3448350435 wait complete. 2022-12-01T09:43:48.711 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2022-12-01T09:43:48.724 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2022-12-01T09:43:48.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.859+0000 7f96c199a700 1 Processor -- start 2022-12-01T09:43:48.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.859+0000 7f96c199a700 1 -- start start 2022-12-01T09:43:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.860+0000 7f96c199a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f96bc0b3ba0 0x7f96bc0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.860+0000 7f96c199a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0b4f50 con 0x7f96bc0b1450 2022-12-01T09:43:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.860+0000 7f96c199a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0b1820 con 0x7f96bc0b53e0 2022-12-01T09:43:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.860+0000 7f96c199a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0b4580 con 0x7f96bc0b3ba0 2022-12-01T09:43:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.860+0000 7f96baffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f96bc0b1450 0x7f96bc0cc770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59040/0 (socket says 172.21.15.33:59040) 2022-12-01T09:43:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.860+0000 7f96baffd700 1 -- 172.21.15.33:0/2242959175 learned_addr learned my addr 172.21.15.33:0/2242959175 (peer_addr_for_me v1:172.21.15.33:0/0) 2022-12-01T09:43:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.860+0000 7f96ba7fc700 1 --2- 172.21.15.33:0/2242959175 >> v2:172.21.15.156:3300/0 conn(0x7f96bc0b3ba0 0x7f96bc0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.860+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598117156 0 0) 0x7f96bc0b4f50 con 0x7f96bc0b1450 2022-12-01T09:43:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.860+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a80035b0 con 0x7f96bc0b1450 2022-12-01T09:43:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1682468239 0 0) 0x7f96a80035b0 con 0x7f96bc0b1450 2022-12-01T09:43:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 >> v2:172.21.15.156:3300/0 conn(0x7f96bc0b3ba0 msgr2=0x7f96bc0b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 --2- 172.21.15.33:0/2242959175 >> v2:172.21.15.156:3300/0 conn(0x7f96bc0b3ba0 0x7f96bc0b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 >> v1:172.21.15.156:6789/0 conn(0x7f96bc0b53e0 legacy=0x7f96bc0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0d0830 con 0x7f96bc0b1450 2022-12-01T09:43:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3904297037 0 0) 0x7f96b0001670 con 0x7f96bc0b1450 2022-12-01T09:43:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96ba7fc700 1 --2- 172.21.15.33:0/2242959175 >> v2:172.21.15.156:3300/0 conn(0x7f96bc0b3ba0 0x7f96bc0b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-12-01T09:43:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 >> v1:172.21.15.33:6789/0 conn(0x7f96bc0b1450 legacy=0x7f96bc0cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96a8003a00 0x7f96a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96a8004850 0x7f96a8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:48.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a8005200 0x7f96a800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:48.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a800c160 con 0x7f96a8003a00 2022-12-01T09:43:48.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a800c2d0 con 0x7f96a8004850 2022-12-01T09:43:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a800c490 con 0x7f96a8005200 2022-12-01T09:43:48.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96baffd700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96a8003a00 0x7f96a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96ba7fc700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96a8004850 0x7f96a8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:48.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96bb7fe700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a8005200 0x7f96a800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:48.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96baffd700 1 -- 172.21.15.33:0/2242959175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a8005200 msgr2=0x7f96a800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:48.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96baffd700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a8005200 0x7f96a800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96baffd700 1 -- 172.21.15.33:0/2242959175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96a8004850 msgr2=0x7f96a8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-12-01T09:43:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96baffd700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96a8004850 0x7f96a8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96baffd700 1 -- 172.21.15.33:0/2242959175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a80035b0 con 0x7f96a8003a00 2022-12-01T09:43:48.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96bb7fe700 1 -- 172.21.15.33:0/2242959175 reap_dead start 2022-12-01T09:43:48.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96baffd700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96a8003a00 0x7f96a8003dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f96b0001eb0 tx=0x7f96a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdab31816dd56a45 server_cookie=0 in_seq=0 out_seq=0 2022-12-01T09:43:48.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b000ce00 con 0x7f96a8003a00 2022-12-01T09:43:48.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b0005960 con 0x7f96a8003a00 2022-12-01T09:43:48.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.861+0000 7f96b9ffb700 1 -- 172.21.15.33:0/2242959175 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0005d10 con 0x7f96a8003a00 2022-12-01T09:43:48.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.862+0000 7f96c199a700 1 -- 172.21.15.33:0/2242959175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96a8003a00 msgr2=0x7f96a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:48.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.862+0000 7f96c199a700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96a8003a00 0x7f96a8003dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f96b0001eb0 tx=0x7f96a8005880 comp rx=0 tx=0).stop 2022-12-01T09:43:48.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.862+0000 7f96c199a700 1 -- 172.21.15.33:0/2242959175 shutdown_connections 2022-12-01T09:43:48.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.862+0000 7f96c199a700 1 --2- 172.21.15.33:0/2242959175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96a8003a00 0x7f96a8003dd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.862+0000 7f96c199a700 1 -- 172.21.15.33:0/2242959175 >> 172.21.15.33:0/2242959175 conn(0x7f96bc0ceba0 msgr2=0x7f96bc0cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-12-01T09:43:48.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.862+0000 7f96c199a700 1 -- 172.21.15.33:0/2242959175 shutdown_connections 2022-12-01T09:43:48.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.862+0000 7f96c199a700 1 -- 172.21.15.33:0/2242959175 wait complete. 2022-12-01T09:43:48.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.863+0000 7f96c199a700 1 Processor -- start 2022-12-01T09:43:48.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.863+0000 7f96c199a700 1 -- start start 2022-12-01T09:43:48.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96c199a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96a8003a00 0x7f96bc15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:48.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96c199a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96bc1f39a0 0x7f96bc15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:48.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96c199a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96bc1e5370 0x7f96bc1e5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-12-01T09:43:48.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96c199a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc1e5d50 con 0x7f96a8003a00 2022-12-01T09:43:48.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96c199a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc15cd40 con 0x7f96bc1e5370 2022-12-01T09:43:48.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96c199a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0c91f0 con 0x7f96bc1f39a0 2022-12-01T09:43:48.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96baffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96a8003a00 0x7f96bc15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:48.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96baffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96a8003a00 0x7f96bc15c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55528/0 (socket says 172.21.15.33:55528) 2022-12-01T09:43:48.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96baffd700 1 -- 172.21.15.33:0/3307399052 learned_addr learned my addr 172.21.15.33:0/3307399052 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-12-01T09:43:48.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96bb7fe700 1 --2- 172.21.15.33:0/3307399052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96bc1e5370 0x7f96bc1e5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:48.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96baffd700 1 -- 172.21.15.33:0/3307399052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96bc1f39a0 msgr2=0x7f96bc15c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:48.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.864+0000 7f96ba7fc700 1 --2- 172.21.15.33:0/3307399052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96bc1f39a0 0x7f96bc15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-12-01T09:43:48.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.865+0000 7f96baffd700 1 --2- 172.21.15.33:0/3307399052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96bc1f39a0 0x7f96bc15c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.865+0000 7f96baffd700 1 -- 172.21.15.33:0/3307399052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96bc1e5370 msgr2=0x7f96bc1e5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-12-01T09:43:48.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.865+0000 7f96baffd700 1 --2- 172.21.15.33:0/3307399052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96bc1e5370 0x7f96bc1e5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-12-01T09:43:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.865+0000 7f96baffd700 1 -- 172.21.15.33:0/3307399052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc15cfe0 con 0x7f96a8003a00 2022-12-01T09:43:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-12-01T09:43:48.865+0000 7f96bb7fe700 1 --2- 172.21.15.33:0/3307399052 >> [v2:172.21.15.156:3300/0,v1