2023-01-25T05:39:19.807 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T05:39:19.808 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi --verbose --owner scheduled_yuriw@teuthology --description rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e} --archive /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136853 -- /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136853/orig.config.yaml 2023-01-25T05:39:19.839 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T05:39:19.916 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136853 branch: wip-yuri2-testing-2023-01-23-0928 description: rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e} email: yweinstein@radhat.com first_in_suite: false job_id: '7136853' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri2-testing-2023-01-23-0928 ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 3 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug mgrc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd memory target: 1610612736 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 61996d73ab738798e4ee0055c86457f5c459da4a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 61996d73ab738798e4ee0055c86457f5c459da4a selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2023-01-23-0928 sha1: 61996d73ab738798e4ee0055c86457f5c459da4a owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - mon.a - mgr.a - client.0 - - host.b - client.1 sha1: 61996d73ab738798e4ee0055c86457f5c459da4a sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri2-testing-2023-01-23-0928 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 61996d73ab738798e4ee0055c86457f5c459da4a targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPjBveRyDX4FetCqvxyAikADfSwXVSv+yf49KMvWRiqfDE7tUwC/bvz/Q67Y596SuNz6YR21HoFEo+2S4n5tAfA= smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+swqYpVw+s1LPEqrMkAKpU1+9QwaaZwsgo7yXUUsRSBiRJPxAk3utuhCUnO35X98Ks9+FgTdzZNIV5ScEUdc/oCTNcmdYvAMbiYUjXynazBQ0MOSiD9zUqWdZfLF+Fnygkcmems52E0gm1HOWIeJihBMFXBKxMUq1zgnM6gmJwMCT5vTv7+sikFySo7lPdfXTuZjKWdVvG4VY4DAbqCEKzMxIJAQ1mSWJLBBhNijKol79didJOwA5RYZE6RnWcAwP2Pu6mOV1GnBmJLhmDCXa/M5RUXXQgDDTk59XFehg9nJSBPDOw2Iy7ouiY7OqUaJbhemqXq9INLR1wxRQw/hmqZKsIVzjCS/sZBHm8gNxDyA4EBHUbdzgVQBNaWBQqESqtpgRrgJGwuamVHb4Xuio+7DQbvTaNI625PKyVr/ho0GMPLBQ0r3Svma4w1Kqo8Lx4fNw49pJI9y2DT08UcHQYLXGnm7+9MRX3vIovaSIYyFpP5KWxEdSdfE9VaFaXyc= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - sudo sed -i 's/runtime = "runc"/#runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/#runtime = "crun"/runtime = "crun"/g' /usr/share/containers/containers.conf - install: null - cephadm: null - workunit: clients: client.1: - cephadm/create_iscsi_disks.sh - workunit: clients: client.0: - cephadm/test_dashboard_e2e.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:22:09 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T05:39:19.917 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa; will attempt to use it 2023-01-25T05:39:19.918 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa/tasks 2023-01-25T05:39:19.918 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T05:39:19.920 INFO:teuthology.task.internal:Checking packages... 2023-01-25T05:39:19.947 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '61996d73ab738798e4ee0055c86457f5c459da4a' 2023-01-25T05:39:19.947 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T05:39:19.948 INFO:teuthology.packaging:ref: None 2023-01-25T05:39:19.948 INFO:teuthology.packaging:tag: None 2023-01-25T05:39:19.948 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-01-23-0928 2023-01-25T05:39:19.949 INFO:teuthology.packaging:sha1: 61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T05:39:19.949 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2023-01-23-0928 2023-01-25T05:39:20.101 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1963.g61996d73 2023-01-25T05:39:20.101 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T05:39:20.108 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T05:39:20.108 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T05:39:20.125 INFO:teuthology.task.internal:Saving configuration 2023-01-25T05:39:20.139 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T05:39:20.145 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T05:39:20.174 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136853', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 05:33:42.307430', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPjBveRyDX4FetCqvxyAikADfSwXVSv+yf49KMvWRiqfDE7tUwC/bvz/Q67Y596SuNz6YR21HoFEo+2S4n5tAfA='} 2023-01-25T05:39:20.203 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136853', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 05:33:42.305892', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGba05QncPMw9eW8WXKT9oCPAlgb0mdOVYvKNlynEAvaG8kQT0keNNtqNsaAkZa3lMGJJP48sCR0uO/2TWaqgKQ='} 2023-01-25T05:39:20.204 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T05:39:20.210 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'] 2023-01-25T05:39:20.211 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['host.b', 'client.1'] 2023-01-25T05:39:20.211 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T05:39:20.283 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff3f5489700>, signals=[15]) 2023-01-25T05:39:20.285 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T05:39:20.292 INFO:teuthology.task.internal:Opening connections... 2023-01-25T05:39:20.292 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-01-25T05:39:20.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T05:39:20.363 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-01-25T05:39:20.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T05:39:20.432 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T05:39:20.440 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-01-25T05:39:20.461 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-01-25T05:39:20.461 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-01-25T05:39:20.520 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-01-25T05:39:20.521 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2023-01-25T05:39:20.521 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-01-25T05:39:20.521 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-01-25T05:39:20.521 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2023-01-25T05:39:20.522 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-01-25T05:39:20.522 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-25T05:39:20.522 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-01-25T05:39:20.522 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-25T05:39:20.522 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-01-25T05:39:20.523 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T05:39:20.523 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T05:39:20.523 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-25T05:39:20.524 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-01-25T05:39:20.544 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-01-25T05:39:20.564 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-01-25T05:39:20.564 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-01-25T05:39:20.622 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-01-25T05:39:20.623 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-01-25T05:39:20.623 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-01-25T05:39:20.623 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-01-25T05:39:20.623 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-01-25T05:39:20.624 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-01-25T05:39:20.624 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-25T05:39:20.624 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-01-25T05:39:20.624 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-25T05:39:20.624 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-01-25T05:39:20.625 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T05:39:20.625 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T05:39:20.625 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-25T05:39:20.625 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-01-25T05:39:20.641 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T05:39:20.653 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T05:39:20.659 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T05:39:20.659 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-01-25T05:39:20.662 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-01-25T05:39:20.679 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T05:39:20.686 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T05:39:20.686 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-01-25T05:39:20.720 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-01-25T05:39:20.747 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T05:39:20.801 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T05:39:20.815 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T05:39:20.816 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T05:39:20.816 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T05:39:20.817 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T05:39:20.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T05:39:20.835 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-01-25T05:39:20.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T05:39:20.836 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-01-25T05:39:20.893 INFO:teuthology.orchestra.run.smithi089.stdout:4.18.0-408.el8.x86_64 2023-01-25T05:39:20.893 INFO:teuthology.task.kernel:Running kernel on smithi089: 4.18.0-408.el8.x86_64 2023-01-25T05:39:20.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2023-01-25T05:39:20.894 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-408.el8.x86_64 2023-01-25T05:39:20.895 INFO:teuthology.task.kernel:Running kernel on smithi088: 4.18.0-408.el8.x86_64 2023-01-25T05:39:20.895 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2023-01-25T05:39:24.597 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - AppStream 33 MB/s | 27 MB 00:00 2023-01-25T05:39:24.784 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-8 - AppStream 30 MB/s | 27 MB 00:00 2023-01-25T05:39:30.281 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - BaseOS 39 MB/s | 27 MB 00:00 2023-01-25T05:39:30.575 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-8 - BaseOS 34 MB/s | 27 MB 00:00 2023-01-25T05:39:34.504 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - Extras 158 kB/s | 18 kB 00:00 2023-01-25T05:39:34.824 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-8 - Extras 129 kB/s | 18 kB 00:00 2023-01-25T05:39:34.932 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - PowerTools 19 MB/s | 5.6 MB 00:00 2023-01-25T05:39:35.243 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-8 - PowerTools 20 MB/s | 5.6 MB 00:00 2023-01-25T05:39:36.181 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-01-25T05:39:36.451 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-01-25T05:39:37.231 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 15 MB/s | 13 MB 00:00 2023-01-25T05:39:37.543 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 14 MB/s | 13 MB 00:00 2023-01-25T05:39:40.531 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 386 kB/s | 24 kB 00:00 2023-01-25T05:39:40.844 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 459 kB/s | 24 kB 00:00 2023-01-25T05:39:43.654 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-25T05:39:43.654 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-25T05:39:43.823 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:39:43.823 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:39:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:39:43.824 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:39:43.824 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:39:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 4.18.0-448.el8 CentOS-BaseOS 9.2 M 2023-01-25T05:39:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 4.18.0-448.el8 CentOS-BaseOS 41 M 2023-01-25T05:39:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 4.18.0-448.el8 CentOS-BaseOS 34 M 2023-01-25T05:39:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:39:43.825 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:39:43.825 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:39:43.826 INFO:teuthology.orchestra.run.smithi088.stdout:Install 3 Packages 2023-01-25T05:39:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:39:43.827 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 85 M 2023-01-25T05:39:43.827 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 94 M 2023-01-25T05:39:43.827 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:39:43.983 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-25T05:39:43.983 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-25T05:39:44.145 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:39:44.145 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:39:44.146 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:39:44.146 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:39:44.146 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:39:44.146 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 4.18.0-448.el8 CentOS-BaseOS 9.2 M 2023-01-25T05:39:44.146 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 4.18.0-448.el8 CentOS-BaseOS 41 M 2023-01-25T05:39:44.147 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 4.18.0-448.el8 CentOS-BaseOS 34 M 2023-01-25T05:39:44.147 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:39:44.147 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:39:44.147 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:39:44.147 INFO:teuthology.orchestra.run.smithi089.stdout:Install 3 Packages 2023-01-25T05:39:44.148 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:39:44.148 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 85 M 2023-01-25T05:39:44.148 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 94 M 2023-01-25T05:39:44.149 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:39:44.236 INFO:teuthology.orchestra.run.smithi088.stdout:(1/3): kernel-4.18.0-448.el8.x86_64.rpm 22 MB/s | 9.2 MB 00:00 2023-01-25T05:39:44.628 INFO:teuthology.orchestra.run.smithi089.stdout:(1/3): kernel-4.18.0-448.el8.x86_64.rpm 19 MB/s | 9.2 MB 00:00 2023-01-25T05:39:45.238 INFO:teuthology.orchestra.run.smithi088.stdout:(2/3): kernel-core-4.18.0-448.el8.x86_64.rpm 29 MB/s | 41 MB 00:01 2023-01-25T05:39:45.691 INFO:teuthology.orchestra.run.smithi088.stdout:(3/3): kernel-modules-4.18.0-448.el8.x86_64.rpm 18 MB/s | 34 MB 00:01 2023-01-25T05:39:45.693 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:39:45.694 INFO:teuthology.orchestra.run.smithi088.stdout:Total 45 MB/s | 85 MB 00:01 2023-01-25T05:39:45.761 INFO:teuthology.orchestra.run.smithi089.stdout:(2/3): kernel-core-4.18.0-448.el8.x86_64.rpm 26 MB/s | 41 MB 00:01 2023-01-25T05:39:46.228 INFO:teuthology.orchestra.run.smithi089.stdout:(3/3): kernel-modules-4.18.0-448.el8.x86_64.rpm 16 MB/s | 34 MB 00:02 2023-01-25T05:39:46.231 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:39:46.231 INFO:teuthology.orchestra.run.smithi089.stdout:Total 41 MB/s | 85 MB 00:02 2023-01-25T05:39:46.330 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:39:46.716 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:39:46.716 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:39:46.860 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:39:47.235 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:39:47.235 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:39:48.813 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:39:48.844 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:39:50.506 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:39:50.549 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:39:51.545 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:39:52.087 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T05:39:53.267 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:39:53.935 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T05:39:55.895 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T05:39:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T05:39:57.742 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T05:39:58.210 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T05:39:59.657 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T05:39:59.935 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:01.527 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T05:40:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:22.251 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:22.276 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:22.700 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:22.700 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-4.18.0-448.el8.x86_64 1/3 2023-01-25T05:40:22.700 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-4.18.0-448.el8.x86_64 2/3 2023-01-25T05:40:23.316 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:23.317 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:40:23.317 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:40:23.317 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-4.18.0-448.el8.x86_64 kernel-core-4.18.0-448.el8.x86_64 2023-01-25T05:40:23.317 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-4.18.0-448.el8.x86_64 2023-01-25T05:40:23.318 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:40:23.318 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:40:23.444 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel --last | head -n 1 2023-01-25T05:40:23.557 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:23.584 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:23.642 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 05:39:59 AM UTC 2023-01-25T05:40:23.643 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T05:40:23.644 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-408.el8.x86_64 Expected: 4.18.0-448.el8.x86_64 2023-01-25T05:40:23.644 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T05:40:23.644 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T05:40:23.645 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-01-25T05:40:23.645 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T05:40:23.645 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel --last | head -n 1 2023-01-25T05:40:23.833 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 05:39:59 AM UTC 2023-01-25T05:40:23.834 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T05:40:23.835 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2023-01-25T05:40:23.868 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2023-01-25T05:40:23.868 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2023-01-25T05:40:23.868 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.02 2023-01-25T05:40:23.868 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 129.el8 2023-01-25T05:40:23.869 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2023-01-25T05:40:23.869 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-01-25T05:40:23.869 INFO:teuthology.orchestra.run.smithi088.stdout:Group : System Environment/Base 2023-01-25T05:40:23.869 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 9265586 2023-01-25T05:40:23.869 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2023-01-25T05:40:23.870 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-01-25T05:40:23.870 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-01-25T05:40:23.870 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-01-25T05:40:23.870 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : kbuilder.bsys.centos.org 2023-01-25T05:40:23.870 INFO:teuthology.orchestra.run.smithi088.stdout:Relocations : (not relocatable) 2023-01-25T05:40:23.871 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : CentOS BuildSystem 2023-01-25T05:40:23.871 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2023-01-25T05:40:23.871 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2023-01-25T05:40:23.871 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2023-01-25T05:40:23.871 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2023-01-25T05:40:23.872 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:40:23.872 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-01-25T05:40:23.872 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2023-01-25T05:40:23.872 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2023-01-25T05:40:23.872 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2023-01-25T05:40:23.873 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:40:23.873 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2023-01-25T05:40:23.874 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-01-25T05:40:23.874 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 4.18.0-448.el8.x86_64 2023-01-25T05:40:23.874 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-01-25T05:40:24.002 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:24.002 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-4.18.0-448.el8.x86_64 1/3 2023-01-25T05:40:24.002 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-4.18.0-448.el8.x86_64 2/3 2023-01-25T05:40:24.632 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T05:40:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:40:24.633 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:40:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-4.18.0-448.el8.x86_64 kernel-core-4.18.0-448.el8.x86_64 2023-01-25T05:40:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-4.18.0-448.el8.x86_64 2023-01-25T05:40:24.633 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:40:24.634 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:40:24.751 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel --last | head -n 1 2023-01-25T05:40:24.950 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 05:40:01 AM UTC 2023-01-25T05:40:24.951 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T05:40:24.952 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-408.el8.x86_64 Expected: 4.18.0-448.el8.x86_64 2023-01-25T05:40:24.952 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T05:40:24.952 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T05:40:24.952 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-01-25T05:40:24.953 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T05:40:24.953 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel --last | head -n 1 2023-01-25T05:40:25.139 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 05:40:01 AM UTC 2023-01-25T05:40:25.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T05:40:25.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2023-01-25T05:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2023-01-25T05:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2023-01-25T05:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.02 2023-01-25T05:40:25.175 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 129.el8 2023-01-25T05:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2023-01-25T05:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-01-25T05:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout:Group : System Environment/Base 2023-01-25T05:40:25.176 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 9265586 2023-01-25T05:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2023-01-25T05:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-01-25T05:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-01-25T05:40:25.177 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-01-25T05:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : kbuilder.bsys.centos.org 2023-01-25T05:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout:Relocations : (not relocatable) 2023-01-25T05:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : CentOS BuildSystem 2023-01-25T05:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2023-01-25T05:40:25.178 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2023-01-25T05:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2023-01-25T05:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2023-01-25T05:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-01-25T05:40:25.179 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2023-01-25T05:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2023-01-25T05:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2023-01-25T05:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:40:25.180 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2023-01-25T05:40:25.181 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-01-25T05:40:25.181 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 4.18.0-448.el8.x86_64 2023-01-25T05:40:25.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-01-25T05:40:25.270 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-01-25T05:40:27.109 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-01-25T05:40:27.110 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2023-01-25T05:40:27.111 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-01-25T05:40:27.163 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.MQvQAZU9GN 2023-01-25T05:40:27.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MQvQAZU9GN 2023-01-25T05:40:27.205 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.MQvQAZU9GN 2023-01-25T05:40:27.356 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.MQvQAZU9GN is 6KB 2023-01-25T05:40:27.405 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.MQvQAZU9GN 2023-01-25T05:40:27.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2023-01-25T05:40:27.486 INFO:teuthology.orchestra.run.smithi088.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-01-25T05:40:27.486 INFO:teuthology.orchestra.run.smithi088.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-01-25T05:40:27.487 INFO:teuthology.orchestra.run.smithi088.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-01-25T05:40:27.487 INFO:teuthology.orchestra.run.smithi088.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64.conf 2023-01-25T05:40:27.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64 2023-01-25T05:40:27.653 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2023-01-25T05:40:28.955 INFO:teuthology.orchestra.run.smithi089.stderr:done 2023-01-25T05:40:28.956 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-01-25T05:40:28.978 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.LzJXDzmPOG 2023-01-25T05:40:28.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LzJXDzmPOG 2023-01-25T05:40:29.056 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.LzJXDzmPOG 2023-01-25T05:40:29.200 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.LzJXDzmPOG is 6KB 2023-01-25T05:40:29.249 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.LzJXDzmPOG 2023-01-25T05:40:29.266 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2023-01-25T05:40:29.331 INFO:teuthology.orchestra.run.smithi089.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-01-25T05:40:29.331 INFO:teuthology.orchestra.run.smithi089.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-01-25T05:40:29.331 INFO:teuthology.orchestra.run.smithi089.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-01-25T05:40:29.332 INFO:teuthology.orchestra.run.smithi089.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64.conf 2023-01-25T05:40:29.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64 2023-01-25T05:40:29.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2023-01-25T05:40:57.684 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-01-25T05:40:57.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-01-25T05:40:57.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T05:40:59.499 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-01-25T05:40:59.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-01-25T05:40:59.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T05:41:32.140 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-01-25T05:41:34.184 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-01-25T05:42:02.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-01-25T05:42:02.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T05:42:04.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-01-25T05:42:04.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T05:42:11.660 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-01-25T05:42:12.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-01-25T05:42:12.015 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-448.el8.x86_64"... 2023-01-25T05:42:12.015 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-01-25T05:42:12.072 INFO:teuthology.orchestra.run.smithi089.stdout:4.18.0-448.el8.x86_64 2023-01-25T05:42:12.072 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-448.el8.x86_64 vs 4.18.0-448.el8.x86_64 2023-01-25T05:42:12.072 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T05:42:12.073 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-01-25T05:42:13.074 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-01-25T05:42:13.074 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T05:42:13.217 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2023-01-25T05:42:13.246 DEBUG:teuthology.parallel:result is None 2023-01-25T05:42:20.183 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-01-25T05:42:20.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-01-25T05:42:20.539 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-448.el8.x86_64"... 2023-01-25T05:42:20.539 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-01-25T05:42:20.557 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-448.el8.x86_64 2023-01-25T05:42:20.558 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-448.el8.x86_64 vs 4.18.0-448.el8.x86_64 2023-01-25T05:42:20.558 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T05:42:20.558 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-01-25T05:42:21.559 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-01-25T05:42:21.559 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T05:42:21.655 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2023-01-25T05:42:21.680 DEBUG:teuthology.parallel:result is None 2023-01-25T05:42:21.681 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T05:42:21.687 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T05:42:21.688 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T05:42:21.690 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T05:42:21.711 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T05:42:21.717 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T05:42:21.727 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T05:42:21.727 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T05:42:21.748 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T05:42:21.787 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T05:42:21.794 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T05:42:21.794 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T05:42:21.816 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T05:42:21.871 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T05:42:21.873 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T05:42:21.877 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T05:42:21.884 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T05:42:21.885 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T05:42:21.892 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T05:42:21.892 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T05:42:21.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T05:42:21.947 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T05:42:21.956 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T05:42:21.956 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T05:42:21.962 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T05:42:22.006 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T05:42:22.063 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T05:42:22.104 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T05:42:22.188 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T05:42:22.232 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T05:42:22.232 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T05:42:22.300 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T05:42:22.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T05:42:22.399 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T05:42:22.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T05:42:22.528 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T05:42:22.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T05:42:22.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-01-25T05:42:22.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-01-25T05:42:22.662 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T05:42:22.693 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T05:42:23.429 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T05:42:23.437 INFO:teuthology.task.internal:Starting timer... 2023-01-25T05:42:23.437 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T05:42:23.470 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T05:42:23.478 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-25T05:42:23.479 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2023-01-25T05:42:23.574 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2023-01-25T05:42:23.576 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-01-25T05:42:23.705 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2023-01-25T05:42:23.707 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T05:42:23.707 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2023-01-25T05:42:23.730 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2023-01-25T05:42:23.730 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-01-25T05:42:23.758 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-01-25T05:42:23.758 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2023-01-25T05:42:23.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T05:42:23.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T05:42:23.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T05:42:23.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T05:42:23.829 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T05:42:23.830 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2023-01-25T05:42:23.871 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-01-25T05:42:23.900 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T05:42:23.910 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-01-25T05:42:23.916 INFO:teuthology.repo_utils:Fetching main from origin 2023-01-25T05:42:24.032 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T05:42:24.049 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T05:42:24.051 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T05:48:47.782 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2023-01-25T05:48:47.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-01-25T05:48:47.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T05:48:47.854 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-01-25T05:48:47.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-01-25T05:48:47.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T05:48:47.992 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-01-25T05:48:48.059 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T05:48:48.070 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T05:48:48.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T05:48:48.071 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T05:48:48.073 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T05:48:48.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T05:48:48.103 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T05:48:48.118 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T05:48:48.132 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T05:48:48.146 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T05:48:48.181 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2023-01-25T05:48:48.192 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2023-01-25T05:48:48.206 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T05:48:48.215 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-01-25T05:48:48.220 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T05:48:48.226 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-01-25T05:48:48.240 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T05:48:48.254 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T05:48:48.294 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-01-25T05:48:48.297 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T05:48:48.297 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-01-25T05:48:48.298 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T05:48:48.298 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T05:48:48.298 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T05:48:48.298 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T05:48:48.315 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2023-01-25T05:48:48.319 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T05:48:48.319 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-01-25T05:48:48.319 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T05:48:48.320 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T05:48:48.320 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T05:48:48.320 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T05:48:48.321 INFO:teuthology.run_tasks:Running task pexec... 2023-01-25T05:48:48.330 INFO:teuthology.task.pexec:Executing custom commands... 2023-01-25T05:48:48.331 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi088.front.sepia.ceph.com 2023-01-25T05:48:48.331 DEBUG:teuthology.orchestra.run.smithi088:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-01-25T05:48:48.332 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi089.front.sepia.ceph.com 2023-01-25T05:48:48.332 DEBUG:teuthology.orchestra.run.smithi089:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-01-25T05:48:49.087 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:13 ago on Wed 25 Jan 2023 05:47:35 AM UTC. 2023-01-25T05:48:49.106 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:13 ago on Wed 25 Jan 2023 05:47:35 AM UTC. 2023-01-25T05:48:50.524 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:48:50.525 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:48:50.525 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-01-25T05:48:50.526 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:48:50.526 INFO:teuthology.orchestra.run.smithi088.stdout:Resetting modules: 2023-01-25T05:48:50.526 INFO:teuthology.orchestra.run.smithi088.stdout: container-tools 2023-01-25T05:48:50.526 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:48:50.526 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:48:50.527 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:48:50.527 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:48:50.563 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:48:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:48:50.564 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2023-01-25T05:48:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:48:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:Resetting modules: 2023-01-25T05:48:50.565 INFO:teuthology.orchestra.run.smithi089.stdout: container-tools 2023-01-25T05:48:50.565 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:48:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:48:50.565 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:48:50.566 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:48:50.797 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:48:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:48:51.575 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:16 ago on Wed 25 Jan 2023 05:47:35 AM UTC. 2023-01-25T05:48:51.606 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:16 ago on Wed 25 Jan 2023 05:47:35 AM UTC. 2023-01-25T05:48:53.000 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:48:53.002 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================= 2023-01-25T05:48:53.003 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:48:53.003 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================= 2023-01-25T05:48:53.003 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-01-25T05:48:53.004 INFO:teuthology.orchestra.run.smithi088.stdout: conmon x86_64 3:2.1.4-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 57 k 2023-01-25T05:48:53.004 INFO:teuthology.orchestra.run.smithi088.stdout: container-selinux noarch 2:2.189.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 60 k 2023-01-25T05:48:53.005 INFO:teuthology.orchestra.run.smithi088.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 18 M 2023-01-25T05:48:53.005 INFO:teuthology.orchestra.run.smithi088.stdout: criu x86_64 3.15-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 518 k 2023-01-25T05:48:53.005 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-overlayfs x86_64 1.9-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 73 k 2023-01-25T05:48:53.005 INFO:teuthology.orchestra.run.smithi088.stdout: libslirp x86_64 4.4.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 70 k 2023-01-25T05:48:53.006 INFO:teuthology.orchestra.run.smithi088.stdout: runc x86_64 1:1.1.4-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.9 M 2023-01-25T05:48:53.006 INFO:teuthology.orchestra.run.smithi088.stdout: slirp4netns x86_64 1.2.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 54 k 2023-01-25T05:48:53.007 INFO:teuthology.orchestra.run.smithi088.stdout:Installing group/module packages: 2023-01-25T05:48:53.007 INFO:teuthology.orchestra.run.smithi088.stdout: aardvark-dns x86_64 2:1.1.0-4.module_el8.7.0+1216+b022c01d CentOS-AppStream 997 k 2023-01-25T05:48:53.007 INFO:teuthology.orchestra.run.smithi088.stdout: buildah x86_64 1:1.27.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 8.1 M 2023-01-25T05:48:53.007 INFO:teuthology.orchestra.run.smithi088.stdout: cockpit-podman noarch 53-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 547 k 2023-01-25T05:48:53.008 INFO:teuthology.orchestra.run.smithi088.stdout: crun x86_64 1.5-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 213 k 2023-01-25T05:48:53.008 INFO:teuthology.orchestra.run.smithi088.stdout: netavark x86_64 2:1.1.0-6.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.2 M 2023-01-25T05:48:53.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-podman noarch 4.2.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 151 k 2023-01-25T05:48:53.008 INFO:teuthology.orchestra.run.smithi088.stdout: skopeo x86_64 2:1.9.2-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 6.8 M 2023-01-25T05:48:53.009 INFO:teuthology.orchestra.run.smithi088.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2023-01-25T05:48:53.009 INFO:teuthology.orchestra.run.smithi088.stdout: udica noarch 0.2.6-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 49 k 2023-01-25T05:48:53.009 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T05:48:53.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2023-01-25T05:48:53.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2023-01-25T05:48:53.010 INFO:teuthology.orchestra.run.smithi088.stdout: yajl x86_64 2.1.0-11.el8 CentOS-AppStream 41 k 2023-01-25T05:48:53.010 INFO:teuthology.orchestra.run.smithi088.stdout:Installing module profiles: 2023-01-25T05:48:53.010 INFO:teuthology.orchestra.run.smithi088.stdout: container-tools/common 2023-01-25T05:48:53.010 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling module streams: 2023-01-25T05:48:53.011 INFO:teuthology.orchestra.run.smithi088.stdout: container-tools rhel8 2023-01-25T05:48:53.011 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:48:53.011 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:48:53.011 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================================= 2023-01-25T05:48:53.012 INFO:teuthology.orchestra.run.smithi088.stdout:Install 12 Packages 2023-01-25T05:48:53.012 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 8 Packages 2023-01-25T05:48:53.012 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:48:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 43 M 2023-01-25T05:48:53.013 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:48:53.025 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:48:53.027 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================= 2023-01-25T05:48:53.027 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:48:53.028 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================= 2023-01-25T05:48:53.028 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-01-25T05:48:53.028 INFO:teuthology.orchestra.run.smithi089.stdout: conmon x86_64 3:2.1.4-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 57 k 2023-01-25T05:48:53.028 INFO:teuthology.orchestra.run.smithi089.stdout: container-selinux noarch 2:2.189.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 60 k 2023-01-25T05:48:53.029 INFO:teuthology.orchestra.run.smithi089.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 18 M 2023-01-25T05:48:53.029 INFO:teuthology.orchestra.run.smithi089.stdout: criu x86_64 3.15-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 518 k 2023-01-25T05:48:53.029 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-overlayfs x86_64 1.9-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 73 k 2023-01-25T05:48:53.030 INFO:teuthology.orchestra.run.smithi089.stdout: libslirp x86_64 4.4.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 70 k 2023-01-25T05:48:53.030 INFO:teuthology.orchestra.run.smithi089.stdout: runc x86_64 1:1.1.4-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.9 M 2023-01-25T05:48:53.030 INFO:teuthology.orchestra.run.smithi089.stdout: slirp4netns x86_64 1.2.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 54 k 2023-01-25T05:48:53.030 INFO:teuthology.orchestra.run.smithi089.stdout:Installing group/module packages: 2023-01-25T05:48:53.031 INFO:teuthology.orchestra.run.smithi089.stdout: aardvark-dns x86_64 2:1.1.0-4.module_el8.7.0+1216+b022c01d CentOS-AppStream 997 k 2023-01-25T05:48:53.031 INFO:teuthology.orchestra.run.smithi089.stdout: buildah x86_64 1:1.27.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 8.1 M 2023-01-25T05:48:53.031 INFO:teuthology.orchestra.run.smithi089.stdout: cockpit-podman noarch 53-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 547 k 2023-01-25T05:48:53.031 INFO:teuthology.orchestra.run.smithi089.stdout: crun x86_64 1.5-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 213 k 2023-01-25T05:48:53.032 INFO:teuthology.orchestra.run.smithi089.stdout: netavark x86_64 2:1.1.0-6.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.2 M 2023-01-25T05:48:53.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-podman noarch 4.2.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 151 k 2023-01-25T05:48:53.032 INFO:teuthology.orchestra.run.smithi089.stdout: skopeo x86_64 2:1.9.2-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 6.8 M 2023-01-25T05:48:53.032 INFO:teuthology.orchestra.run.smithi089.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2023-01-25T05:48:53.033 INFO:teuthology.orchestra.run.smithi089.stdout: udica noarch 0.2.6-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 49 k 2023-01-25T05:48:53.033 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T05:48:53.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2023-01-25T05:48:53.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2023-01-25T05:48:53.033 INFO:teuthology.orchestra.run.smithi089.stdout: yajl x86_64 2.1.0-11.el8 CentOS-AppStream 41 k 2023-01-25T05:48:53.034 INFO:teuthology.orchestra.run.smithi089.stdout:Installing module profiles: 2023-01-25T05:48:53.034 INFO:teuthology.orchestra.run.smithi089.stdout: container-tools/common 2023-01-25T05:48:53.034 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling module streams: 2023-01-25T05:48:53.034 INFO:teuthology.orchestra.run.smithi089.stdout: container-tools rhel8 2023-01-25T05:48:53.034 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:48:53.035 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:48:53.035 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================================= 2023-01-25T05:48:53.035 INFO:teuthology.orchestra.run.smithi089.stdout:Install 12 Packages 2023-01-25T05:48:53.035 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 8 Packages 2023-01-25T05:48:53.036 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:48:53.036 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 43 M 2023-01-25T05:48:53.036 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:48:53.097 INFO:teuthology.orchestra.run.smithi088.stdout:(1/20): cockpit-podman-53-1.module_el8.7.0+1216 6.0 MB/s | 547 kB 00:00 2023-01-25T05:48:53.119 INFO:teuthology.orchestra.run.smithi089.stdout:(1/20): cockpit-podman-53-1.module_el8.7.0+1216 6.2 MB/s | 547 kB 00:00 2023-01-25T05:48:53.130 INFO:teuthology.orchestra.run.smithi088.stdout:(2/20): crun-1.5-1.module_el8.7.0+1216+b022c01d 6.2 MB/s | 213 kB 00:00 2023-01-25T05:48:53.152 INFO:teuthology.orchestra.run.smithi089.stdout:(2/20): crun-1.5-1.module_el8.7.0+1216+b022c01d 6.3 MB/s | 213 kB 00:00 2023-01-25T05:48:53.172 INFO:teuthology.orchestra.run.smithi088.stdout:(3/20): aardvark-dns-1.1.0-4.module_el8.7.0+121 5.9 MB/s | 997 kB 00:00 2023-01-25T05:48:53.214 INFO:teuthology.orchestra.run.smithi088.stdout:(4/20): python3-podman-4.2.0-1.module_el8.7.0+1 3.5 MB/s | 151 kB 00:00 2023-01-25T05:48:53.227 INFO:teuthology.orchestra.run.smithi089.stdout:(3/20): aardvark-dns-1.1.0-4.module_el8.7.0+121 5.0 MB/s | 997 kB 00:00 2023-01-25T05:48:53.231 INFO:teuthology.orchestra.run.smithi088.stdout:(5/20): python3-pytoml-0.1.14-5.git7dea353.el8. 1.4 MB/s | 25 kB 00:00 2023-01-25T05:48:53.269 INFO:teuthology.orchestra.run.smithi089.stdout:(4/20): python3-podman-4.2.0-1.module_el8.7.0+1 3.6 MB/s | 151 kB 00:00 2023-01-25T05:48:53.294 INFO:teuthology.orchestra.run.smithi088.stdout:(6/20): python3-pyxdg-0.25-16.el8.noarch.rpm 1.5 MB/s | 94 kB 00:00 2023-01-25T05:48:53.295 INFO:teuthology.orchestra.run.smithi089.stdout:(5/20): python3-pytoml-0.1.14-5.git7dea353.el8. 977 kB/s | 25 kB 00:00 2023-01-25T05:48:53.328 INFO:teuthology.orchestra.run.smithi089.stdout:(6/20): python3-pyxdg-0.25-16.el8.noarch.rpm 2.7 MB/s | 94 kB 00:00 2023-01-25T05:48:53.379 INFO:teuthology.orchestra.run.smithi089.stdout:(7/20): netavark-1.1.0-6.module_el8.7.0+1216+b0 9.5 MB/s | 2.2 MB 00:00 2023-01-25T05:48:53.382 INFO:teuthology.orchestra.run.smithi088.stdout:(7/20): netavark-1.1.0-6.module_el8.7.0+1216+b0 8.6 MB/s | 2.2 MB 00:00 2023-01-25T05:48:53.488 INFO:teuthology.orchestra.run.smithi089.stdout:(8/20): buildah-1.27.0-2.module_el8.7.0+1216+b0 18 MB/s | 8.1 MB 00:00 2023-01-25T05:48:53.507 INFO:teuthology.orchestra.run.smithi088.stdout:(8/20): toolbox-0.0.99.3-1.module_el8.5.0+877+1 18 MB/s | 2.3 MB 00:00 2023-01-25T05:48:53.532 INFO:teuthology.orchestra.run.smithi088.stdout:(9/20): udica-0.2.6-3.module_el8.7.0+1216+b022c 1.9 MB/s | 49 kB 00:00 2023-01-25T05:48:53.538 INFO:teuthology.orchestra.run.smithi089.stdout:(9/20): udica-0.2.6-3.module_el8.7.0+1216+b022c 987 kB/s | 49 kB 00:00 2023-01-25T05:48:53.558 INFO:teuthology.orchestra.run.smithi088.stdout:(10/20): yajl-2.1.0-11.el8.x86_64.rpm 1.6 MB/s | 41 kB 00:00 2023-01-25T05:48:53.563 INFO:teuthology.orchestra.run.smithi089.stdout:(10/20): yajl-2.1.0-11.el8.x86_64.rpm 1.6 MB/s | 41 kB 00:00 2023-01-25T05:48:53.589 INFO:teuthology.orchestra.run.smithi089.stdout:(11/20): conmon-2.1.4-1.module_el8.7.0+1216+b02 2.2 MB/s | 57 kB 00:00 2023-01-25T05:48:53.614 INFO:teuthology.orchestra.run.smithi089.stdout:(12/20): container-selinux-2.189.0-1.module_el8 2.4 MB/s | 60 kB 00:00 2023-01-25T05:48:53.641 INFO:teuthology.orchestra.run.smithi088.stdout:(11/20): buildah-1.27.0-2.module_el8.7.0+1216+b 13 MB/s | 8.1 MB 00:00 2023-01-25T05:48:53.667 INFO:teuthology.orchestra.run.smithi088.stdout:(12/20): conmon-2.1.4-1.module_el8.7.0+1216+b02 522 kB/s | 57 kB 00:00 2023-01-25T05:48:53.697 INFO:teuthology.orchestra.run.smithi089.stdout:(13/20): toolbox-0.0.99.3-1.module_el8.5.0+877+ 7.1 MB/s | 2.3 MB 00:00 2023-01-25T05:48:53.722 INFO:teuthology.orchestra.run.smithi088.stdout:(13/20): container-selinux-2.189.0-1.module_el8 755 kB/s | 60 kB 00:00 2023-01-25T05:48:53.778 INFO:teuthology.orchestra.run.smithi089.stdout:(14/20): criu-3.15-3.module_el8.7.0+1216+b022c0 6.7 MB/s | 518 kB 00:00 2023-01-25T05:48:53.792 INFO:teuthology.orchestra.run.smithi088.stdout:(14/20): criu-3.15-3.module_el8.7.0+1216+b022c0 7.2 MB/s | 518 kB 00:00 2023-01-25T05:48:53.806 INFO:teuthology.orchestra.run.smithi089.stdout:(15/20): fuse-overlayfs-1.9-1.module_el8.7.0+12 2.2 MB/s | 73 kB 00:00 2023-01-25T05:48:53.826 INFO:teuthology.orchestra.run.smithi088.stdout:(15/20): fuse-overlayfs-1.9-1.module_el8.7.0+12 2.2 MB/s | 73 kB 00:00 2023-01-25T05:48:53.840 INFO:teuthology.orchestra.run.smithi089.stdout:(16/20): libslirp-4.4.0-1.module_el8.7.0+1216+b 2.1 MB/s | 70 kB 00:00 2023-01-25T05:48:53.860 INFO:teuthology.orchestra.run.smithi088.stdout:(16/20): libslirp-4.4.0-1.module_el8.7.0+1216+b 2.1 MB/s | 70 kB 00:00 2023-01-25T05:48:54.035 INFO:teuthology.orchestra.run.smithi088.stdout:(17/20): skopeo-1.9.2-1.module_el8.7.0+1216+b02 9.2 MB/s | 6.8 MB 00:00 2023-01-25T05:48:54.068 INFO:teuthology.orchestra.run.smithi088.stdout:(18/20): slirp4netns-1.2.0-2.module_el8.7.0+121 1.6 MB/s | 54 kB 00:00 2023-01-25T05:48:54.073 INFO:teuthology.orchestra.run.smithi089.stdout:(17/20): skopeo-1.9.2-1.module_el8.7.0+1216+b02 9.1 MB/s | 6.8 MB 00:00 2023-01-25T05:48:54.210 INFO:teuthology.orchestra.run.smithi088.stdout:(19/20): runc-1.1.4-1.module_el8.7.0+1216+b022c 8.4 MB/s | 2.9 MB 00:00 2023-01-25T05:48:54.288 INFO:teuthology.orchestra.run.smithi089.stdout:(18/20): containernetworking-plugins-1.1.1-3.mo 27 MB/s | 18 MB 00:00 2023-01-25T05:48:54.308 INFO:teuthology.orchestra.run.smithi089.stdout:(19/20): slirp4netns-1.2.0-2.module_el8.7.0+121 232 kB/s | 54 kB 00:00 2023-01-25T05:48:54.366 INFO:teuthology.orchestra.run.smithi089.stdout:(20/20): runc-1.1.4-1.module_el8.7.0+1216+b022c 5.6 MB/s | 2.9 MB 00:00 2023-01-25T05:48:54.368 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:48:54.369 INFO:teuthology.orchestra.run.smithi089.stdout:Total 32 MB/s | 43 MB 00:01 2023-01-25T05:48:54.436 INFO:teuthology.orchestra.run.smithi088.stdout:(20/20): containernetworking-plugins-1.1.1-3.mo 24 MB/s | 18 MB 00:00 2023-01-25T05:48:54.438 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:48:54.438 INFO:teuthology.orchestra.run.smithi088.stdout:Total 30 MB/s | 43 MB 00:01 2023-01-25T05:48:54.787 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:48:54.832 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:48:54.833 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:48:54.865 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:48:54.911 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:48:54.911 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:48:55.479 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:48:55.483 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:48:55.572 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:48:55.575 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:48:56.562 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:48:56.574 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+b0 1/1 2023-01-25T05:48:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-25T05:48:56.688 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:48:56.700 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+b0 1/1 2023-01-25T05:48:56.745 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-25T05:48:56.833 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-25T05:48:56.934 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-25T05:49:14.198 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-25T05:49:14.316 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-25T05:49:14.346 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 2/28 2023-01-25T05:49:14.496 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 2/28 2023-01-25T05:49:14.586 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 3/28 2023-01-25T05:49:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 3/28 2023-01-25T05:49:15.088 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 4/28 2023-01-25T05:49:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 4/28 2023-01-25T05:49:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 5/28 2023-01-25T05:49:16.969 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 5/28 2023-01-25T05:49:17.028 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module_el8.7 6/28 2023-01-25T05:49:17.162 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module_el8.7 6/28 2023-01-25T05:49:17.250 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : yajl-2.1.0-11.el8.x86_64 7/28 2023-01-25T05:49:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : yajl-2.1.0-11.el8.x86_64 7/28 2023-01-25T05:49:17.395 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 8/28 2023-01-25T05:49:17.571 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 8/28 2023-01-25T05:49:17.671 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 9/28 2023-01-25T05:49:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 9/28 2023-01-25T05:49:18.006 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 10/28 2023-01-25T05:49:18.205 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 10/28 2023-01-25T05:49:18.823 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 11/28 2023-01-25T05:49:19.059 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 11/28 2023-01-25T05:49:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 12/28 2023-01-25T05:49:19.336 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 12/28 2023-01-25T05:49:19.338 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 13/28 2023-01-25T05:49:19.524 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 14/28 2023-01-25T05:49:19.572 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 13/28 2023-01-25T05:49:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 14/28 2023-01-25T05:49:19.770 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 15/28 2023-01-25T05:49:19.962 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 16/28 2023-01-25T05:49:19.981 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 16/28 2023-01-25T05:49:19.996 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 15/28 2023-01-25T05:49:20.188 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 16/28 2023-01-25T05:49:20.206 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 16/28 2023-01-25T05:49:20.384 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_ 17/28 2023-01-25T05:49:20.585 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_ 17/28 2023-01-25T05:49:21.171 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 18/28 2023-01-25T05:49:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 18/28 2023-01-25T05:49:21.388 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 19/28 2023-01-25T05:49:21.563 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 20/28 2023-01-25T05:49:21.563 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 21/28 2023-01-25T05:49:21.606 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 19/28 2023-01-25T05:49:21.763 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 21/28 2023-01-25T05:49:21.780 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 20/28 2023-01-25T05:49:21.781 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 21/28 2023-01-25T05:49:21.946 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 22/28 2023-01-25T05:49:21.964 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 21/28 2023-01-25T05:49:22.087 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 23/28 2023-01-25T05:49:22.131 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 22/28 2023-01-25T05:49:22.281 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 23/28 2023-01-25T05:49:22.283 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : criu-3.15-3.module_el8.6.0+926+8bef8ae7.x86_64 24/28 2023-01-25T05:49:22.430 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libslirp-4.4.0-1.module_el8.6.0+926+8bef8ae7.x86_6 25/28 2023-01-25T05:49:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : criu-3.15-3.module_el8.6.0+926+8bef8ae7.x86_64 24/28 2023-01-25T05:49:22.563 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libslirp-4.4.0-1.module_el8.6.0+926+8bef8ae7.x86_6 25/28 2023-01-25T05:49:22.579 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 26/28 2023-01-25T05:49:22.739 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 26/28 2023-01-25T05:49:22.779 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : containernetworking-plugins-1:1.1.1-1.module_el8.7 27/28 2023-01-25T05:49:22.911 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 28/28 2023-01-25T05:49:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : containernetworking-plugins-1:1.1.1-1.module_el8.7 27/28 2023-01-25T05:49:23.104 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 28/28 2023-01-25T05:50:01.958 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 28/28 2023-01-25T05:50:02.116 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 28/28 2023-01-25T05:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 28/28 2023-01-25T05:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 1/28 2023-01-25T05:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 2/28 2023-01-25T05:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 3/28 2023-01-25T05:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 4/28 2023-01-25T05:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 5/28 2023-01-25T05:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 6/28 2023-01-25T05:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 7/28 2023-01-25T05:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 8/28 2023-01-25T05:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 9/28 2023-01-25T05:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 10/28 2023-01-25T05:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 11/28 2023-01-25T05:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : yajl-2.1.0-11.el8.x86_64 12/28 2023-01-25T05:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_ 13/28 2023-01-25T05:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 14/28 2023-01-25T05:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 15/28 2023-01-25T05:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 16/28 2023-01-25T05:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 17/28 2023-01-25T05:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : containernetworking-plugins-1:1.1.1-1.module_el8.7 18/28 2023-01-25T05:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 19/28 2023-01-25T05:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : criu-3.15-3.module_el8.6.0+926+8bef8ae7.x86_64 20/28 2023-01-25T05:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 21/28 2023-01-25T05:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 22/28 2023-01-25T05:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 23/28 2023-01-25T05:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libslirp-4.4.0-1.module_el8.6.0+926+8bef8ae7.x86_6 24/28 2023-01-25T05:50:02.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/28 2023-01-25T05:50:02.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 26/28 2023-01-25T05:50:02.497 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 27/28 2023-01-25T05:50:02.642 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 28/28 2023-01-25T05:50:02.643 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 1/28 2023-01-25T05:50:02.643 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 2/28 2023-01-25T05:50:02.643 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 3/28 2023-01-25T05:50:02.643 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 4/28 2023-01-25T05:50:02.643 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 5/28 2023-01-25T05:50:02.644 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 6/28 2023-01-25T05:50:02.644 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 7/28 2023-01-25T05:50:02.644 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 8/28 2023-01-25T05:50:02.644 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 9/28 2023-01-25T05:50:02.645 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 10/28 2023-01-25T05:50:02.645 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 11/28 2023-01-25T05:50:02.645 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : yajl-2.1.0-11.el8.x86_64 12/28 2023-01-25T05:50:02.645 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_ 13/28 2023-01-25T05:50:02.645 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 14/28 2023-01-25T05:50:02.646 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 15/28 2023-01-25T05:50:02.646 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 16/28 2023-01-25T05:50:02.646 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 17/28 2023-01-25T05:50:02.646 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : containernetworking-plugins-1:1.1.1-1.module_el8.7 18/28 2023-01-25T05:50:02.646 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 19/28 2023-01-25T05:50:02.646 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : criu-3.15-3.module_el8.6.0+926+8bef8ae7.x86_64 20/28 2023-01-25T05:50:02.647 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 21/28 2023-01-25T05:50:02.647 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 22/28 2023-01-25T05:50:02.647 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 23/28 2023-01-25T05:50:02.647 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libslirp-4.4.0-1.module_el8.6.0+926+8bef8ae7.x86_6 24/28 2023-01-25T05:50:02.648 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/28 2023-01-25T05:50:02.648 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 26/28 2023-01-25T05:50:02.648 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 27/28 2023-01-25T05:50:03.530 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 28/28 2023-01-25T05:50:03.530 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:50:03.530 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-01-25T05:50:03.530 INFO:teuthology.orchestra.run.smithi089.stdout: conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.530 INFO:teuthology.orchestra.run.smithi089.stdout: container-selinux-2:2.189.0-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-25T05:50:03.531 INFO:teuthology.orchestra.run.smithi089.stdout: containernetworking-plugins-1:1.1.1-3.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.531 INFO:teuthology.orchestra.run.smithi089.stdout: criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.531 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.531 INFO:teuthology.orchestra.run.smithi089.stdout: libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.531 INFO:teuthology.orchestra.run.smithi089.stdout: runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.532 INFO:teuthology.orchestra.run.smithi089.stdout: slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.532 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:50:03.532 INFO:teuthology.orchestra.run.smithi089.stdout: aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.532 INFO:teuthology.orchestra.run.smithi089.stdout: buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.533 INFO:teuthology.orchestra.run.smithi089.stdout: cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-25T05:50:03.533 INFO:teuthology.orchestra.run.smithi089.stdout: crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.533 INFO:teuthology.orchestra.run.smithi089.stdout: netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.533 INFO:teuthology.orchestra.run.smithi089.stdout: python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-25T05:50:03.533 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-01-25T05:50:03.534 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-01-25T05:50:03.534 INFO:teuthology.orchestra.run.smithi089.stdout: skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.534 INFO:teuthology.orchestra.run.smithi089.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2023-01-25T05:50:03.534 INFO:teuthology.orchestra.run.smithi089.stdout: udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 2023-01-25T05:50:03.534 INFO:teuthology.orchestra.run.smithi089.stdout: yajl-2.1.0-11.el8.x86_64 2023-01-25T05:50:03.535 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:50:03.535 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:50:03.608 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 28/28 2023-01-25T05:50:03.609 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:50:03.609 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-01-25T05:50:03.609 INFO:teuthology.orchestra.run.smithi088.stdout: conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.609 INFO:teuthology.orchestra.run.smithi088.stdout: container-selinux-2:2.189.0-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-25T05:50:03.610 INFO:teuthology.orchestra.run.smithi088.stdout: containernetworking-plugins-1:1.1.1-3.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.610 INFO:teuthology.orchestra.run.smithi088.stdout: criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.610 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.610 INFO:teuthology.orchestra.run.smithi088.stdout: libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.610 INFO:teuthology.orchestra.run.smithi088.stdout: runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.611 INFO:teuthology.orchestra.run.smithi088.stdout: slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.611 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:50:03.611 INFO:teuthology.orchestra.run.smithi088.stdout: aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.611 INFO:teuthology.orchestra.run.smithi088.stdout: buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.611 INFO:teuthology.orchestra.run.smithi088.stdout: cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-25T05:50:03.612 INFO:teuthology.orchestra.run.smithi088.stdout: crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.612 INFO:teuthology.orchestra.run.smithi088.stdout: netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.612 INFO:teuthology.orchestra.run.smithi088.stdout: python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-25T05:50:03.612 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-01-25T05:50:03.612 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-01-25T05:50:03.613 INFO:teuthology.orchestra.run.smithi088.stdout: skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-25T05:50:03.613 INFO:teuthology.orchestra.run.smithi088.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2023-01-25T05:50:03.613 INFO:teuthology.orchestra.run.smithi088.stdout: udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 2023-01-25T05:50:03.613 INFO:teuthology.orchestra.run.smithi088.stdout: yajl-2.1.0-11.el8.x86_64 2023-01-25T05:50:03.613 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:50:03.614 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:50:03.836 DEBUG:teuthology.parallel:result is None 2023-01-25T05:50:03.945 DEBUG:teuthology.parallel:result is None 2023-01-25T05:50:03.945 INFO:teuthology.run_tasks:Running task install... 2023-01-25T05:50:03.954 DEBUG:teuthology.task.install:project ceph 2023-01-25T05:50:03.954 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}} 2023-01-25T05:50:03.955 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'} 2023-01-25T05:50:03.955 INFO:teuthology.task.install:Using flavor: default 2023-01-25T05:50:03.961 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T05:50:03.962 INFO:teuthology.task.install:extra packages: [] 2023-01-25T05:50:03.962 DEBUG:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2023-01-25T05:50:04.001 INFO:teuthology.orchestra.run.smithi088.stdout:CentOSStream 2023-01-25T05:50:04.002 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T05:50:04.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo lsb_release -is 2023-01-25T05:50:04.003 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'tag': None, 'wait_for_package': False} 2023-01-25T05:50:04.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2023-01-25T05:50:04.040 INFO:teuthology.orchestra.run.smithi089.stdout:CentOSStream 2023-01-25T05:50:04.041 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T05:50:04.041 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'tag': None, 'wait_for_package': False} 2023-01-25T05:50:04.042 DEBUG:teuthology.orchestra.run.smithi089:> sudo lsb_release -is 2023-01-25T05:50:04.079 INFO:teuthology.orchestra.run.smithi088.stdout:CentOSStream 2023-01-25T05:50:04.080 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T05:50:04.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T05:50:04.119 INFO:teuthology.orchestra.run.smithi089.stdout:CentOSStream 2023-01-25T05:50:04.120 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T05:50:04.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T05:50:04.234 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/ 2023-01-25T05:50:04.234 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1963.g61996d73 2023-01-25T05:50:04.269 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/ 2023-01-25T05:50:04.270 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1963.g61996d73 2023-01-25T05:50:04.351 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T05:50:04.352 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T05:50:04.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T05:50:04.379 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T05:50:04.380 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/61996d73ab738798e4ee0055c86457f5c459da4a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T05:50:04.383 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T05:50:04.384 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T05:50:04.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T05:50:04.412 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T05:50:04.412 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/61996d73ab738798e4ee0055c86457f5c459da4a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T05:50:04.450 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T05:50:04.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T05:50:04.526 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T05:50:04.557 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T05:50:04.593 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-01-25T05:50:04.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-01-25T05:50:04.624 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-01-25T05:50:04.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-01-25T05:50:04.843 INFO:teuthology.orchestra.run.smithi088.stdout:61 files removed 2023-01-25T05:50:04.871 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw 2023-01-25T05:50:04.874 INFO:teuthology.orchestra.run.smithi089.stdout:61 files removed 2023-01-25T05:50:04.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw 2023-01-25T05:50:05.554 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 288 kB/s | 80 kB 00:00 2023-01-25T05:50:05.580 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 292 kB/s | 80 kB 00:00 2023-01-25T05:50:05.838 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 38 kB/s | 9.4 kB 00:00 2023-01-25T05:50:05.898 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-01-25T05:50:06.097 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2023-01-25T05:50:06.173 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-01-25T05:50:10.985 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-8 - AppStream 5.7 MB/s | 27 MB 00:04 2023-01-25T05:50:11.266 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - AppStream 5.3 MB/s | 27 MB 00:05 2023-01-25T05:50:18.193 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-8 - BaseOS 12 MB/s | 27 MB 00:02 2023-01-25T05:50:18.357 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - BaseOS 12 MB/s | 27 MB 00:02 2023-01-25T05:50:22.475 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-8 - Extras 155 kB/s | 18 kB 00:00 2023-01-25T05:50:22.639 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - Extras 143 kB/s | 18 kB 00:00 2023-01-25T05:50:22.885 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-8 - PowerTools 20 MB/s | 5.6 MB 00:00 2023-01-25T05:50:23.033 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-8 - PowerTools 21 MB/s | 5.6 MB 00:00 2023-01-25T05:50:24.118 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-01-25T05:50:24.282 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-01-25T05:50:26.294 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 13 MB 00:02 2023-01-25T05:50:26.416 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 6.7 MB/s | 13 MB 00:01 2023-01-25T05:50:29.678 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 305 kB/s | 24 kB 00:00 2023-01-25T05:50:29.690 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 436 kB/s | 24 kB 00:00 2023-01-25T05:50:33.127 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:50:33.130 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:50:33.130 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:50:33.131 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:50:33.131 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:50:33.131 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 13 M 2023-01-25T05:50:33.131 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-01-25T05:50:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T05:50:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T05:50:33.132 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T05:50:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.0.0-1963.g61996d73.el8 ceph 5.2 M 2023-01-25T05:50:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 M 2023-01-25T05:50:33.132 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 k 2023-01-25T05:50:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T05:50:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 767 k 2023-01-25T05:50:33.133 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T05:50:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-25T05:50:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 474 k 2023-01-25T05:50:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-25T05:50:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.5 M 2023-01-25T05:50:33.134 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T05:50:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-25T05:50:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse 2023-01-25T05:50:33.135 INFO:teuthology.orchestra.run.smithi089.stdout: x86_64 2:18.0.0-1963.g61996d73.el8 ceph 45 k 2023-01-25T05:50:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 115 k 2023-01-25T05:50:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.0.0-1963.g61996d73.el8 ceph 190 k 2023-01-25T05:50:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-25T05:50:33.136 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.0.0-1963.g61996d73.el8 ceph 371 k 2023-01-25T05:50:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 365 k 2023-01-25T05:50:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 107 k 2023-01-25T05:50:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T05:50:33.137 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:50:33.137 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:50:33.138 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:50:33.138 INFO:teuthology.orchestra.run.smithi089.stdout:Install 21 Packages 2023-01-25T05:50:33.138 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2023-01-25T05:50:33.138 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:50:33.139 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 62 M 2023-01-25T05:50:33.139 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:50:33.140 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:50:33.143 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:50:33.143 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:50:33.143 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:50:33.143 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:50:33.143 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 13 M 2023-01-25T05:50:33.144 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-01-25T05:50:33.144 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T05:50:33.144 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T05:50:33.144 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T05:50:33.144 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:18.0.0-1963.g61996d73.el8 ceph 5.2 M 2023-01-25T05:50:33.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 M 2023-01-25T05:50:33.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 k 2023-01-25T05:50:33.145 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T05:50:33.145 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 767 k 2023-01-25T05:50:33.145 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T05:50:33.146 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-25T05:50:33.146 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 474 k 2023-01-25T05:50:33.146 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-25T05:50:33.146 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.5 M 2023-01-25T05:50:33.146 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T05:50:33.147 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-25T05:50:33.147 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse 2023-01-25T05:50:33.147 INFO:teuthology.orchestra.run.smithi088.stdout: x86_64 2:18.0.0-1963.g61996d73.el8 ceph 45 k 2023-01-25T05:50:33.147 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 115 k 2023-01-25T05:50:33.147 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:18.0.0-1963.g61996d73.el8 ceph 190 k 2023-01-25T05:50:33.148 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-25T05:50:33.148 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:18.0.0-1963.g61996d73.el8 ceph 371 k 2023-01-25T05:50:33.148 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 365 k 2023-01-25T05:50:33.148 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 107 k 2023-01-25T05:50:33.149 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T05:50:33.149 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:50:33.149 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:50:33.149 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:50:33.149 INFO:teuthology.orchestra.run.smithi088.stdout:Install 21 Packages 2023-01-25T05:50:33.150 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 2 Packages 2023-01-25T05:50:33.150 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:50:33.150 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 62 M 2023-01-25T05:50:33.151 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:50:34.387 INFO:teuthology.orchestra.run.smithi089.stdout:(1/23): ceph-base-18.0.0-1963.g61996d73.el8.x86 4.2 MB/s | 5.2 MB 00:01 2023-01-25T05:50:34.425 INFO:teuthology.orchestra.run.smithi088.stdout:(1/23): ceph-base-18.0.0-1963.g61996d73.el8.x86 4.1 MB/s | 5.2 MB 00:01 2023-01-25T05:50:34.471 INFO:teuthology.orchestra.run.smithi089.stdout:(2/23): ceph-selinux-18.0.0-1963.g61996d73.el8. 293 kB/s | 24 kB 00:00 2023-01-25T05:50:34.509 INFO:teuthology.orchestra.run.smithi088.stdout:(2/23): ceph-selinux-18.0.0-1963.g61996d73.el8. 292 kB/s | 24 kB 00:00 2023-01-25T05:50:34.721 INFO:teuthology.orchestra.run.smithi089.stdout:(3/23): libcephfs2-18.0.0-1963.g61996d73.el8.x8 3.0 MB/s | 767 kB 00:00 2023-01-25T05:50:34.842 INFO:teuthology.orchestra.run.smithi088.stdout:(3/23): libcephfs2-18.0.0-1963.g61996d73.el8.x8 2.2 MB/s | 767 kB 00:00 2023-01-25T05:50:34.896 INFO:teuthology.orchestra.run.smithi089.stdout:(4/23): libradosstriper1-18.0.0-1963.g61996d73. 2.6 MB/s | 474 kB 00:00 2023-01-25T05:50:35.018 INFO:teuthology.orchestra.run.smithi088.stdout:(4/23): libradosstriper1-18.0.0-1963.g61996d73. 2.6 MB/s | 474 kB 00:00 2023-01-25T05:50:35.913 INFO:teuthology.orchestra.run.smithi089.stdout:(5/23): ceph-radosgw-18.0.0-1963.g61996d73.el8. 4.7 MB/s | 13 MB 00:02 2023-01-25T05:50:35.980 INFO:teuthology.orchestra.run.smithi089.stdout:(6/23): python3-ceph-argparse-18.0.0-1963.g6199 671 kB/s | 45 kB 00:00 2023-01-25T05:50:36.039 INFO:teuthology.orchestra.run.smithi089.stdout:(7/23): python3-ceph-common-18.0.0-1963.g61996d 1.9 MB/s | 115 kB 00:00 2023-01-25T05:50:36.076 INFO:teuthology.orchestra.run.smithi088.stdout:(5/23): ceph-radosgw-18.0.0-1963.g61996d73.el8. 4.4 MB/s | 13 MB 00:02 2023-01-25T05:50:36.122 INFO:teuthology.orchestra.run.smithi089.stdout:(8/23): python3-cephfs-18.0.0-1963.g61996d73.el 2.2 MB/s | 190 kB 00:00 2023-01-25T05:50:36.143 INFO:teuthology.orchestra.run.smithi088.stdout:(6/23): python3-ceph-argparse-18.0.0-1963.g6199 672 kB/s | 45 kB 00:00 2023-01-25T05:50:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:(7/23): python3-ceph-common-18.0.0-1963.g61996d 1.3 MB/s | 115 kB 00:00 2023-01-25T05:50:36.256 INFO:teuthology.orchestra.run.smithi089.stdout:(9/23): python3-rados-18.0.0-1963.g61996d73.el8 2.7 MB/s | 371 kB 00:00 2023-01-25T05:50:36.310 INFO:teuthology.orchestra.run.smithi088.stdout:(8/23): python3-cephfs-18.0.0-1963.g61996d73.el 2.2 MB/s | 190 kB 00:00 2023-01-25T05:50:36.400 INFO:teuthology.orchestra.run.smithi089.stdout:(10/23): python3-rbd-18.0.0-1963.g61996d73.el8. 2.5 MB/s | 365 kB 00:00 2023-01-25T05:50:36.452 INFO:teuthology.orchestra.run.smithi088.stdout:(9/23): python3-rados-18.0.0-1963.g61996d73.el8 2.6 MB/s | 371 kB 00:00 2023-01-25T05:50:36.482 INFO:teuthology.orchestra.run.smithi089.stdout:(11/23): python3-rgw-18.0.0-1963.g61996d73.el8. 1.2 MB/s | 107 kB 00:00 2023-01-25T05:50:36.565 INFO:teuthology.orchestra.run.smithi089.stdout:(12/23): librdkafka-0.11.4-3.el8.x86_64.rpm 4.2 MB/s | 354 kB 00:00 2023-01-25T05:50:36.657 INFO:teuthology.orchestra.run.smithi089.stdout:(13/23): librgw2-18.0.0-1963.g61996d73.el8.x86_ 3.7 MB/s | 6.5 MB 00:01 2023-01-25T05:50:36.691 INFO:teuthology.orchestra.run.smithi089.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2023-01-25T05:50:36.716 INFO:teuthology.orchestra.run.smithi089.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.0 MB/s | 47 kB 00:00 2023-01-25T05:50:36.742 INFO:teuthology.orchestra.run.smithi089.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 520 kB/s | 44 kB 00:00 2023-01-25T05:50:36.794 INFO:teuthology.orchestra.run.smithi088.stdout:(10/23): ceph-common-18.0.0-1963.g61996d73.el8. 6.7 MB/s | 24 MB 00:03 2023-01-25T05:50:36.819 INFO:teuthology.orchestra.run.smithi088.stdout:(11/23): python3-rbd-18.0.0-1963.g61996d73.el8. 994 kB/s | 365 kB 00:00 2023-01-25T05:50:36.844 INFO:teuthology.orchestra.run.smithi088.stdout:(12/23): python3-rgw-18.0.0-1963.g61996d73.el8. 2.1 MB/s | 107 kB 00:00 2023-01-25T05:50:36.875 INFO:teuthology.orchestra.run.smithi089.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 441 kB/s | 59 kB 00:00 2023-01-25T05:50:36.934 INFO:teuthology.orchestra.run.smithi089.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-01-25T05:50:36.946 INFO:teuthology.orchestra.run.smithi088.stdout:(13/23): librgw2-18.0.0-1963.g61996d73.el8.x86_ 3.4 MB/s | 6.5 MB 00:01 2023-01-25T05:50:36.959 INFO:teuthology.orchestra.run.smithi089.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 896 kB/s | 75 kB 00:00 2023-01-25T05:50:37.045 INFO:teuthology.orchestra.run.smithi088.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-01-25T05:50:37.071 INFO:teuthology.orchestra.run.smithi088.stdout:(15/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.4 MB/s | 354 kB 00:00 2023-01-25T05:50:37.088 INFO:teuthology.orchestra.run.smithi088.stdout:(16/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-01-25T05:50:37.104 INFO:teuthology.orchestra.run.smithi088.stdout:(17/23): python3-prettytable-0.7.2-14.el8.noarc 284 kB/s | 44 kB 00:00 2023-01-25T05:50:37.252 INFO:teuthology.orchestra.run.smithi089.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 5.5 MB/s | 1.7 MB 00:00 2023-01-25T05:50:37.297 INFO:teuthology.orchestra.run.smithi088.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 282 kB/s | 59 kB 00:00 2023-01-25T05:50:37.322 INFO:teuthology.orchestra.run.smithi088.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 346 kB/s | 75 kB 00:00 2023-01-25T05:50:37.472 INFO:teuthology.orchestra.run.smithi088.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 763 kB/s | 306 kB 00:00 2023-01-25T05:50:37.561 INFO:teuthology.orchestra.run.smithi089.stdout:(21/23): ceph-common-18.0.0-1963.g61996d73.el8. 5.5 MB/s | 24 MB 00:04 2023-01-25T05:50:37.636 INFO:teuthology.orchestra.run.smithi089.stdout:(22/23): librados2-18.0.0-1963.g61996d73.el8.x8 5.4 MB/s | 3.6 MB 00:00 2023-01-25T05:50:37.864 INFO:teuthology.orchestra.run.smithi088.stdout:(21/23): librbd1-18.0.0-1963.g61996d73.el8.x86_ 9.1 MB/s | 3.6 MB 00:00 2023-01-25T05:50:37.928 INFO:teuthology.orchestra.run.smithi089.stdout:(23/23): librbd1-18.0.0-1963.g61996d73.el8.x86_ 5.3 MB/s | 3.6 MB 00:00 2023-01-25T05:50:37.931 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:50:37.932 INFO:teuthology.orchestra.run.smithi089.stdout:Total 13 MB/s | 62 MB 00:04 2023-01-25T05:50:37.964 INFO:teuthology.orchestra.run.smithi088.stdout:(22/23): librados2-18.0.0-1963.g61996d73.el8.x8 5.7 MB/s | 3.6 MB 00:00 2023-01-25T05:50:37.971 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:50:38.016 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:50:38.017 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:50:38.114 INFO:teuthology.orchestra.run.smithi088.stdout:(23/23): thrift-0.13.0-2.el8.x86_64.rpm 2.1 MB/s | 1.7 MB 00:00 2023-01-25T05:50:38.118 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:50:38.118 INFO:teuthology.orchestra.run.smithi088.stdout:Total 12 MB/s | 62 MB 00:04 2023-01-25T05:50:38.158 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:50:38.204 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:50:38.204 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:50:38.371 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:50:38.374 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:50:38.567 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:50:39.564 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:50:39.759 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:50:39.781 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T05:50:39.942 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T05:50:40.018 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2023-01-25T05:50:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2023-01-25T05:50:40.209 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T05:50:40.352 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T05:50:40.608 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T05:50:40.745 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T05:50:40.825 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T05:50:40.920 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T05:50:40.935 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T05:50:41.052 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T05:50:41.181 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T05:50:41.299 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T05:50:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T05:50:41.519 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T05:50:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T05:50:41.909 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T05:50:41.913 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T05:50:41.983 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T05:50:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T05:50:42.165 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T05:50:42.169 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T05:50:42.341 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T05:50:42.359 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T05:50:42.429 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T05:50:42.486 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T05:50:42.539 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T05:50:42.560 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 10/25 2023-01-25T05:50:42.670 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 10/25 2023-01-25T05:50:42.802 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T05:50:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T05:50:43.017 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T05:50:43.110 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T05:50:43.183 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T05:50:43.249 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T05:50:43.276 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T05:50:43.344 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T05:50:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2023-01-25T05:50:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2023-01-25T05:50:44.234 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2023-01-25T05:50:44.312 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2023-01-25T05:50:44.442 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T05:50:44.514 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T05:50:44.526 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T05:50:44.599 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T05:50:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 17/25 2023-01-25T05:50:44.801 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 17/25 2023-01-25T05:50:44.883 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-25T05:50:45.026 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-25T05:50:45.108 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 19/25 2023-01-25T05:50:45.252 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 19/25 2023-01-25T05:50:48.944 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T05:50:49.097 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T05:50:49.183 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T05:50:49.334 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T05:50:49.745 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T05:50:49.899 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T05:50:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T05:50:50.181 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T05:50:50.238 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T05:50:50.324 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T05:50:50.408 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T05:50:50.533 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T05:51:09.640 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T05:51:09.640 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-01-25T05:51:09.640 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-01-25T05:51:09.641 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-01-25T05:51:09.641 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /run 2023-01-25T05:51:09.641 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-01-25T05:51:09.641 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-01-25T05:51:09.641 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-01-25T05:51:09.642 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-01-25T05:51:09.642 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-01-25T05:51:09.642 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:09.923 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T05:51:09.923 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2023-01-25T05:51:09.923 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2023-01-25T05:51:09.923 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-01-25T05:51:09.925 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2023-01-25T05:51:09.926 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2023-01-25T05:51:09.926 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2023-01-25T05:51:09.926 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2023-01-25T05:51:09.926 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2023-01-25T05:51:09.926 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-01-25T05:51:09.927 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:11.020 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T05:51:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T05:51:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T05:51:11.265 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T05:51:11.265 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T05:51:11.349 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T05:51:11.370 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T05:51:11.370 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T05:51:11.573 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T05:51:11.573 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T05:51:11.966 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T05:51:11.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 1/25 2023-01-25T05:51:11.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2/25 2023-01-25T05:51:11.967 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T05:51:11.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T05:51:11.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T05:51:11.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 6/25 2023-01-25T05:51:11.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T05:51:11.968 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 8/25 2023-01-25T05:51:11.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 9/25 2023-01-25T05:51:11.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 10/25 2023-01-25T05:51:11.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T05:51:11.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T05:51:11.969 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 13/25 2023-01-25T05:51:11.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-25T05:51:11.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-25T05:51:11.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-25T05:51:11.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-25T05:51:11.970 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-25T05:51:11.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-01-25T05:51:11.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-01-25T05:51:11.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-01-25T05:51:11.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T05:51:11.971 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T05:51:11.972 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 24/25 2023-01-25T05:51:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T05:51:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 1/25 2023-01-25T05:51:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2/25 2023-01-25T05:51:12.294 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T05:51:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T05:51:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T05:51:12.295 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 6/25 2023-01-25T05:51:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T05:51:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 8/25 2023-01-25T05:51:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 9/25 2023-01-25T05:51:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 10/25 2023-01-25T05:51:12.297 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T05:51:12.297 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T05:51:12.297 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 13/25 2023-01-25T05:51:12.297 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-25T05:51:12.297 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-25T05:51:12.298 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-25T05:51:12.298 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-25T05:51:12.298 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-25T05:51:12.298 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-01-25T05:51:12.298 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-01-25T05:51:12.299 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-01-25T05:51:12.299 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T05:51:12.299 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T05:51:12.299 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 24/25 2023-01-25T05:51:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T05:51:12.763 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:12.764 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-01-25T05:51:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.764 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:51:12.764 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.765 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T05:51:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T05:51:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T05:51:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.766 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T05:51:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T05:51:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T05:51:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.767 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T05:51:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.768 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T05:51:12.769 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:12.770 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:51:13.051 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-test 2023-01-25T05:51:13.164 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T05:51:13.164 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:13.165 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-01-25T05:51:13.165 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.165 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.165 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:51:13.165 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.166 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.166 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.166 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.166 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T05:51:13.167 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.167 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T05:51:13.167 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T05:51:13.167 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.167 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T05:51:13.168 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.168 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T05:51:13.168 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T05:51:13.168 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.168 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.169 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.169 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T05:51:13.169 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.169 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.169 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:13.169 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T05:51:13.170 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:13.170 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:51:13.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-test 2023-01-25T05:51:13.782 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:44 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:14.253 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:45 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:14.922 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:51:14.923 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:14.923 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:51:14.923 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:14.923 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:51:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.0.0-1963.g61996d73.el8 ceph 47 M 2023-01-25T05:51:14.924 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T05:51:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-25T05:51:14.924 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.0.0-1963.g61996d73.el8 ceph 137 k 2023-01-25T05:51:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-25T05:51:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-25T05:51:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-25T05:51:14.925 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:14.925 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:51:14.926 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:14.926 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2023-01-25T05:51:14.926 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:14.927 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 48 M 2023-01-25T05:51:14.927 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 218 M 2023-01-25T05:51:14.927 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:51:14.994 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 2.9 MB/s | 202 kB 00:00 2023-01-25T05:51:15.028 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 5.6 MB/s | 187 kB 00:00 2023-01-25T05:51:15.090 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.2 MB/s | 323 kB 00:00 2023-01-25T05:51:15.112 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 3.1 MB/s | 71 kB 00:00 2023-01-25T05:51:15.145 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): libcephsqlite-18.0.0-1963.g61996d73.el8. 623 kB/s | 137 kB 00:00 2023-01-25T05:51:15.393 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:51:15.395 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:51:15.395 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:51:15.395 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:51:15.395 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:51:15.395 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:18.0.0-1963.g61996d73.el8 ceph 47 M 2023-01-25T05:51:15.396 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T05:51:15.396 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-25T05:51:15.396 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:18.0.0-1963.g61996d73.el8 ceph 137 k 2023-01-25T05:51:15.396 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-25T05:51:15.397 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-25T05:51:15.397 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-25T05:51:15.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:15.397 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:51:15.397 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:51:15.398 INFO:teuthology.orchestra.run.smithi088.stdout:Install 6 Packages 2023-01-25T05:51:15.398 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:15.398 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 48 M 2023-01-25T05:51:15.398 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 218 M 2023-01-25T05:51:15.398 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:51:15.473 INFO:teuthology.orchestra.run.smithi088.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-01-25T05:51:15.498 INFO:teuthology.orchestra.run.smithi088.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.6 MB/s | 187 kB 00:00 2023-01-25T05:51:15.532 INFO:teuthology.orchestra.run.smithi088.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2023-01-25T05:51:15.557 INFO:teuthology.orchestra.run.smithi088.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 71 kB 00:00 2023-01-25T05:51:15.674 INFO:teuthology.orchestra.run.smithi088.stdout:(5/6): libcephsqlite-18.0.0-1963.g61996d73.el8. 494 kB/s | 137 kB 00:00 2023-01-25T05:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): ceph-test-18.0.0-1963.g61996d73.el8.x86_ 19 MB/s | 47 MB 00:02 2023-01-25T05:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout:Total 19 MB/s | 48 MB 00:02 2023-01-25T05:51:17.453 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:51:17.473 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:51:17.474 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:51:17.752 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:51:17.756 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:51:18.236 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:51:18.414 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-25T05:51:18.614 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-25T05:51:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T05:51:18.859 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T05:51:19.090 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-25T05:51:19.261 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T05:51:22.015 INFO:teuthology.orchestra.run.smithi088.stdout:(6/6): ceph-test-18.0.0-1963.g61996d73.el8.x86_ 7.2 MB/s | 47 MB 00:06 2023-01-25T05:51:22.018 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:51:22.018 INFO:teuthology.orchestra.run.smithi088.stdout:Total 7.3 MB/s | 48 MB 00:06 2023-01-25T05:51:22.062 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:51:22.081 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:51:22.082 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:51:22.359 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:51:22.362 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:51:22.850 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:51:23.054 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-25T05:51:23.245 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-25T05:51:23.401 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T05:51:23.477 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T05:51:23.647 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-25T05:51:23.818 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T05:51:23.843 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T05:51:24.099 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T05:51:24.395 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T05:51:24.395 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 1/6 2023-01-25T05:51:24.396 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2/6 2023-01-25T05:51:24.396 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-25T05:51:24.396 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-25T05:51:24.396 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-25T05:51:24.923 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-25T05:51:24.923 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:24.924 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:51:24.924 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:24.924 INFO:teuthology.orchestra.run.smithi089.stdout: jq-1.6-6.el8.x86_64 2023-01-25T05:51:24.924 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:24.925 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T05:51:24.925 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T05:51:24.925 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T05:51:24.925 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:24.926 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:51:25.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph 2023-01-25T05:51:25.873 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:27.020 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:51:27.023 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2023-01-25T05:51:27.023 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:51:27.023 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2023-01-25T05:51:27.024 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:51:27.024 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.4 k 2023-01-25T05:51:27.024 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T05:51:27.024 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.0.0-1963.g61996d73.el8 ceph 2.3 M 2023-01-25T05:51:27.024 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.0.0-1963.g61996d73.el8 ceph 1.5 M 2023-01-25T05:51:27.025 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 236 k 2023-01-25T05:51:27.025 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.9 M 2023-01-25T05:51:27.025 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 17 M 2023-01-25T05:51:27.025 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T05:51:27.026 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T05:51:27.026 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-25T05:51:27.026 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T05:51:27.026 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T05:51:27.026 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-25T05:51:27.027 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T05:51:27.027 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T05:51:27.027 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T05:51:27.027 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-25T05:51:27.027 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-25T05:51:27.028 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T05:51:27.028 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T05:51:27.028 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T05:51:27.028 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-25T05:51:27.029 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-25T05:51:27.029 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-25T05:51:27.029 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T05:51:27.029 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T05:51:27.029 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T05:51:27.030 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T05:51:27.030 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T05:51:27.030 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T05:51:27.030 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T05:51:27.030 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-25T05:51:27.031 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T05:51:27.031 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:27.031 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:51:27.031 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2023-01-25T05:51:27.031 INFO:teuthology.orchestra.run.smithi089.stdout:Install 32 Packages 2023-01-25T05:51:27.032 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:27.032 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 28 M 2023-01-25T05:51:27.033 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 110 M 2023-01-25T05:51:27.033 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:51:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:(1/32): ceph-18.0.0-1963.g61996d73.el8.x86_64.r 42 kB/s | 6.4 kB 00:00 2023-01-25T05:51:27.416 INFO:teuthology.orchestra.run.smithi089.stdout:(2/32): ceph-mds-18.0.0-1963.g61996d73.el8.x86_ 5.9 MB/s | 2.3 MB 00:00 2023-01-25T05:51:27.456 INFO:teuthology.orchestra.run.smithi089.stdout:(3/32): ceph-mgr-18.0.0-1963.g61996d73.el8.x86_ 3.6 MB/s | 1.5 MB 00:00 2023-01-25T05:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1963.g6199 2.3 MB/s | 236 kB 00:00 2023-01-25T05:51:27.616 INFO:teuthology.orchestra.run.smithi089.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-01-25T05:51:27.641 INFO:teuthology.orchestra.run.smithi089.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2023-01-25T05:51:27.666 INFO:teuthology.orchestra.run.smithi089.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.0 MB/s | 103 kB 00:00 2023-01-25T05:51:27.692 INFO:teuthology.orchestra.run.smithi089.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-01-25T05:51:27.725 INFO:teuthology.orchestra.run.smithi089.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2023-01-25T05:51:27.751 INFO:teuthology.orchestra.run.smithi089.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.3 MB/s | 237 kB 00:00 2023-01-25T05:51:27.792 INFO:teuthology.orchestra.run.smithi089.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 13 MB/s | 559 kB 00:00 2023-01-25T05:51:27.818 INFO:teuthology.orchestra.run.smithi089.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.3 MB/s | 109 kB 00:00 2023-01-25T05:51:27.951 INFO:teuthology.orchestra.run.smithi089.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 327 kB/s | 44 kB 00:00 2023-01-25T05:51:28.052 INFO:teuthology.orchestra.run.smithi089.stdout:(14/32): ceph-mon-18.0.0-1963.g61996d73.el8.x86 4.5 MB/s | 3.9 MB 00:00 2023-01-25T05:51:28.148 INFO:teuthology.orchestra.run.smithi089.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 942 kB/s | 185 kB 00:00 2023-01-25T05:51:28.319 INFO:teuthology.orchestra.run.smithi089.stdout:(16/32): ceph-osd-18.0.0-1963.g61996d73.el8.x86 19 MB/s | 17 MB 00:00 2023-01-25T05:51:28.345 INFO:teuthology.orchestra.run.smithi089.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 590 kB/s | 173 kB 00:00 2023-01-25T05:51:28.370 INFO:teuthology.orchestra.run.smithi089.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.7 MB/s | 384 kB 00:00 2023-01-25T05:51:28.392 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T05:51:28.395 INFO:teuthology.orchestra.run.smithi089.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 349 kB/s | 18 kB 00:00 2023-01-25T05:51:28.412 INFO:teuthology.orchestra.run.smithi089.stdout:(20/32): python3-jaraco-6.2-6.el8.noarch.rpm 120 kB/s | 11 kB 00:00 2023-01-25T05:51:28.429 INFO:teuthology.orchestra.run.smithi089.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 830 kB/s | 49 kB 00:00 2023-01-25T05:51:28.446 INFO:teuthology.orchestra.run.smithi089.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2023-01-25T05:51:28.471 INFO:teuthology.orchestra.run.smithi089.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 370 kB/s | 16 kB 00:00 2023-01-25T05:51:28.488 INFO:teuthology.orchestra.run.smithi089.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 446 kB/s | 19 kB 00:00 2023-01-25T05:51:28.514 INFO:teuthology.orchestra.run.smithi089.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 568 kB/s | 24 kB 00:00 2023-01-25T05:51:28.539 INFO:teuthology.orchestra.run.smithi089.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 583 kB/s | 29 kB 00:00 2023-01-25T05:51:28.556 INFO:teuthology.orchestra.run.smithi089.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 656 kB/s | 27 kB 00:00 2023-01-25T05:51:28.597 INFO:teuthology.orchestra.run.smithi089.stdout:(28/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2023-01-25T05:51:28.655 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T05:51:28.673 INFO:teuthology.orchestra.run.smithi089.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.8 MB/s | 241 kB 00:00 2023-01-25T05:51:28.698 INFO:teuthology.orchestra.run.smithi089.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.7 MB/s | 251 kB 00:00 2023-01-25T05:51:28.723 INFO:teuthology.orchestra.run.smithi089.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 678 kB/s | 85 kB 00:00 2023-01-25T05:51:28.754 INFO:teuthology.orchestra.run.smithi089.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 303 kB/s | 23 kB 00:00 2023-01-25T05:51:28.755 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:51:28.755 INFO:teuthology.orchestra.run.smithi089.stdout:Total 16 MB/s | 28 MB 00:01 2023-01-25T05:51:28.829 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:51:28.865 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:51:28.866 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:51:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T05:51:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 1/6 2023-01-25T05:51:28.960 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2/6 2023-01-25T05:51:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-25T05:51:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-25T05:51:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-25T05:51:29.095 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:51:29.099 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:51:29.477 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-25T05:51:29.478 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:29.479 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:51:29.480 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:29.480 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-6.el8.x86_64 2023-01-25T05:51:29.480 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:29.480 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T05:51:29.482 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T05:51:29.482 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T05:51:29.482 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:29.482 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:51:29.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph 2023-01-25T05:51:30.274 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:51:30.464 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:01 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:30.565 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T05:51:30.842 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T05:51:31.106 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-25T05:51:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-25T05:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-25T05:51:31.610 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:51:31.613 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2023-01-25T05:51:31.613 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:51:31.613 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2023-01-25T05:51:31.614 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:51:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.4 k 2023-01-25T05:51:31.614 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T05:51:31.614 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:18.0.0-1963.g61996d73.el8 ceph 2.3 M 2023-01-25T05:51:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:18.0.0-1963.g61996d73.el8 ceph 1.5 M 2023-01-25T05:51:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 236 k 2023-01-25T05:51:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.9 M 2023-01-25T05:51:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 17 M 2023-01-25T05:51:31.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T05:51:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T05:51:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-25T05:51:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T05:51:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T05:51:31.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-25T05:51:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T05:51:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T05:51:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T05:51:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-25T05:51:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-25T05:51:31.617 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T05:51:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T05:51:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T05:51:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-25T05:51:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-25T05:51:31.618 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-25T05:51:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T05:51:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T05:51:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T05:51:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T05:51:31.619 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T05:51:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T05:51:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T05:51:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-25T05:51:31.620 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T05:51:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:31.621 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:51:31.621 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2023-01-25T05:51:31.621 INFO:teuthology.orchestra.run.smithi088.stdout:Install 32 Packages 2023-01-25T05:51:31.621 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:31.622 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 28 M 2023-01-25T05:51:31.622 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 110 M 2023-01-25T05:51:31.623 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:51:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-25T05:51:31.783 INFO:teuthology.orchestra.run.smithi088.stdout:(1/32): ceph-18.0.0-1963.g61996d73.el8.x86_64.r 39 kB/s | 6.4 kB 00:00 2023-01-25T05:51:31.945 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-25T05:51:31.967 INFO:teuthology.orchestra.run.smithi088.stdout:(2/32): ceph-mgr-18.0.0-1963.g61996d73.el8.x86_ 4.4 MB/s | 1.5 MB 00:00 2023-01-25T05:51:32.018 INFO:teuthology.orchestra.run.smithi088.stdout:(3/32): ceph-mds-18.0.0-1963.g61996d73.el8.x86_ 5.7 MB/s | 2.3 MB 00:00 2023-01-25T05:51:32.084 INFO:teuthology.orchestra.run.smithi088.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1963.g6199 3.4 MB/s | 236 kB 00:00 2023-01-25T05:51:32.143 INFO:teuthology.orchestra.run.smithi088.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-01-25T05:51:32.157 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-25T05:51:32.169 INFO:teuthology.orchestra.run.smithi088.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2023-01-25T05:51:32.219 INFO:teuthology.orchestra.run.smithi088.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.0 MB/s | 103 kB 00:00 2023-01-25T05:51:32.252 INFO:teuthology.orchestra.run.smithi088.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-01-25T05:51:32.286 INFO:teuthology.orchestra.run.smithi088.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2023-01-25T05:51:32.311 INFO:teuthology.orchestra.run.smithi088.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.3 MB/s | 237 kB 00:00 2023-01-25T05:51:32.345 INFO:teuthology.orchestra.run.smithi088.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 16 MB/s | 559 kB 00:00 2023-01-25T05:51:32.371 INFO:teuthology.orchestra.run.smithi088.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.3 MB/s | 109 kB 00:00 2023-01-25T05:51:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-25T05:51:32.504 INFO:teuthology.orchestra.run.smithi088.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 327 kB/s | 44 kB 00:00 2023-01-25T05:51:32.627 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-25T05:51:32.655 INFO:teuthology.orchestra.run.smithi088.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.2 MB/s | 185 kB 00:00 2023-01-25T05:51:32.721 INFO:teuthology.orchestra.run.smithi088.stdout:(15/32): ceph-mon-18.0.0-1963.g61996d73.el8.x86 4.1 MB/s | 3.9 MB 00:00 2023-01-25T05:51:32.889 INFO:teuthology.orchestra.run.smithi088.stdout:(16/32): ceph-osd-18.0.0-1963.g61996d73.el8.x86 18 MB/s | 17 MB 00:00 2023-01-25T05:51:32.906 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-25T05:51:32.914 INFO:teuthology.orchestra.run.smithi088.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 667 kB/s | 173 kB 00:00 2023-01-25T05:51:32.964 INFO:teuthology.orchestra.run.smithi088.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 351 kB/s | 18 kB 00:00 2023-01-25T05:51:32.981 INFO:teuthology.orchestra.run.smithi088.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-01-25T05:51:33.006 INFO:teuthology.orchestra.run.smithi088.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 1.1 MB/s | 49 kB 00:00 2023-01-25T05:51:33.090 INFO:teuthology.orchestra.run.smithi088.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 540 kB/s | 59 kB 00:00 2023-01-25T05:51:33.140 INFO:teuthology.orchestra.run.smithi088.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 919 kB/s | 384 kB 00:00 2023-01-25T05:51:33.154 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-25T05:51:33.157 INFO:teuthology.orchestra.run.smithi088.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-01-25T05:51:33.199 INFO:teuthology.orchestra.run.smithi088.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 320 kB/s | 19 kB 00:00 2023-01-25T05:51:33.224 INFO:teuthology.orchestra.run.smithi088.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2023-01-25T05:51:33.250 INFO:teuthology.orchestra.run.smithi088.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 259 kB/s | 24 kB 00:00 2023-01-25T05:51:33.275 INFO:teuthology.orchestra.run.smithi088.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 387 kB/s | 29 kB 00:00 2023-01-25T05:51:33.300 INFO:teuthology.orchestra.run.smithi088.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2023-01-25T05:51:33.376 INFO:teuthology.orchestra.run.smithi088.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2023-01-25T05:51:33.426 INFO:teuthology.orchestra.run.smithi088.stdout:(30/32): python3-zc-lockfile-2.0-2.el8.noarch.r 458 kB/s | 23 kB 00:00 2023-01-25T05:51:33.451 INFO:teuthology.orchestra.run.smithi088.stdout:(31/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.2 MB/s | 241 kB 00:00 2023-01-25T05:51:33.497 INFO:teuthology.orchestra.run.smithi088.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.1 MB/s | 251 kB 00:00 2023-01-25T05:51:33.500 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:51:33.500 INFO:teuthology.orchestra.run.smithi088.stdout:Total 15 MB/s | 28 MB 00:01 2023-01-25T05:51:33.560 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-25T05:51:33.583 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:51:33.620 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:51:33.621 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:51:33.849 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:51:33.853 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:51:33.853 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-25T05:51:34.058 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-25T05:51:34.308 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-25T05:51:34.528 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T05:51:34.826 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-25T05:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-25T05:51:35.109 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:51:35.319 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-25T05:51:35.387 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T05:51:35.547 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T05:51:35.698 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T05:51:35.814 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T05:51:35.937 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-25T05:51:36.113 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T05:51:36.213 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-25T05:51:36.361 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-25T05:51:36.386 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-25T05:51:36.574 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-25T05:51:36.734 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-25T05:51:36.784 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-25T05:51:36.987 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-25T05:51:37.088 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T05:51:37.195 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-25T05:51:37.468 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 27/32 2023-01-25T05:51:37.491 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-25T05:51:37.699 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T05:51:37.729 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-25T05:51:37.959 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-25T05:51:38.324 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-25T05:51:38.601 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-25T05:51:38.789 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-25T05:51:38.980 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-25T05:51:39.197 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T05:51:39.198 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T05:51:39.417 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T05:51:39.514 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-25T05:51:39.762 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-25T05:51:39.805 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T05:51:39.986 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-25T05:51:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T05:51:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T05:51:40.223 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T05:51:40.408 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T05:51:40.426 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T05:51:40.444 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T05:51:40.581 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T05:51:40.667 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T05:51:40.941 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-25T05:51:41.010 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T05:51:41.011 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 1/32 2023-01-25T05:51:41.011 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2/32 2023-01-25T05:51:41.011 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 3/32 2023-01-25T05:51:41.011 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 4/32 2023-01-25T05:51:41.012 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 5/32 2023-01-25T05:51:41.012 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 6/32 2023-01-25T05:51:41.012 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-25T05:51:41.012 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-25T05:51:41.012 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-25T05:51:41.013 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-25T05:51:41.013 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-25T05:51:41.013 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-25T05:51:41.013 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-25T05:51:41.013 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-25T05:51:41.014 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-25T05:51:41.014 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-25T05:51:41.014 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T05:51:41.014 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-25T05:51:41.014 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-25T05:51:41.015 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-25T05:51:41.015 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-25T05:51:41.016 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-25T05:51:41.016 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-25T05:51:41.016 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-25T05:51:41.016 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-25T05:51:41.017 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-25T05:51:41.017 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-25T05:51:41.017 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-25T05:51:41.017 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-25T05:51:41.017 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-25T05:51:41.018 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-25T05:51:41.293 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-25T05:51:41.635 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T05:51:42.016 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-25T05:51:42.016 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:42.016 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:51:42.017 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:42.017 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:42.017 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:42.017 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:51:42.017 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:42.018 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:42.018 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T05:51:42.018 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T05:51:42.018 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T05:51:42.019 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T05:51:42.019 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T05:51:42.019 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T05:51:42.019 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T05:51:42.019 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T05:51:42.020 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T05:51:42.020 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T05:51:42.020 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T05:51:42.020 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T05:51:42.020 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T05:51:42.021 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T05:51:42.021 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T05:51:42.021 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T05:51:42.021 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T05:51:42.021 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T05:51:42.022 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T05:51:42.022 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T05:51:42.022 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T05:51:42.022 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T05:51:42.022 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T05:51:42.023 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T05:51:42.023 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T05:51:42.023 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T05:51:42.023 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:42.023 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:51:42.028 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 27/32 2023-01-25T05:51:42.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-base 2023-01-25T05:51:42.259 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T05:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:13 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:43.750 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T05:51:43.991 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T05:51:44.008 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:51:44.107 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:51:44.108 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T05:51:44.108 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:51:44.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install cephadm 2023-01-25T05:51:44.376 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T05:51:44.797 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T05:51:44.915 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:15 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:45.013 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T05:51:45.229 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T05:51:45.247 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T05:51:45.378 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T05:51:45.822 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T05:51:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 1/32 2023-01-25T05:51:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2/32 2023-01-25T05:51:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 3/32 2023-01-25T05:51:45.823 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 4/32 2023-01-25T05:51:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 5/32 2023-01-25T05:51:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 6/32 2023-01-25T05:51:45.824 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-25T05:51:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-25T05:51:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-25T05:51:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-25T05:51:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-25T05:51:45.825 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-25T05:51:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-25T05:51:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-25T05:51:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-25T05:51:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-25T05:51:45.826 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T05:51:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-25T05:51:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-25T05:51:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-25T05:51:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-25T05:51:45.827 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-25T05:51:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-25T05:51:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-25T05:51:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-25T05:51:45.828 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-25T05:51:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-25T05:51:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-25T05:51:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-25T05:51:45.829 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-25T05:51:45.830 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-25T05:51:46.049 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:51:46.050 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:46.051 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:51:46.051 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:46.051 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:51:46.051 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 82 k 2023-01-25T05:51:46.052 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:46.052 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:51:46.052 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:46.053 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T05:51:46.053 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:46.053 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 82 k 2023-01-25T05:51:46.053 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 374 k 2023-01-25T05:51:46.053 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:51:46.229 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm-18.0.0-1963.g61996d73.el8.noarch.rpm 463 kB/s | 82 kB 00:00 2023-01-25T05:51:46.230 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:51:46.230 INFO:teuthology.orchestra.run.smithi089.stdout:Total 460 kB/s | 82 kB 00:00 2023-01-25T05:51:46.230 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:51:46.237 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:51:46.238 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:51:46.239 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:51:46.243 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:51:46.285 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:51:46.893 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-25T05:51:46.893 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:46.893 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:51:46.894 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:46.894 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:46.894 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:46.894 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:51:46.894 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:46.895 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:46.895 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T05:51:46.895 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T05:51:46.895 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T05:51:46.895 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T05:51:46.896 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T05:51:46.896 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T05:51:46.896 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T05:51:46.896 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T05:51:46.896 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T05:51:46.897 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T05:51:46.897 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T05:51:46.897 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T05:51:46.897 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T05:51:46.897 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T05:51:46.898 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T05:51:46.898 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T05:51:46.898 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T05:51:46.898 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T05:51:46.898 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T05:51:46.899 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T05:51:46.899 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T05:51:46.899 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T05:51:46.899 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T05:51:46.899 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T05:51:46.900 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T05:51:46.900 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T05:51:46.900 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:51:47.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-base 2023-01-25T05:51:47.852 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:18 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:51:48.057 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:51:48.799 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:51:48.799 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:48.799 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:51:48.799 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:51:48.800 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:48.800 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:51:48.897 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:51:48.998 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:51:48.999 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T05:51:48.999 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:51:49.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T05:51:49.085 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install cephadm 2023-01-25T05:51:49.787 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:20 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:49.807 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:20 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:50.923 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:51:50.924 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:50.924 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-01-25T05:51:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:51:50.925 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1963.g61996d73.el8 ceph 165 k 2023-01-25T05:51:50.925 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:50.925 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:51:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T05:51:50.926 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 165 k 2023-01-25T05:51:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 503 k 2023-01-25T05:51:50.926 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:51:50.945 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:51:50.946 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:51:50.946 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:51:50.947 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:51:50.947 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:51:50.947 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 82 k 2023-01-25T05:51:50.947 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:50.947 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:51:50.948 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:51:50.948 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T05:51:50.948 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:50.948 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 82 k 2023-01-25T05:51:50.948 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 374 k 2023-01-25T05:51:50.949 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:51:51.126 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-immutable-object-cache-18.0.0-1963.g61996d 820 kB/s | 165 kB 00:00 2023-01-25T05:51:51.127 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:51:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:Total 815 kB/s | 165 kB 00:00 2023-01-25T05:51:51.128 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:51:51.138 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:51:51.139 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:51:51.164 INFO:teuthology.orchestra.run.smithi088.stdout:cephadm-18.0.0-1963.g61996d73.el8.noarch.rpm 380 kB/s | 82 kB 00:00 2023-01-25T05:51:51.164 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:51:51.165 INFO:teuthology.orchestra.run.smithi088.stdout:Total 378 kB/s | 82 kB 00:00 2023-01-25T05:51:51.165 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:51:51.172 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:51:51.172 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:51:51.174 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:51:51.178 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:51:51.187 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:51:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:51:51.227 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:51:51.309 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:51:51.474 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T05:51:51.907 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T05:51:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T05:51:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:52.428 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:51:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:52.429 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:51:52.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr 2023-01-25T05:51:52.815 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:51:53.005 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:51:53.247 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:51:53.347 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:24 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:53.803 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:51:53.803 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:53.803 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:51:53.803 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:51:53.804 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:53.804 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:51:54.043 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T05:51:54.386 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:51:54.487 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:51:54.488 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T05:51:54.488 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:51:54.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T05:51:54.767 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:25 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:55.305 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:26 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:55.911 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:51:55.912 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:51:55.912 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-01-25T05:51:55.913 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:51:55.913 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:51:55.913 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1963.g61996d73.el8 ceph 165 k 2023-01-25T05:51:55.913 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:55.913 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:51:55.914 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:51:55.914 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T05:51:55.914 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:55.914 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 165 k 2023-01-25T05:51:55.914 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 503 k 2023-01-25T05:51:55.915 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:51:56.450 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:51:56.451 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:56.451 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:51:56.452 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:56.452 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:51:56.452 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 1.7 M 2023-01-25T05:51:56.452 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T05:51:56.452 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 23 k 2023-01-25T05:51:56.453 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 15 k 2023-01-25T05:51:56.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-25T05:51:56.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T05:51:56.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T05:51:56.453 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:56.454 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:51:56.454 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:51:56.454 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2023-01-25T05:51:56.454 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:56.455 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.0 M 2023-01-25T05:51:56.455 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 8.2 M 2023-01-25T05:51:56.455 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:51:56.637 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-immutable-object-cache-18.0.0-1963.g61996d 229 kB/s | 165 kB 00:00 2023-01-25T05:51:56.637 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:51:56.638 INFO:teuthology.orchestra.run.smithi088.stdout:Total 228 kB/s | 165 kB 00:00 2023-01-25T05:51:56.638 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:51:56.651 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:51:56.651 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:51:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:51:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:51:56.871 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1963.g619 55 kB/s | 23 kB 00:00 2023-01-25T05:51:56.896 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1963.g6199 33 kB/s | 15 kB 00:00 2023-01-25T05:51:56.955 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 509 kB/s | 43 kB 00:00 2023-01-25T05:51:56.997 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 335 kB/s | 34 kB 00:00 2023-01-25T05:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): ceph-mgr-dashboard-18.0.0-1963.g61996d73 2.9 MB/s | 1.7 MB 00:00 2023-01-25T05:51:57.064 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:51:57.139 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.0 MB/s | 196 kB 00:00 2023-01-25T05:51:57.141 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:51:57.141 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.9 MB/s | 2.0 MB 00:00 2023-01-25T05:51:57.151 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:51:57.160 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:51:57.160 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:51:57.219 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T05:51:57.243 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:51:57.247 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:51:57.552 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:51:57.654 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T05:51:57.795 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-25T05:51:58.031 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-25T05:51:58.189 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T05:51:58.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:58.189 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:51:58.189 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:51:58.190 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:51:58.190 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:51:58.266 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-25T05:51:58.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr 2023-01-25T05:51:58.403 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 4/6 2023-01-25T05:51:58.803 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 5/6 2023-01-25T05:51:59.038 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T05:51:59.105 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:30 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:51:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T05:51:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 1/6 2023-01-25T05:51:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 2/6 2023-01-25T05:51:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 3/6 2023-01-25T05:51:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-25T05:51:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-25T05:51:59.853 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-25T05:51:59.853 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:59.853 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:51:59.854 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:51:59.854 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:51:59.854 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:51:59.854 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T05:51:59.854 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T05:51:59.855 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T05:51:59.855 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:51:59.855 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:51:59.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T05:52:00.141 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:00.240 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:00.242 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T05:52:00.242 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:00.331 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T05:52:00.678 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:31 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:01.052 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout:===================================================================================================== 2023-01-25T05:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout:===================================================================================================== 2023-01-25T05:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 7.4 M 2023-01-25T05:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T05:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-01-25T05:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-01-25T05:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-25T05:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-25T05:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-25T05:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-25T05:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-25T05:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout:===================================================================================================== 2023-01-25T05:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout:Install 8 Packages 2023-01-25T05:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 35 M 2023-01-25T05:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 210 M 2023-01-25T05:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:52:01.995 INFO:teuthology.orchestra.run.smithi089.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 27 MB/s | 4.9 MB 00:00 2023-01-25T05:52:02.120 INFO:teuthology.orchestra.run.smithi089.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 30 MB/s | 3.7 MB 00:00 2023-01-25T05:52:02.154 INFO:teuthology.orchestra.run.smithi089.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-25T05:52:02.186 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:02.187 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:52:02.188 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:02.188 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:52:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 1.7 M 2023-01-25T05:52:02.188 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T05:52:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 23 k 2023-01-25T05:52:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 15 k 2023-01-25T05:52:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-25T05:52:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T05:52:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T05:52:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:02.190 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:52:02.190 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:02.190 INFO:teuthology.orchestra.run.smithi088.stdout:Install 6 Packages 2023-01-25T05:52:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:02.191 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 2.0 M 2023-01-25T05:52:02.192 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 8.2 M 2023-01-25T05:52:02.192 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:52:02.217 INFO:teuthology.orchestra.run.smithi089.stdout:(4/8): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-01-25T05:52:02.246 INFO:teuthology.orchestra.run.smithi089.stdout:(5/8): libgfortran-8.5.0-18.el8.x86_64.rpm 19 MB/s | 645 kB 00:00 2023-01-25T05:52:02.272 INFO:teuthology.orchestra.run.smithi089.stdout:(6/8): libquadmath-8.5.0-18.el8.x86_64.rpm 6.7 MB/s | 172 kB 00:00 2023-01-25T05:52:02.397 INFO:teuthology.orchestra.run.smithi089.stdout:(7/8): ceph-mgr-diskprediction-local-18.0.0-196 13 MB/s | 7.4 MB 00:00 2023-01-25T05:52:02.590 INFO:teuthology.orchestra.run.smithi088.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1963.g619 58 kB/s | 23 kB 00:00 2023-01-25T05:52:02.614 INFO:teuthology.orchestra.run.smithi089.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 30 MB/s | 14 MB 00:00 2023-01-25T05:52:02.615 INFO:teuthology.orchestra.run.smithi088.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1963.g6199 34 kB/s | 15 kB 00:00 2023-01-25T05:52:02.617 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:02.617 INFO:teuthology.orchestra.run.smithi089.stdout:Total 44 MB/s | 35 MB 00:00 2023-01-25T05:52:02.665 INFO:teuthology.orchestra.run.smithi088.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 567 kB/s | 43 kB 00:00 2023-01-25T05:52:02.732 INFO:teuthology.orchestra.run.smithi088.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 288 kB/s | 34 kB 00:00 2023-01-25T05:52:02.774 INFO:teuthology.orchestra.run.smithi088.stdout:(5/6): ceph-mgr-dashboard-18.0.0-1963.g61996d73 2.9 MB/s | 1.7 MB 00:00 2023-01-25T05:52:02.833 INFO:teuthology.orchestra.run.smithi088.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.1 MB/s | 196 kB 00:00 2023-01-25T05:52:02.835 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:02.835 INFO:teuthology.orchestra.run.smithi088.stdout:Total 3.1 MB/s | 2.0 MB 00:00 2023-01-25T05:52:02.845 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:52:02.847 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:52:02.853 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:52:02.854 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:52:02.866 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:52:02.866 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:52:02.934 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:52:02.938 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:52:03.184 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:52:03.188 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:52:03.209 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:52:03.439 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-25T05:52:03.668 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-25T05:52:03.744 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:52:03.845 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-25T05:52:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T05:52:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 4/6 2023-01-25T05:52:04.057 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T05:52:04.188 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T05:52:04.395 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 5/6 2023-01-25T05:52:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T05:52:04.814 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T05:52:04.916 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T05:52:04.916 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 1/6 2023-01-25T05:52:04.916 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 2/6 2023-01-25T05:52:04.916 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 3/6 2023-01-25T05:52:04.917 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-25T05:52:04.917 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-25T05:52:05.021 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T05:52:05.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-25T05:52:05.423 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:05.424 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:52:05.424 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:05.424 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:05.424 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:05.424 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T05:52:05.425 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T05:52:05.425 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T05:52:05.425 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:05.425 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:05.527 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T05:52:05.624 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T05:52:05.846 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T05:52:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:37 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T05:52:07.143 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T05:52:07.404 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:07.406 INFO:teuthology.orchestra.run.smithi088.stdout:===================================================================================================== 2023-01-25T05:52:07.406 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:52:07.406 INFO:teuthology.orchestra.run.smithi088.stdout:===================================================================================================== 2023-01-25T05:52:07.406 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:52:07.407 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 7.4 M 2023-01-25T05:52:07.407 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T05:52:07.407 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-01-25T05:52:07.407 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-01-25T05:52:07.407 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-25T05:52:07.408 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-25T05:52:07.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-25T05:52:07.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-25T05:52:07.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-25T05:52:07.409 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:07.409 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:52:07.409 INFO:teuthology.orchestra.run.smithi088.stdout:===================================================================================================== 2023-01-25T05:52:07.409 INFO:teuthology.orchestra.run.smithi088.stdout:Install 8 Packages 2023-01-25T05:52:07.409 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:07.410 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 35 M 2023-01-25T05:52:07.410 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 210 M 2023-01-25T05:52:07.410 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:52:07.437 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T05:52:07.672 INFO:teuthology.orchestra.run.smithi088.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-01-25T05:52:07.739 INFO:teuthology.orchestra.run.smithi088.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2023-01-25T05:52:07.772 INFO:teuthology.orchestra.run.smithi088.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-25T05:52:07.881 INFO:teuthology.orchestra.run.smithi088.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 18 MB/s | 3.7 MB 00:00 2023-01-25T05:52:07.923 INFO:teuthology.orchestra.run.smithi088.stdout:(5/8): libgfortran-8.5.0-18.el8.x86_64.rpm 15 MB/s | 645 kB 00:00 2023-01-25T05:52:07.956 INFO:teuthology.orchestra.run.smithi088.stdout:(6/8): libquadmath-8.5.0-18.el8.x86_64.rpm 5.1 MB/s | 172 kB 00:00 2023-01-25T05:52:08.082 INFO:teuthology.orchestra.run.smithi088.stdout:(7/8): ceph-mgr-diskprediction-local-18.0.0-196 11 MB/s | 7.4 MB 00:00 2023-01-25T05:52:08.299 INFO:teuthology.orchestra.run.smithi088.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 26 MB/s | 14 MB 00:00 2023-01-25T05:52:08.301 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:08.301 INFO:teuthology.orchestra.run.smithi088.stdout:Total 40 MB/s | 35 MB 00:00 2023-01-25T05:52:08.532 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:52:08.550 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:52:08.551 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:52:08.867 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:52:08.870 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:52:09.167 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T05:52:09.423 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:52:09.616 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T05:52:09.740 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T05:52:09.865 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T05:52:10.432 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-25T05:52:10.463 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T05:52:10.612 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T05:52:10.632 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T05:52:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T05:52:10.937 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 1/8 2023-01-25T05:52:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-25T05:52:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-25T05:52:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T05:52:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T05:52:10.938 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-25T05:52:10.939 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 7/8 2023-01-25T05:52:11.233 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T05:52:11.423 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T05:52:11.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 8/8 2023-01-25T05:52:11.445 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:11.446 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:52:11.447 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:11.447 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-01-25T05:52:11.447 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-01-25T05:52:11.447 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-25T05:52:11.447 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-25T05:52:11.448 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T05:52:11.449 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T05:52:11.449 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-25T05:52:11.449 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:11.450 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:11.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-rook 2023-01-25T05:52:12.090 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T05:52:12.297 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:43 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:12.485 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T05:52:13.334 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T05:52:13.444 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:13.445 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================== 2023-01-25T05:52:13.445 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:52:13.446 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================== 2023-01-25T05:52:13.446 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:52:13.446 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 47 k 2023-01-25T05:52:13.446 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T05:52:13.447 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T05:52:13.447 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T05:52:13.447 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T05:52:13.447 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-25T05:52:13.447 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-25T05:52:13.448 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T05:52:13.448 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-25T05:52:13.448 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-25T05:52:13.448 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-25T05:52:13.448 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-25T05:52:13.448 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T05:52:13.449 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T05:52:13.449 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:13.449 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:52:13.449 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================== 2023-01-25T05:52:13.449 INFO:teuthology.orchestra.run.smithi089.stdout:Install 13 Packages 2023-01-25T05:52:13.450 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:13.450 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 1.9 M 2023-01-25T05:52:13.451 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 25 M 2023-01-25T05:52:13.451 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 119 kB/s | 27 kB 00:00 2023-01-25T05:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 80 kB/s | 20 kB 00:00 2023-01-25T05:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-01-25T05:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.8 MB/s | 110 kB 00:00 2023-01-25T05:52:13.782 INFO:teuthology.orchestra.run.smithi089.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 2.6 MB/s | 155 kB 00:00 2023-01-25T05:52:13.807 INFO:teuthology.orchestra.run.smithi089.stdout:(6/13): ceph-mgr-rook-18.0.0-1963.g61996d73.el8 132 kB/s | 47 kB 00:00 2023-01-25T05:52:13.833 INFO:teuthology.orchestra.run.smithi089.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 563 kB/s | 43 kB 00:00 2023-01-25T05:52:13.916 INFO:teuthology.orchestra.run.smithi089.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 246 kB/s | 33 kB 00:00 2023-01-25T05:52:13.941 INFO:teuthology.orchestra.run.smithi089.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 122 kB/s | 16 kB 00:00 2023-01-25T05:52:13.967 INFO:teuthology.orchestra.run.smithi089.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 607 kB/s | 81 kB 00:00 2023-01-25T05:52:14.017 INFO:teuthology.orchestra.run.smithi089.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 1.2 MB/s | 61 kB 00:00 2023-01-25T05:52:14.043 INFO:teuthology.orchestra.run.smithi089.stdout:(12/13): python3-rsa-4.8-1.el8.noarch.rpm 610 kB/s | 61 kB 00:00 2023-01-25T05:52:14.159 INFO:teuthology.orchestra.run.smithi089.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.8 MB/s | 1.2 MB 00:00 2023-01-25T05:52:14.161 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:14.161 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.7 MB/s | 1.9 MB 00:00 2023-01-25T05:52:14.213 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:52:14.228 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:52:14.228 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:52:14.325 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:52:14.328 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:52:14.830 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T05:52:15.183 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T05:52:15.337 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-25T05:52:15.605 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-25T05:52:15.884 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-25T05:52:16.108 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-25T05:52:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-25T05:52:16.419 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-25T05:52:16.589 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T05:52:16.698 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-25T05:52:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T05:52:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 1/8 2023-01-25T05:52:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-25T05:52:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-25T05:52:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T05:52:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T05:52:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-25T05:52:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 7/8 2023-01-25T05:52:16.940 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T05:52:17.482 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 8/8 2023-01-25T05:52:17.483 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:17.483 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:52:17.483 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:17.484 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-01-25T05:52:17.484 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-01-25T05:52:17.484 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-25T05:52:17.484 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-25T05:52:17.484 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T05:52:17.485 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T05:52:17.485 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-25T05:52:17.485 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:17.485 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:17.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-rook 2023-01-25T05:52:18.014 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T05:52:18.325 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:49 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:18.346 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-25T05:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T05:52:19.221 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-25T05:52:19.385 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T05:52:19.465 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:19.467 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================== 2023-01-25T05:52:19.467 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:52:19.467 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================== 2023-01-25T05:52:19.468 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:52:19.468 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 47 k 2023-01-25T05:52:19.468 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T05:52:19.468 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T05:52:19.469 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T05:52:19.469 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T05:52:19.469 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-25T05:52:19.469 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-25T05:52:19.469 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T05:52:19.470 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-25T05:52:19.470 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-25T05:52:19.470 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-25T05:52:19.470 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-25T05:52:19.471 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T05:52:19.471 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T05:52:19.471 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:19.471 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:52:19.471 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================== 2023-01-25T05:52:19.472 INFO:teuthology.orchestra.run.smithi088.stdout:Install 13 Packages 2023-01-25T05:52:19.472 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:19.473 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 1.9 M 2023-01-25T05:52:19.473 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 25 M 2023-01-25T05:52:19.473 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:52:19.549 INFO:teuthology.orchestra.run.smithi088.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 342 kB/s | 27 kB 00:00 2023-01-25T05:52:19.574 INFO:teuthology.orchestra.run.smithi088.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 194 kB/s | 20 kB 00:00 2023-01-25T05:52:19.599 INFO:teuthology.orchestra.run.smithi088.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.6 MB/s | 126 kB 00:00 2023-01-25T05:52:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2023-01-25T05:52:19.650 INFO:teuthology.orchestra.run.smithi088.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.0 MB/s | 155 kB 00:00 2023-01-25T05:52:19.666 INFO:teuthology.orchestra.run.smithi088.stdout:(6/13): ceph-mgr-rook-18.0.0-1963.g61996d73.el8 242 kB/s | 47 kB 00:00 2023-01-25T05:52:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T05:52:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 1/13 2023-01-25T05:52:19.682 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-25T05:52:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-25T05:52:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-25T05:52:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-25T05:52:19.683 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T05:52:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T05:52:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-25T05:52:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T05:52:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-25T05:52:19.684 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-25T05:52:19.685 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-25T05:52:19.685 INFO:teuthology.orchestra.run.smithi088.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 722 kB/s | 43 kB 00:00 2023-01-25T05:52:19.767 INFO:teuthology.orchestra.run.smithi088.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 162 kB/s | 16 kB 00:00 2023-01-25T05:52:19.784 INFO:teuthology.orchestra.run.smithi088.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 246 kB/s | 33 kB 00:00 2023-01-25T05:52:19.818 INFO:teuthology.orchestra.run.smithi088.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 606 kB/s | 81 kB 00:00 2023-01-25T05:52:19.885 INFO:teuthology.orchestra.run.smithi088.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 612 kB/s | 61 kB 00:00 2023-01-25T05:52:19.901 INFO:teuthology.orchestra.run.smithi088.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 734 kB/s | 61 kB 00:00 2023-01-25T05:52:20.027 INFO:teuthology.orchestra.run.smithi088.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.5 MB/s | 1.2 MB 00:00 2023-01-25T05:52:20.028 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:20.029 INFO:teuthology.orchestra.run.smithi088.stdout:Total 3.4 MB/s | 1.9 MB 00:00 2023-01-25T05:52:20.082 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:52:20.097 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:52:20.097 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:52:20.193 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:52:20.196 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:52:20.246 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-25T05:52:20.246 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:20.246 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:52:20.246 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:20.247 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T05:52:20.247 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T05:52:20.247 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T05:52:20.247 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T05:52:20.247 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T05:52:20.248 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T05:52:20.248 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T05:52:20.248 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T05:52:20.248 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T05:52:20.248 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T05:52:20.249 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T05:52:20.249 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T05:52:20.249 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:20.249 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:20.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T05:52:20.712 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:52:21.007 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T05:52:21.090 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:52 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-25T05:52:21.498 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-25T05:52:21.786 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-25T05:52:22.044 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-25T05:52:22.241 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:22.242 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:22.242 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:52:22.242 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:22.243 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:52:22.243 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 120 k 2023-01-25T05:52:22.244 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T05:52:22.244 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T05:52:22.245 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-25T05:52:22.245 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-25T05:52:22.245 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T05:52:22.245 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:22.245 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:52:22.246 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:22.246 INFO:teuthology.orchestra.run.smithi089.stdout:Install 5 Packages 2023-01-25T05:52:22.246 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:22.247 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 6.0 M 2023-01-25T05:52:22.247 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 26 M 2023-01-25T05:52:22.247 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:52:22.284 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-25T05:52:22.370 INFO:teuthology.orchestra.run.smithi089.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 4.2 MB/s | 538 kB 00:00 2023-01-25T05:52:22.437 INFO:teuthology.orchestra.run.smithi089.stdout:(2/5): ceph-mgr-cephadm-18.0.0-1963.g61996d73.e 623 kB/s | 120 kB 00:00 2023-01-25T05:52:22.529 INFO:teuthology.orchestra.run.smithi089.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-01-25T05:52:22.571 INFO:teuthology.orchestra.run.smithi089.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 452 kB/s | 60 kB 00:00 2023-01-25T05:52:22.584 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-25T05:52:22.621 INFO:teuthology.orchestra.run.smithi089.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.9 MB/s | 476 kB 00:00 2023-01-25T05:52:22.623 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:22.624 INFO:teuthology.orchestra.run.smithi089.stdout:Total 16 MB/s | 6.0 MB 00:00 2023-01-25T05:52:22.674 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:52:22.685 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:52:22.685 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:52:22.794 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:52:22.797 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:52:22.816 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T05:52:23.073 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:52:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-01-25T05:52:23.899 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T05:52:24.240 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-25T05:52:24.383 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T05:52:24.701 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T05:52:24.789 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-01-25T05:52:25.022 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-25T05:52:25.096 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T05:52:25.187 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T05:52:25.284 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T05:52:25.495 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T05:52:25.495 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 1/13 2023-01-25T05:52:25.496 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-25T05:52:25.496 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-25T05:52:25.496 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-25T05:52:25.496 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-25T05:52:25.497 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T05:52:25.497 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T05:52:25.497 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-25T05:52:25.497 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T05:52:25.497 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-25T05:52:25.498 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-25T05:52:25.498 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-25T05:52:25.585 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T05:52:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/5 2023-01-25T05:52:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-01-25T05:52:25.586 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-01-25T05:52:25.587 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T05:52:26.079 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-01-25T05:52:26.079 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:26.079 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:52:26.079 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:26.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T05:52:26.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T05:52:26.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T05:52:26.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T05:52:26.080 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:26.081 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:26.162 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-25T05:52:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:26.163 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:52:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:26.163 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T05:52:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T05:52:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T05:52:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T05:52:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T05:52:26.164 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T05:52:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T05:52:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T05:52:26.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T05:52:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T05:52:26.166 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T05:52:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T05:52:26.167 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:26.167 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:26.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-fuse 2023-01-25T05:52:26.288 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T05:52:26.898 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:57 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:27.008 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:58 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:28.053 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:28.053 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:52:28.054 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:28.054 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:52:28.054 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 845 k 2023-01-25T05:52:28.054 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-01-25T05:52:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-25T05:52:28.055 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:28.055 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:52:28.055 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:28.055 INFO:teuthology.orchestra.run.smithi089.stdout:Install 2 Packages 2023-01-25T05:52:28.056 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:28.056 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 928 k 2023-01-25T05:52:28.057 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 2.9 M 2023-01-25T05:52:28.057 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:52:28.128 INFO:teuthology.orchestra.run.smithi089.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-01-25T05:52:28.148 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:28.149 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:28.149 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:52:28.149 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:28.149 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:52:28.150 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 120 k 2023-01-25T05:52:28.150 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T05:52:28.150 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T05:52:28.150 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-25T05:52:28.150 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-25T05:52:28.151 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T05:52:28.152 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:28.152 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:52:28.153 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:28.153 INFO:teuthology.orchestra.run.smithi088.stdout:Install 5 Packages 2023-01-25T05:52:28.153 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:28.154 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 6.0 M 2023-01-25T05:52:28.155 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 26 M 2023-01-25T05:52:28.155 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:52:28.238 INFO:teuthology.orchestra.run.smithi088.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 6.1 MB/s | 538 kB 00:00 2023-01-25T05:52:28.338 INFO:teuthology.orchestra.run.smithi088.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2023-01-25T05:52:28.345 INFO:teuthology.orchestra.run.smithi089.stdout:(2/2): ceph-fuse-18.0.0-1963.g61996d73.el8.x86_ 2.8 MB/s | 845 kB 00:00 2023-01-25T05:52:28.346 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:28.347 INFO:teuthology.orchestra.run.smithi089.stdout:Total 3.1 MB/s | 928 kB 00:00 2023-01-25T05:52:28.356 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:52:28.377 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:52:28.377 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:52:28.390 INFO:teuthology.orchestra.run.smithi088.stdout:(3/5): ceph-mgr-cephadm-18.0.0-1963.g61996d73.e 506 kB/s | 120 kB 00:00 2023-01-25T05:52:28.471 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:52:28.474 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:52:28.480 INFO:teuthology.orchestra.run.smithi088.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.9 MB/s | 476 kB 00:00 2023-01-25T05:52:28.506 INFO:teuthology.orchestra.run.smithi088.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 361 kB/s | 60 kB 00:00 2023-01-25T05:52:28.507 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:28.508 INFO:teuthology.orchestra.run.smithi088.stdout:Total 17 MB/s | 6.0 MB 00:00 2023-01-25T05:52:28.559 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:52:28.570 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:52:28.570 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:52:28.646 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:52:28.675 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:52:28.679 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:52:28.940 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-25T05:52:28.961 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:52:29.141 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T05:52:29.258 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-01-25T05:52:29.550 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T05:52:29.551 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/2 2023-01-25T05:52:30.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-25T05:52:30.089 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:30.089 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:52:30.089 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-25T05:52:30.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:30.090 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:30.237 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T05:52:30.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-volume 2023-01-25T05:52:30.984 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-01-25T05:52:31.050 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:02 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:31.298 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T05:52:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T05:52:31.776 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T05:52:31.776 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/5 2023-01-25T05:52:31.776 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-01-25T05:52:31.776 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-01-25T05:52:31.777 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T05:52:32.199 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:32.199 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:32.200 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-01-25T05:52:32.200 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:32.201 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:52:32.202 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 263 k 2023-01-25T05:52:32.202 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:32.202 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:52:32.202 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:32.202 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T05:52:32.203 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:32.203 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 263 k 2023-01-25T05:52:32.203 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 1.3 M 2023-01-25T05:52:32.203 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:52:32.284 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-01-25T05:52:32.284 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:32.285 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:52:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T05:52:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T05:52:32.285 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T05:52:32.286 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T05:52:32.286 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:32.286 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:32.417 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-volume-18.0.0-1963.g61996d73.el8.noarch.rp 1.2 MB/s | 263 kB 00:00 2023-01-25T05:52:32.418 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:32.418 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.2 MB/s | 263 kB 00:00 2023-01-25T05:52:32.419 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:52:32.424 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-fuse 2023-01-25T05:52:32.428 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:52:32.429 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:52:32.460 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:52:32.463 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:52:32.648 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:52:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:52:33.142 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:04 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:33.358 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:52:33.900 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:52:33.900 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:33.901 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:52:33.901 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:33.901 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:33.901 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:34.088 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados-devel 2023-01-25T05:52:34.287 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:34.288 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:34.288 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:52:34.288 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:34.289 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:52:34.289 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 845 k 2023-01-25T05:52:34.289 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-01-25T05:52:34.289 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-25T05:52:34.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:34.290 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:52:34.290 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:34.290 INFO:teuthology.orchestra.run.smithi088.stdout:Install 2 Packages 2023-01-25T05:52:34.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:34.291 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 928 k 2023-01-25T05:52:34.291 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 2.9 M 2023-01-25T05:52:34.291 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:52:34.354 INFO:teuthology.orchestra.run.smithi088.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.3 MB/s | 83 kB 00:00 2023-01-25T05:52:34.579 INFO:teuthology.orchestra.run.smithi088.stdout:(2/2): ceph-fuse-18.0.0-1963.g61996d73.el8.x86_ 2.9 MB/s | 845 kB 00:00 2023-01-25T05:52:34.580 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:34.581 INFO:teuthology.orchestra.run.smithi088.stdout:Total 3.1 MB/s | 928 kB 00:00 2023-01-25T05:52:34.590 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:52:34.612 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:52:34.612 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:52:34.706 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:52:34.710 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:52:34.814 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:05 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:34.891 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:52:35.158 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-25T05:52:35.383 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T05:52:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T05:52:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/2 2023-01-25T05:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-01-25T05:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 139 k 2023-01-25T05:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T05:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 139 k 2023-01-25T05:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 512 k 2023-01-25T05:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:52:36.382 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-25T05:52:36.382 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:52:36.382 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-25T05:52:36.383 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout:librados-devel-18.0.0-1963.g61996d73.el8.x86_64 317 kB/s | 139 kB 00:00 2023-01-25T05:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout:Total 317 kB/s | 139 kB 00:00 2023-01-25T05:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:52:36.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-volume 2023-01-25T05:52:36.600 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:52:36.788 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:37.088 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:37.317 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:08 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:37.573 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:37.574 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:37.575 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:52:37.575 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:52:37.575 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:37.576 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:37.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs2 2023-01-25T05:52:38.458 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:38.459 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-01-25T05:52:38.459 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:38.459 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:52:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 263 k 2023-01-25T05:52:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:38.460 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:52:38.460 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:38.460 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T05:52:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:38.461 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 263 k 2023-01-25T05:52:38.461 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 1.3 M 2023-01-25T05:52:38.461 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:52:38.537 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:09 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:38.882 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-volume-18.0.0-1963.g61996d73.el8.noarch.rp 622 kB/s | 263 kB 00:00 2023-01-25T05:52:38.883 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:38.883 INFO:teuthology.orchestra.run.smithi088.stdout:Total 621 kB/s | 263 kB 00:00 2023-01-25T05:52:38.883 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:52:38.895 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:52:38.895 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:52:38.925 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:52:38.928 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:52:39.114 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:52:39.376 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:52:39.563 INFO:teuthology.orchestra.run.smithi089.stdout:Package libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:39.664 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:39.665 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T05:52:39.665 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:39.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs-devel 2023-01-25T05:52:39.793 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:52:40.260 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T05:52:40.260 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:40.261 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:52:40.261 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T05:52:40.261 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:40.261 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:40.438 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados-devel 2023-01-25T05:52:40.469 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:11 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:41.172 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:12 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:41.613 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:41.613 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:41.614 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-01-25T05:52:41.614 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:41.614 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:52:41.614 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 30 k 2023-01-25T05:52:41.615 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:41.615 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:52:41.615 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:41.615 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T05:52:41.615 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:41.616 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 30 k 2023-01-25T05:52:41.616 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 137 k 2023-01-25T05:52:41.616 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:52:41.780 INFO:teuthology.orchestra.run.smithi089.stdout:libcephfs-devel-18.0.0-1963.g61996d73.el8.x86_6 185 kB/s | 30 kB 00:00 2023-01-25T05:52:41.780 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:41.780 INFO:teuthology.orchestra.run.smithi089.stdout:Total 183 kB/s | 30 kB 00:00 2023-01-25T05:52:41.781 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:52:41.784 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:52:41.784 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:52:41.795 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:52:41.798 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:52:41.864 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:52:42.113 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:42.313 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:42.314 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:42.314 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-01-25T05:52:42.314 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:42.315 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:52:42.315 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 139 k 2023-01-25T05:52:42.315 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:42.315 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:52:42.315 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:42.316 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T05:52:42.316 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:42.316 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 139 k 2023-01-25T05:52:42.316 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 512 k 2023-01-25T05:52:42.316 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:52:42.376 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:42.513 INFO:teuthology.orchestra.run.smithi088.stdout:librados-devel-18.0.0-1963.g61996d73.el8.x86_64 701 kB/s | 139 kB 00:00 2023-01-25T05:52:42.514 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:42.514 INFO:teuthology.orchestra.run.smithi088.stdout:Total 697 kB/s | 139 kB 00:00 2023-01-25T05:52:42.514 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:52:42.519 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:52:42.519 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:52:42.571 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:52:42.574 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:52:42.694 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:52:42.816 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:42.817 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:42.817 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:52:42.817 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:52:42.817 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:42.818 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:42.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados2 2023-01-25T05:52:43.195 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:43.653 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:14 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:43.747 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:43.747 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:43.747 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:52:43.747 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:52:43.748 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:43.748 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:43.932 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs2 2023-01-25T05:52:44.661 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:15 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:44.697 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T05:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:44.890 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librbd1 2023-01-25T05:52:45.614 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:16 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:45.684 INFO:teuthology.orchestra.run.smithi088.stdout:Package libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:45.785 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:45.787 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T05:52:45.787 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:45.871 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs-devel 2023-01-25T05:52:46.592 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:17 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:46.655 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:46.758 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:46.759 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T05:52:46.759 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:46.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rados 2023-01-25T05:52:47.583 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:18 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:47.737 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:47.738 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:47.738 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-01-25T05:52:47.738 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:47.739 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:52:47.739 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 30 k 2023-01-25T05:52:47.739 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:47.739 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:52:47.740 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:52:47.740 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T05:52:47.740 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:47.740 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 30 k 2023-01-25T05:52:47.741 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 137 k 2023-01-25T05:52:47.741 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:52:47.936 INFO:teuthology.orchestra.run.smithi088.stdout:libcephfs-devel-18.0.0-1963.g61996d73.el8.x86_6 155 kB/s | 30 kB 00:00 2023-01-25T05:52:47.937 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:47.937 INFO:teuthology.orchestra.run.smithi088.stdout:Total 154 kB/s | 30 kB 00:00 2023-01-25T05:52:47.941 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:52:47.941 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:52:47.941 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:52:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:52:47.955 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:52:48.016 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:52:48.204 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:48.465 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T05:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:48.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rgw 2023-01-25T05:52:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:48.946 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:52:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:52:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:52:48.946 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:49.060 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados2 2023-01-25T05:52:49.541 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:20 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:49.780 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:20 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:50.588 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:50.689 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T05:52:50.691 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:50.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-cephfs 2023-01-25T05:52:50.823 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:50.923 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:50.924 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T05:52:50.925 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:51.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librbd1 2023-01-25T05:52:51.512 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:22 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:51.730 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:22 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:52.658 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:52.659 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T05:52:52.660 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:52.771 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:52.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rbd 2023-01-25T05:52:52.873 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:52.874 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T05:52:52.875 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:52.960 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rados 2023-01-25T05:52:53.494 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:24 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:24 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:54.529 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:54.631 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:54.632 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-01-25T05:52:54.632 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:54.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-fuse 2023-01-25T05:52:54.734 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:54.836 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:54.837 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T05:52:54.837 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:54.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rgw 2023-01-25T05:52:55.445 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:26 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:55.648 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:26 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:56.590 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:52:56.591 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:56.591 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2023-01-25T05:52:56.591 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:56.592 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:52:56.592 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 94 k 2023-01-25T05:52:56.592 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:56.592 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:52:56.593 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:52:56.593 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T05:52:56.593 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:56.593 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 94 k 2023-01-25T05:52:56.593 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 280 k 2023-01-25T05:52:56.593 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:52:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:56.793 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-fuse-18.0.0-1963.g61996d73.el8.x86_64.rpm 470 kB/s | 94 kB 00:00 2023-01-25T05:52:56.793 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:52:56.794 INFO:teuthology.orchestra.run.smithi089.stdout:Total 467 kB/s | 94 kB 00:00 2023-01-25T05:52:56.795 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:52:56.795 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:56.795 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T05:52:56.795 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:56.805 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:52:56.805 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:52:56.857 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:52:56.860 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:52:56.883 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-cephfs 2023-01-25T05:52:56.967 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:52:57.469 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:57.599 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:28 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:57.760 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:58.295 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:52:58.296 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:58.296 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:52:58.296 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:52:58.296 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:52:58.297 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:52:58.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-mirror 2023-01-25T05:52:58.635 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:52:58.738 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:52:58.739 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T05:52:58.739 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:52:58.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install python3-rbd 2023-01-25T05:52:59.207 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:30 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:52:59.537 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:30 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:53:00.352 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:53:00.353 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:53:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-01-25T05:53:00.353 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:53:00.354 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:53:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.4 M 2023-01-25T05:53:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:53:00.354 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:53:00.354 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:53:00.355 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T05:53:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:53:00.355 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 3.4 M 2023-01-25T05:53:00.355 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 16 M 2023-01-25T05:53:00.356 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:53:00.579 INFO:teuthology.orchestra.run.smithi088.stdout:Package python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T05:53:00.680 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:53:00.681 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-01-25T05:53:00.682 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:53:00.776 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-fuse 2023-01-25T05:53:01.099 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-mirror-18.0.0-1963.g61996d73.el8.x86_64.rpm 4.6 MB/s | 3.4 MB 00:00 2023-01-25T05:53:01.100 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:53:01.100 INFO:teuthology.orchestra.run.smithi089.stdout:Total 4.6 MB/s | 3.4 MB 00:00 2023-01-25T05:53:01.101 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:53:01.114 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:53:01.115 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:53:01.177 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:53:01.181 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:53:01.510 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:32 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:53:01.625 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:53:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:02.264 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:02.670 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:53:02.670 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:53:02.670 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-01-25T05:53:02.671 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:53:02.671 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:53:02.671 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 94 k 2023-01-25T05:53:02.671 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:02.671 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:53:02.672 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:53:02.672 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T05:53:02.672 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:02.673 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 94 k 2023-01-25T05:53:02.673 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 280 k 2023-01-25T05:53:02.673 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:53:02.730 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:02.730 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:53:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:53:02.731 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:53:02.731 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:53:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:53:02.873 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-fuse-18.0.0-1963.g61996d73.el8.x86_64.rpm 469 kB/s | 94 kB 00:00 2023-01-25T05:53:02.874 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:53:02.874 INFO:teuthology.orchestra.run.smithi088.stdout:Total 466 kB/s | 94 kB 00:00 2023-01-25T05:53:02.874 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:53:02.884 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:53:02.885 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:53:02.936 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:53:02.939 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:53:02.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-nbd 2023-01-25T05:53:03.050 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:53:03.242 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:03.540 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:03.701 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:02:34 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:53:04.303 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:04.304 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:04.304 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:53:04.304 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:53:04.304 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:04.305 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:53:04.533 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-mirror 2023-01-25T05:53:04.842 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-01-25T05:53:04.842 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:53:04.843 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2023-01-25T05:53:04.843 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:53:04.843 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-01-25T05:53:04.843 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 179 k 2023-01-25T05:53:04.844 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:53:04.844 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-01-25T05:53:04.844 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-01-25T05:53:04.844 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-01-25T05:53:04.844 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:53:04.845 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 179 k 2023-01-25T05:53:04.845 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 568 k 2023-01-25T05:53:04.845 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-01-25T05:53:05.152 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-nbd-18.0.0-1963.g61996d73.el8.x86_64.rpm 581 kB/s | 179 kB 00:00 2023-01-25T05:53:05.153 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:53:05.154 INFO:teuthology.orchestra.run.smithi089.stdout:Total 579 kB/s | 179 kB 00:00 2023-01-25T05:53:05.154 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-01-25T05:53:05.165 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-01-25T05:53:05.165 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-01-25T05:53:05.217 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-01-25T05:53:05.220 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-01-25T05:53:05.261 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:36 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:53:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-01-25T05:53:05.526 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:05.825 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:53:06.316 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-01-25T05:53:06.316 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:53:06.317 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-01-25T05:53:06.317 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-01-25T05:53:06.403 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:53:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:53:06.404 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-01-25T05:53:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:53:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:53:06.404 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.4 M 2023-01-25T05:53:06.405 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:53:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:53:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T05:53:06.405 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 3.4 M 2023-01-25T05:53:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 16 M 2023-01-25T05:53:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:53:06.529 DEBUG:teuthology.parallel:result is None 2023-01-25T05:53:07.069 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-mirror-18.0.0-1963.g61996d73.el8.x86_64.rpm 5.2 MB/s | 3.4 MB 00:00 2023-01-25T05:53:07.069 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:53:07.070 INFO:teuthology.orchestra.run.smithi088.stdout:Total 5.2 MB/s | 3.4 MB 00:00 2023-01-25T05:53:07.070 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:53:07.082 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:53:07.082 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:53:07.146 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:53:07.150 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:53:07.595 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:53:07.728 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:08.162 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:08.639 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:08.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:08.640 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:53:08.640 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:53:08.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:08.641 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:53:08.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-nbd 2023-01-25T05:53:09.597 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:02:40 ago on Wed 25 Jan 2023 05:50:29 AM UTC. 2023-01-25T05:53:10.744 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-01-25T05:53:10.745 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:53:10.745 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-01-25T05:53:10.745 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:53:10.745 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-01-25T05:53:10.745 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 179 k 2023-01-25T05:53:10.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:10.746 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-01-25T05:53:10.746 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-01-25T05:53:10.746 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-01-25T05:53:10.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:10.747 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 179 k 2023-01-25T05:53:10.747 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 568 k 2023-01-25T05:53:10.747 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-01-25T05:53:10.946 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-nbd-18.0.0-1963.g61996d73.el8.x86_64.rpm 895 kB/s | 179 kB 00:00 2023-01-25T05:53:10.947 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:53:10.947 INFO:teuthology.orchestra.run.smithi088.stdout:Total 889 kB/s | 179 kB 00:00 2023-01-25T05:53:10.947 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-01-25T05:53:10.958 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-01-25T05:53:10.958 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-01-25T05:53:11.010 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-01-25T05:53:11.014 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-01-25T05:53:11.133 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-01-25T05:53:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:11.609 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:12.089 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T05:53:12.089 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:12.090 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-01-25T05:53:12.090 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T05:53:12.090 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:12.090 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-01-25T05:53:12.301 DEBUG:teuthology.parallel:result is None 2023-01-25T05:53:12.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2023-01-25T05:53:12.344 INFO:teuthology.orchestra.run.smithi088.stdout:CentOSStream 2023-01-25T05:53:12.345 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T05:53:12.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T05:53:12.494 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T05:53:12.517 INFO:teuthology.orchestra.run.smithi088.stdout:18.0.0-1963.g61996d73.el8 2023-01-25T05:53:12.518 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1963.g61996d73.el8 2023-01-25T05:53:12.518 INFO:teuthology.task.install:The correct ceph version 18.0.0-1963.g61996d73 is installed. 2023-01-25T05:53:12.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo lsb_release -is 2023-01-25T05:53:12.564 INFO:teuthology.orchestra.run.smithi089.stdout:CentOSStream 2023-01-25T05:53:12.566 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T05:53:12.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T05:53:12.715 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T05:53:12.741 INFO:teuthology.orchestra.run.smithi089.stdout:18.0.0-1963.g61996d73.el8 2023-01-25T05:53:12.742 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1963.g61996d73.el8 2023-01-25T05:53:12.742 INFO:teuthology.task.install:The correct ceph version 18.0.0-1963.g61996d73 is installed. 2023-01-25T05:53:12.742 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T05:53:12.743 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T05:53:12.743 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T05:53:12.772 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T05:53:12.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T05:53:12.811 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T05:53:12.812 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T05:53:12.812 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T05:53:12.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T05:53:12.907 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T05:53:12.908 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T05:53:12.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T05:53:13.009 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T05:53:13.009 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T05:53:13.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T05:53:13.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T05:53:13.105 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-01-25T05:53:13.105 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T05:53:13.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T05:53:13.202 INFO:teuthology.run_tasks:Running task cephadm... 2023-01-25T05:53:13.285 INFO:tasks.cephadm:Config: {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'} 2023-01-25T05:53:13.286 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T05:53:13.294 INFO:tasks.cephadm:Cluster fsid is 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:53:13.295 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-01-25T05:53:13.296 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.88'} 2023-01-25T05:53:13.296 INFO:tasks.cephadm:First mon is mon.a on smithi088 2023-01-25T05:53:13.296 INFO:tasks.cephadm:First mgr is a 2023-01-25T05:53:13.297 INFO:tasks.cephadm:Normalizing hostnames... 2023-01-25T05:53:13.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname $(hostname -s) 2023-01-25T05:53:13.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname $(hostname -s) 2023-01-25T05:53:13.354 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-01-25T05:53:13.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo lsb_release -is 2023-01-25T05:53:13.403 INFO:teuthology.orchestra.run.smithi088.stdout:CentOSStream 2023-01-25T05:53:13.403 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T05:53:13.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T05:53:13.552 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/67570/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-1963-g61996d73', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-1963.g61996d73'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-01-23 19:13:24.694178', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-yuri2-testing-2023-01-23-0928', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2023-01-25T05:53:13.696 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-yuri2-testing-2023-01-23-0928, sha1 61996d73ab738798e4ee0055c86457f5c459da4a from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T05:53:13.697 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/x86_64/flavors/default/cephadm 2023-01-25T05:53:13.698 DEBUG:teuthology.orchestra.run.smithi088:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-01-25T05:53:14.413 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-rw-r--. 1 ubuntu ubuntu 377816 Jan 25 05:53 /home/ubuntu/cephtest/cephadm 2023-01-25T05:53:14.414 DEBUG:teuthology.orchestra.run.smithi089:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-01-25T05:53:15.089 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-rw-r--. 1 ubuntu ubuntu 377816 Jan 25 05:53 /home/ubuntu/cephtest/cephadm 2023-01-25T05:53:15.089 DEBUG:teuthology.orchestra.run.smithi088:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-01-25T05:53:15.111 DEBUG:teuthology.orchestra.run.smithi089:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-01-25T05:53:15.145 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a on all hosts... 2023-01-25T05:53:15.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a pull 2023-01-25T05:53:15.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a pull 2023-01-25T05:53:16.644 INFO:teuthology.orchestra.run.smithi089.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a... 2023-01-25T05:53:16.674 INFO:teuthology.orchestra.run.smithi088.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a... 2023-01-25T05:53:41.107 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-01-25T05:53:41.107 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 18.0.0-1963-g61996d73 (61996d73ab738798e4ee0055c86457f5c459da4a) reef (dev)", 2023-01-25T05:53:41.107 INFO:teuthology.orchestra.run.smithi089.stdout: "image_id": "38f71f226300824588f52df11f51d9fbe357a2b7c3dc32f3d13b39a524ef8d2e", 2023-01-25T05:53:41.108 INFO:teuthology.orchestra.run.smithi089.stdout: "repo_digests": [ 2023-01-25T05:53:41.108 INFO:teuthology.orchestra.run.smithi089.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:397d33a13514e4639c403387fd1334eceba86272036bc595bbfc9d42cdee4b5f" 2023-01-25T05:53:41.108 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2023-01-25T05:53:41.108 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-01-25T05:53:42.638 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-01-25T05:53:42.638 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-1963-g61996d73 (61996d73ab738798e4ee0055c86457f5c459da4a) reef (dev)", 2023-01-25T05:53:42.638 INFO:teuthology.orchestra.run.smithi088.stdout: "image_id": "38f71f226300824588f52df11f51d9fbe357a2b7c3dc32f3d13b39a524ef8d2e", 2023-01-25T05:53:42.639 INFO:teuthology.orchestra.run.smithi088.stdout: "repo_digests": [ 2023-01-25T05:53:42.639 INFO:teuthology.orchestra.run.smithi088.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:397d33a13514e4639c403387fd1334eceba86272036bc595bbfc9d42cdee4b5f" 2023-01-25T05:53:42.639 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-01-25T05:53:42.639 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-01-25T05:53:42.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph 2023-01-25T05:53:42.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph 2023-01-25T05:53:42.725 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /etc/ceph 2023-01-25T05:53:42.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /etc/ceph 2023-01-25T05:53:42.796 INFO:tasks.cephadm:Writing seed config... 2023-01-25T05:53:42.797 INFO:tasks.cephadm: override: [client] debug client = 20 2023-01-25T05:53:42.797 INFO:tasks.cephadm: override: [client] debug mgrc = 20 2023-01-25T05:53:42.798 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-01-25T05:53:42.798 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2023-01-25T05:53:42.798 INFO:tasks.cephadm: override: [mds] debug mgrc = 20 2023-01-25T05:53:42.798 INFO:tasks.cephadm: override: [mgr] debug client = 20 2023-01-25T05:53:42.799 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-01-25T05:53:42.799 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-01-25T05:53:42.799 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-01-25T05:53:42.800 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-01-25T05:53:42.800 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-01-25T05:53:42.800 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-01-25T05:53:42.800 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-01-25T05:53:42.801 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-01-25T05:53:42.801 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-01-25T05:53:42.802 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-01-25T05:53:42.802 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-01-25T05:53:42.802 INFO:tasks.cephadm: override: [osd] debug mgrc = 20 2023-01-25T05:53:42.802 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-01-25T05:53:42.803 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-01-25T05:53:42.803 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-01-25T05:53:42.803 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-01-25T05:53:42.803 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-01-25T05:53:42.804 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-01-25T05:53:42.804 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-01-25T05:53:42.804 INFO:tasks.cephadm: override: [osd] osd memory target = 1610612736 2023-01-25T05:53:42.805 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-01-25T05:53:42.805 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-01-25T05:53:42.806 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-01-25T05:53:42.824 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8e1fe42c-9c74-11ed-9e56-001a4aab830c mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug mgrc = 20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd memory target = 1610612736 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug client = 20 debug mgrc = 20 debug ms = 1 [mds] debug mgrc = 20 2023-01-25T05:53:42.825 DEBUG:teuthology.orchestra.run.smithi088:mon.a> sudo journalctl -f -n 0 -u ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mon.a.service 2023-01-25T05:53:42.866 DEBUG:teuthology.orchestra.run.smithi088:mgr.a> sudo journalctl -f -n 0 -u ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mgr.a.service 2023-01-25T05:53:42.893 INFO:journalctl@ceph.mon.a.smithi088.stdout:-- Logs begin at Wed 2023-01-25 05:42:07 UTC. -- 2023-01-25T05:53:42.894 INFO:tasks.cephadm:Bootstrapping... 2023-01-25T05:53:42.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a -v bootstrap --fsid 8e1fe42c-9c74-11ed-9e56-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.88 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-01-25T05:53:42.919 INFO:journalctl@ceph.mgr.a.smithi088.stdout:-- Logs begin at Wed 2023-01-25 05:42:07 UTC. -- 2023-01-25T05:53:43.139 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-01-25T05:53:43.140 INFO:teuthology.orchestra.run.smithi088.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a', '-v', 'bootstrap', '--fsid', '8e1fe42c-9c74-11ed-9e56-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.88', '--skip-admin-label'] 2023-01-25T05:53:43.278 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 4.2.0 2023-01-25T05:53:43.278 INFO:teuthology.orchestra.run.smithi088.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-01-25T05:53:43.279 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying podman|docker is present... 2023-01-25T05:53:43.415 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 4.2.0 2023-01-25T05:53:43.415 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying lvm2 is present... 2023-01-25T05:53:43.416 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying time synchronization is in place... 2023-01-25T05:53:43.423 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-01-25T05:53:43.423 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-01-25T05:53:43.429 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-01-25T05:53:43.429 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-01-25T05:53:43.435 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout enabled 2023-01-25T05:53:43.441 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout active 2023-01-25T05:53:43.442 INFO:teuthology.orchestra.run.smithi088.stdout:Unit chronyd.service is enabled and running 2023-01-25T05:53:43.442 INFO:teuthology.orchestra.run.smithi088.stdout:Repeating the final host check... 2023-01-25T05:53:43.582 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 4.2.0 2023-01-25T05:53:43.582 INFO:teuthology.orchestra.run.smithi088.stdout:podman (/bin/podman) version 4.2.0 is present 2023-01-25T05:53:43.583 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl is present 2023-01-25T05:53:43.583 INFO:teuthology.orchestra.run.smithi088.stdout:lvcreate is present 2023-01-25T05:53:43.588 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-01-25T05:53:43.589 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-01-25T05:53:43.594 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-01-25T05:53:43.594 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-01-25T05:53:43.600 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout enabled 2023-01-25T05:53:43.606 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout active 2023-01-25T05:53:43.606 INFO:teuthology.orchestra.run.smithi088.stdout:Unit chronyd.service is enabled and running 2023-01-25T05:53:43.607 INFO:teuthology.orchestra.run.smithi088.stdout:Host looks OK 2023-01-25T05:53:43.607 INFO:teuthology.orchestra.run.smithi088.stdout:Cluster fsid: 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:53:43.607 INFO:teuthology.orchestra.run.smithi088.stdout:Acquiring lock 139954585025000 on /run/cephadm/8e1fe42c-9c74-11ed-9e56-001a4aab830c.lock 2023-01-25T05:53:43.607 INFO:teuthology.orchestra.run.smithi088.stdout:Lock 139954585025000 acquired on /run/cephadm/8e1fe42c-9c74-11ed-9e56-001a4aab830c.lock 2023-01-25T05:53:43.608 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying IP 172.21.15.88 port 3300 ... 2023-01-25T05:53:43.608 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying IP 172.21.15.88 port 6789 ... 2023-01-25T05:53:43.608 INFO:teuthology.orchestra.run.smithi088.stdout:Base mon IP(s) is [172.21.15.88:3300, 172.21.15.88:6789], mon addrv is [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2023-01-25T05:53:43.611 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.88 metric 100 2023-01-25T05:53:43.611 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.88 metric 100 2023-01-25T05:53:43.613 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-01-25T05:53:43.614 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-01-25T05:53:43.614 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1787sec hoplimit 64 pref medium 2023-01-25T05:53:43.616 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-01-25T05:53:43.616 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-01-25T05:53:43.616 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-01-25T05:53:43.617 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-01-25T05:53:43.617 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-01-25T05:53:43.617 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-01-25T05:53:43.618 INFO:teuthology.orchestra.run.smithi088.stdout:Mon IP `172.21.15.88` is in CIDR network `172.21.0.0/20` 2023-01-25T05:53:43.618 INFO:teuthology.orchestra.run.smithi088.stdout:Mon IP `172.21.15.88` is in CIDR network `172.21.0.0/20` 2023-01-25T05:53:43.618 INFO:teuthology.orchestra.run.smithi088.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-01-25T05:53:43.618 INFO:teuthology.orchestra.run.smithi088.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-01-25T05:53:43.619 INFO:teuthology.orchestra.run.smithi088.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a... 2023-01-25T05:53:43.958 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stdout 38f71f226300824588f52df11f51d9fbe357a2b7c3dc32f3d13b39a524ef8d2e 2023-01-25T05:53:43.958 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:61996d73ab738798e4ee0055c86457f5c459da4a... 2023-01-25T05:53:43.958 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Getting image source signatures 2023-01-25T05:53:43.958 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:7e3e62c5f74c35ec76223735340d0be45d3230aea3e7ac0240319f1fecd273d4 2023-01-25T05:53:43.959 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:53525f8b521a5f9317c9ce853653e176e9ed1037575ae7f5da2a2bed6a450060 2023-01-25T05:53:43.959 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:aa16c48af92239fef3d4f8c28b3ad613ba91dcadb275f88623c48df79127d165 2023-01-25T05:53:43.959 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:e2873b3fbbec402bafc59c62563e7264f20ad5dccce4dae4ebfb5edd55afb4cb 2023-01-25T05:53:43.959 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying blob sha256:317bd5f21d3fa946c4fb62d54870936260c660d455fde8674fba06ae80df1cf8 2023-01-25T05:53:43.959 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Copying config sha256:38f71f226300824588f52df11f51d9fbe357a2b7c3dc32f3d13b39a524ef8d2e 2023-01-25T05:53:43.959 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Writing manifest to image destination 2023-01-25T05:53:43.960 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/podman: stderr Storing signatures 2023-01-25T05:53:44.798 INFO:teuthology.orchestra.run.smithi088.stdout:ceph: stdout ceph version 18.0.0-1963-g61996d73 (61996d73ab738798e4ee0055c86457f5c459da4a) reef (dev) 2023-01-25T05:53:44.798 INFO:teuthology.orchestra.run.smithi088.stdout:Ceph version: ceph version 18.0.0-1963-g61996d73 (61996d73ab738798e4ee0055c86457f5c459da4a) reef (dev) 2023-01-25T05:53:44.798 INFO:teuthology.orchestra.run.smithi088.stdout:Extracting ceph user uid/gid from container image... 2023-01-25T05:53:45.544 INFO:teuthology.orchestra.run.smithi088.stdout:stat: stdout 167 167 2023-01-25T05:53:45.545 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial keys... 2023-01-25T05:53:46.284 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQDpw9Bj4WPyMRAAOXORjDG4tomd3Q/H+ILrTg== 2023-01-25T05:53:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQDqw9Bj4utyIBAAaF5jQSOBTkA7zk6CoFZiFQ== 2023-01-25T05:53:47.668 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph-authtool: stdout AQDrw9BjmfihDRAAoLijN8PMEkQzmkyZm7AiWw== 2023-01-25T05:53:47.668 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial monmap... 2023-01-25T05:53:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-01-25T05:53:48.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-01-25T05:53:48.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:53:48.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-01-25T05:53:48.412 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool for a [v2:172.21.15.88:3300,v1:172.21.15.88:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-01-25T05:53:48.412 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = pacific 2023-01-25T05:53:48.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: set fsid to 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:53:48.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-01-25T05:53:48.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:53:48.413 INFO:teuthology.orchestra.run.smithi088.stdout:Creating mon... 2023-01-25T05:53:49.152 INFO:teuthology.orchestra.run.smithi088.stdout:create mon.a on 2023-01-25T05:53:49.246 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-01-25T05:53:49.336 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-01-25T05:53:49.429 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c.target → /etc/systemd/system/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c.target. 2023-01-25T05:53:49.485 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c.target → /etc/systemd/system/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c.target. 2023-01-25T05:53:49.552 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mon.a 2023-01-25T05:53:49.553 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mon.a.service: Unit ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mon.a.service not loaded. 2023-01-25T05:53:49.642 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c.target.wants/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@.service. 2023-01-25T05:53:49.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:49 smithi088 systemd[1]: Starting Ceph mon.a for 8e1fe42c-9c74-11ed-9e56-001a4aab830c... 2023-01-25T05:53:50.550 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-01-25T05:53:50.551 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2023-01-25T05:53:50.559 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-01-25T05:53:50.559 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-01-25T05:53:50.560 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2023-01-25T05:53:50.560 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to enable service . firewalld.service is not available 2023-01-25T05:53:50.561 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mon to start... 2023-01-25T05:53:50.561 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mon... 2023-01-25T05:53:50.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:50 smithi088 podman[101771]: 2023-01-25T05:53:50.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:50 smithi088 bash[101771]: afd7decf1009802b3e640f0b59203d5b0d2227956a5578c46ff0d6fa9f38d296 2023-01-25T05:53:50.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:50 smithi088 systemd[1]: Started Ceph mon.a for 8e1fe42c-9c74-11ed-9e56-001a4aab830c. 2023-01-25T05:53:50.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:50 smithi088 ceph-mon[101791]: mkfs 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:53:50.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:50 smithi088 ceph-mon[101791]: mon.a is new leader, mons a in quorum (ranks 0) 2023-01-25T05:53:51.505 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout cluster: 2023-01-25T05:53:51.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout id: 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:53:51.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-01-25T05:53:51.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:53:51.506 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout services: 2023-01-25T05:53:51.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.506499s) 2023-01-25T05:53:51.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-01-25T05:53:51.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-01-25T05:53:51.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:53:51.507 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout data: 2023-01-25T05:53:51.508 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-01-25T05:53:51.508 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-01-25T05:53:51.509 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-01-25T05:53:51.509 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout pgs: 2023-01-25T05:53:51.509 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:53:51.509 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.975+0000 7f4ae61ed700 1 Processor -- start 2023-01-25T05:53:51.509 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.975+0000 7f4ae61ed700 1 -- start start 2023-01-25T05:53:51.510 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4ae61ed700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae0105a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:53:51.510 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4ae61ed700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae0105f90 con 0x7f4ae0105640 2023-01-25T05:53:51.510 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4adf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae0105a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:53:51.510 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4adf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae0105a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47762/0 (socket says 172.21.15.88:47762) 2023-01-25T05:53:51.510 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4adf7fe700 1 -- 172.21.15.88:0/1491429759 learned_addr learned my addr 172.21.15.88:0/1491429759 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:53:51.511 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4adf7fe700 1 -- 172.21.15.88:0/1491429759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae0103c10 con 0x7f4ae0105640 2023-01-25T05:53:51.511 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4adf7fe700 1 --2- 172.21.15.88:0/1491429759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae0105a50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00098a0 tx=0x7f4ad0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c77b6535d21700 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:53:51.511 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4ade7fc700 1 -- 172.21.15.88:0/1491429759 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ad0004160 con 0x7f4ae0105640 2023-01-25T05:53:51.511 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4ade7fc700 1 -- 172.21.15.88:0/1491429759 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad00042c0 con 0x7f4ae0105640 2023-01-25T05:53:51.512 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.976+0000 7f4ade7fc700 1 -- 172.21.15.88:0/1491429759 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ad00045a0 con 0x7f4ae0105640 2023-01-25T05:53:51.512 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.977+0000 7f4ae61ed700 1 -- 172.21.15.88:0/1491429759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 msgr2=0x7f4ae0105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:53:51.512 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.977+0000 7f4ae61ed700 1 --2- 172.21.15.88:0/1491429759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae0105a50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00098a0 tx=0x7f4ad0009bb0 comp rx=0 tx=0).stop 2023-01-25T05:53:51.512 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.977+0000 7f4ae61ed700 1 -- 172.21.15.88:0/1491429759 shutdown_connections 2023-01-25T05:53:51.513 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.977+0000 7f4ae61ed700 1 --2- 172.21.15.88:0/1491429759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae0105a50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:53:51.513 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.977+0000 7f4ae61ed700 1 -- 172.21.15.88:0/1491429759 >> 172.21.15.88:0/1491429759 conn(0x7f4ae00ff580 msgr2=0x7f4ae01019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:53:51.513 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.977+0000 7f4ae61ed700 1 -- 172.21.15.88:0/1491429759 shutdown_connections 2023-01-25T05:53:51.513 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.977+0000 7f4ae61ed700 1 -- 172.21.15.88:0/1491429759 wait complete. 2023-01-25T05:53:51.513 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.978+0000 7f4ae61ed700 1 Processor -- start 2023-01-25T05:53:51.514 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.978+0000 7f4ae61ed700 1 -- start start 2023-01-25T05:53:51.514 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.978+0000 7f4ae61ed700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae01974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:53:51.514 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.978+0000 7f4ae61ed700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae0197a20 con 0x7f4ae0105640 2023-01-25T05:53:51.514 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.978+0000 7f4adf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae01974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:53:51.514 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.978+0000 7f4adf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae01974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47764/0 (socket says 172.21.15.88:47764) 2023-01-25T05:53:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.978+0000 7f4adf7fe700 1 -- 172.21.15.88:0/673536328 learned_addr learned my addr 172.21.15.88:0/673536328 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:53:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.978+0000 7f4adf7fe700 1 -- 172.21.15.88:0/673536328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0009550 con 0x7f4ae0105640 2023-01-25T05:53:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.978+0000 7f4adf7fe700 1 --2- 172.21.15.88:0/673536328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae01974e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0104c80 tx=0x7f4ad0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:53:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4adcff9700 1 -- 172.21.15.88:0/673536328 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ad0011630 con 0x7f4ae0105640 2023-01-25T05:53:51.515 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4adcff9700 1 -- 172.21.15.88:0/673536328 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad0011790 con 0x7f4ae0105640 2023-01-25T05:53:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4adcff9700 1 -- 172.21.15.88:0/673536328 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ad0011a30 con 0x7f4ae0105640 2023-01-25T05:53:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4ae61ed700 1 -- 172.21.15.88:0/673536328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae01040b0 con 0x7f4ae0105640 2023-01-25T05:53:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4ae61ed700 1 -- 172.21.15.88:0/673536328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae0103f20 con 0x7f4ae0105640 2023-01-25T05:53:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4adcff9700 1 -- 172.21.15.88:0/673536328 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f4ad0017020 con 0x7f4ae0105640 2023-01-25T05:53:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4adcff9700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-01-25T05:53:51.517 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4adcff9700 4 mgrc handle_mgr_map Got map version 1 2023-01-25T05:53:51.517 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4adcff9700 4 mgrc handle_mgr_map Active mgr is now 2023-01-25T05:53:51.517 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4adcff9700 4 mgrc reconnect No active mgr available yet 2023-01-25T05:53:51.517 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.979+0000 7f4adcff9700 1 -- 172.21.15.88:0/673536328 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4ad001c450 con 0x7f4ae0105640 2023-01-25T05:53:51.517 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.980+0000 7f4ae61ed700 1 -- 172.21.15.88:0/673536328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae0104240 con 0x7f4ae0105640 2023-01-25T05:53:51.518 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:50.982+0000 7f4adcff9700 1 -- 172.21.15.88:0/673536328 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71752 (secure 0 0 0) 0x7f4ad001b450 con 0x7f4ae0105640 2023-01-25T05:53:51.518 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.051+0000 7f4ae61ed700 1 -- 172.21.15.88:0/673536328 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f4ae0190cd0 con 0x7f4ae0105640 2023-01-25T05:53:51.518 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.052+0000 7f4adcff9700 1 -- 172.21.15.88:0/673536328 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f4ad001b5f0 con 0x7f4ae0105640 2023-01-25T05:53:51.518 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.052+0000 7f4ae61ed700 10 mgrc shutdown 2023-01-25T05:53:51.518 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.052+0000 7f4ae61ed700 1 -- 172.21.15.88:0/673536328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 msgr2=0x7f4ae01974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:53:51.519 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.052+0000 7f4ae61ed700 1 --2- 172.21.15.88:0/673536328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae01974e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0104c80 tx=0x7f4ad0004750 comp rx=0 tx=0).stop 2023-01-25T05:53:51.519 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.052+0000 7f4ae61ed700 1 -- 172.21.15.88:0/673536328 shutdown_connections 2023-01-25T05:53:51.519 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.052+0000 7f4ae61ed700 1 --2- 172.21.15.88:0/673536328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae0105640 0x7f4ae01974e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:53:51.519 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.052+0000 7f4ae61ed700 1 -- 172.21.15.88:0/673536328 >> 172.21.15.88:0/673536328 conn(0x7f4ae00ff580 msgr2=0x7f4ae018b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:53:51.519 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.052+0000 7f4ae61ed700 1 -- 172.21.15.88:0/673536328 shutdown_connections 2023-01-25T05:53:51.519 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.052+0000 7f4ae61ed700 1 -- 172.21.15.88:0/673536328 wait complete. 2023-01-25T05:53:51.520 INFO:teuthology.orchestra.run.smithi088.stdout:mon is available 2023-01-25T05:53:51.520 INFO:teuthology.orchestra.run.smithi088.stdout:Assimilating anything we can from ceph.conf... 2023-01-25T05:53:51.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:51 smithi088 ceph-mon[101791]: mon.a is new leader, mons a in quorum (ranks 0) 2023-01-25T05:53:51.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:51 smithi088 ceph-mon[101791]: monmap e1: 1 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0]} removed_ranks: {} 2023-01-25T05:53:51.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:51 smithi088 ceph-mon[101791]: fsmap 2023-01-25T05:53:51.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:51 smithi088 ceph-mon[101791]: osdmap e1: 0 total, 0 up, 0 in 2023-01-25T05:53:51.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:51 smithi088 ceph-mon[101791]: mgrmap e1: no daemons active 2023-01-25T05:53:51.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:51 smithi088 ceph-mon[101791]: from='client.? 172.21.15.88:0/673536328' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-01-25T05:53:52.444 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:53:52.445 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [global] 2023-01-25T05:53:52.445 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout fsid = 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:53:52.445 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2023-01-25T05:53:52.445 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-01-25T05:53:52.445 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-01-25T05:53:52.446 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-01-25T05:53:52.446 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-01-25T05:53:52.446 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:53:52.446 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [mgr] 2023-01-25T05:53:52.446 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-01-25T05:53:52.447 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:53:52.447 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [osd] 2023-01-25T05:53:52.447 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-01-25T05:53:52.447 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-01-25T05:53:52.448 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-01-25T05:53:52.448 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-01-25T05:53:52.448 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-01-25T05:53:52.448 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.896+0000 7fc9a080f700 1 Processor -- start 2023-01-25T05:53:52.448 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.896+0000 7fc9a080f700 1 -- start start 2023-01-25T05:53:52.449 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.896+0000 7fc9a080f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c102c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:53:52.449 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.896+0000 7fc9a080f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c073730 con 0x7fc99c102870 2023-01-25T05:53:52.449 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.896+0000 7fc99a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:53:52.449 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.896+0000 7fc99a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c102c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47778/0 (socket says 172.21.15.88:47778) 2023-01-25T05:53:52.449 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.896+0000 7fc99a59c700 1 -- 172.21.15.88:0/166720168 learned_addr learned my addr 172.21.15.88:0/166720168 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:53:52.450 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.896+0000 7fc99a59c700 1 -- 172.21.15.88:0/166720168 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c073870 con 0x7fc99c102870 2023-01-25T05:53:52.450 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc99a59c700 1 --2- 172.21.15.88:0/166720168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c102c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098a0 tx=0x7fc98c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3dc9c75c1dcad7 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:53:52.450 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc999d9b700 1 -- 172.21.15.88:0/166720168 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c004160 con 0x7fc99c102870 2023-01-25T05:53:52.450 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc999d9b700 1 -- 172.21.15.88:0/166720168 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c0042c0 con 0x7fc99c102870 2023-01-25T05:53:52.450 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc999d9b700 1 -- 172.21.15.88:0/166720168 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c0045a0 con 0x7fc99c102870 2023-01-25T05:53:52.451 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc9a080f700 1 -- 172.21.15.88:0/166720168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 msgr2=0x7fc99c102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:53:52.451 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc9a080f700 1 --2- 172.21.15.88:0/166720168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c102c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098a0 tx=0x7fc98c009bb0 comp rx=0 tx=0).stop 2023-01-25T05:53:52.451 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc9a080f700 1 -- 172.21.15.88:0/166720168 shutdown_connections 2023-01-25T05:53:52.451 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc9a080f700 1 --2- 172.21.15.88:0/166720168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c102c80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:53:52.451 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc9a080f700 1 -- 172.21.15.88:0/166720168 >> 172.21.15.88:0/166720168 conn(0x7fc99c0fe400 msgr2=0x7fc99c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:53:52.452 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc9a080f700 1 -- 172.21.15.88:0/166720168 shutdown_connections 2023-01-25T05:53:52.452 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.897+0000 7fc9a080f700 1 -- 172.21.15.88:0/166720168 wait complete. 2023-01-25T05:53:52.452 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.898+0000 7fc9a080f700 1 Processor -- start 2023-01-25T05:53:52.452 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.898+0000 7fc9a080f700 1 -- start start 2023-01-25T05:53:52.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.898+0000 7fc9a080f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:53:52.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.898+0000 7fc9a080f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c199bd0 con 0x7fc99c102870 2023-01-25T05:53:52.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.899+0000 7fc99a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:53:52.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.899+0000 7fc99a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47786/0 (socket says 172.21.15.88:47786) 2023-01-25T05:53:52.453 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.899+0000 7fc99a59c700 1 -- 172.21.15.88:0/3655010399 learned_addr learned my addr 172.21.15.88:0/3655010399 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:53:52.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.899+0000 7fc99a59c700 1 -- 172.21.15.88:0/3655010399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c009550 con 0x7fc99c102870 2023-01-25T05:53:52.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.899+0000 7fc99a59c700 1 --2- 172.21.15.88:0/3655010399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c199690 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc98c000c00 tx=0x7fc98c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:53:52.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.899+0000 7fc993fff700 1 -- 172.21.15.88:0/3655010399 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c003dd0 con 0x7fc99c102870 2023-01-25T05:53:52.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.899+0000 7fc993fff700 1 -- 172.21.15.88:0/3655010399 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c011630 con 0x7fc99c102870 2023-01-25T05:53:52.454 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.899+0000 7fc993fff700 1 -- 172.21.15.88:0/3655010399 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c0118d0 con 0x7fc99c102870 2023-01-25T05:53:52.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.900+0000 7fc9a080f700 1 -- 172.21.15.88:0/3655010399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c103470 con 0x7fc99c102870 2023-01-25T05:53:52.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.900+0000 7fc9a080f700 1 -- 172.21.15.88:0/3655010399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c1032e0 con 0x7fc99c102870 2023-01-25T05:53:52.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.900+0000 7fc993fff700 1 -- 172.21.15.88:0/3655010399 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc98c017020 con 0x7fc99c102870 2023-01-25T05:53:52.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.900+0000 7fc993fff700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-01-25T05:53:52.455 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.900+0000 7fc993fff700 4 mgrc handle_mgr_map Got map version 1 2023-01-25T05:53:52.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.900+0000 7fc993fff700 4 mgrc handle_mgr_map Active mgr is now 2023-01-25T05:53:52.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.900+0000 7fc993fff700 4 mgrc reconnect No active mgr available yet 2023-01-25T05:53:52.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.900+0000 7fc993fff700 1 -- 172.21.15.88:0/3655010399 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc98c01c460 con 0x7fc99c102870 2023-01-25T05:53:52.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.901+0000 7fc9a080f700 1 -- 172.21.15.88:0/3655010399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c103600 con 0x7fc99c102870 2023-01-25T05:53:52.456 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.903+0000 7fc993fff700 1 -- 172.21.15.88:0/3655010399 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71752 (secure 0 0 0) 0x7fc98c025480 con 0x7fc99c102870 2023-01-25T05:53:52.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.970+0000 7fc9a080f700 1 -- 172.21.15.88:0/3655010399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fc99c1932e0 con 0x7fc99c102870 2023-01-25T05:53:52.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.973+0000 7fc993fff700 1 -- 172.21.15.88:0/3655010399 <== mon.0 v2:172.21.15.88:3300/0 7 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7fc98c025620 con 0x7fc99c102870 2023-01-25T05:53:52.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.973+0000 7fc993fff700 1 -- 172.21.15.88:0/3655010399 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fc98c039210 con 0x7fc99c102870 2023-01-25T05:53:52.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.974+0000 7fc9a080f700 10 mgrc shutdown 2023-01-25T05:53:52.457 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.974+0000 7fc9a080f700 1 -- 172.21.15.88:0/3655010399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 msgr2=0x7fc99c199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:53:52.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.974+0000 7fc9a080f700 1 --2- 172.21.15.88:0/3655010399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c199690 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc98c000c00 tx=0x7fc98c004750 comp rx=0 tx=0).stop 2023-01-25T05:53:52.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.974+0000 7fc9a080f700 1 -- 172.21.15.88:0/3655010399 shutdown_connections 2023-01-25T05:53:52.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.974+0000 7fc9a080f700 1 --2- 172.21.15.88:0/3655010399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc99c102870 0x7fc99c199690 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:53:52.458 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.974+0000 7fc9a080f700 1 -- 172.21.15.88:0/3655010399 >> 172.21.15.88:0/3655010399 conn(0x7fc99c0fe400 msgr2=0x7fc99c190420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:53:52.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.974+0000 7fc9a080f700 1 -- 172.21.15.88:0/3655010399 shutdown_connections 2023-01-25T05:53:52.459 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:51.974+0000 7fc9a080f700 1 -- 172.21.15.88:0/3655010399 wait complete. 2023-01-25T05:53:52.459 INFO:teuthology.orchestra.run.smithi088.stdout:Generating new minimal ceph.conf... 2023-01-25T05:53:52.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:52 smithi088 ceph-mon[101791]: from='client.? 172.21.15.88:0/3655010399' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-01-25T05:53:52.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:52 smithi088 ceph-mon[101791]: from='client.? 172.21.15.88:0/3655010399' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-01-25T05:53:54.988 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:54 smithi088 ceph-mon[101791]: from='client.? 172.21.15.88:0/2242056036' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-25T05:53:55.891 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.703+0000 7f2c028e6700 1 Processor -- start 2023-01-25T05:53:55.892 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.703+0000 7f2c028e6700 1 -- start start 2023-01-25T05:53:55.892 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.703+0000 7f2c028e6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc104870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:53:55.892 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.703+0000 7f2c028e6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc104e40 con 0x7f2bfc104460 2023-01-25T05:53:55.892 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.703+0000 7f2bfbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc104870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:53:55.892 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.703+0000 7f2bfbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc104870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47794/0 (socket says 172.21.15.88:47794) 2023-01-25T05:53:55.893 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.703+0000 7f2bfbfff700 1 -- 172.21.15.88:0/846901112 learned_addr learned my addr 172.21.15.88:0/846901112 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:53:55.893 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.703+0000 7f2bfbfff700 1 -- 172.21.15.88:0/846901112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc104f80 con 0x7f2bfc104460 2023-01-25T05:53:55.893 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2bfbfff700 1 --2- 172.21.15.88:0/846901112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc104870 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0098a0 tx=0x7f2bec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe4d9a26b87de65 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:53:55.893 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2bfaffd700 1 -- 172.21.15.88:0/846901112 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bec004160 con 0x7f2bfc104460 2023-01-25T05:53:55.893 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2bfaffd700 1 -- 172.21.15.88:0/846901112 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f2bec0036a0 con 0x7f2bfc104460 2023-01-25T05:53:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2bfaffd700 1 -- 172.21.15.88:0/846901112 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bec011870 con 0x7f2bfc104460 2023-01-25T05:53:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2c028e6700 1 -- 172.21.15.88:0/846901112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 msgr2=0x7f2bfc104870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:53:55.894 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2c028e6700 1 --2- 172.21.15.88:0/846901112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc104870 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0098a0 tx=0x7f2bec009bb0 comp rx=0 tx=0).stop 2023-01-25T05:53:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2c028e6700 1 -- 172.21.15.88:0/846901112 shutdown_connections 2023-01-25T05:53:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2c028e6700 1 --2- 172.21.15.88:0/846901112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc104870 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:53:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2c028e6700 1 -- 172.21.15.88:0/846901112 >> 172.21.15.88:0/846901112 conn(0x7f2bfc0fdbb0 msgr2=0x7f2bfc0fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:53:55.895 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2c028e6700 1 -- 172.21.15.88:0/846901112 shutdown_connections 2023-01-25T05:53:55.896 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.704+0000 7f2c028e6700 1 -- 172.21.15.88:0/846901112 wait complete. 2023-01-25T05:53:55.896 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.705+0000 7f2c028e6700 1 Processor -- start 2023-01-25T05:53:55.896 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.705+0000 7f2c028e6700 1 -- start start 2023-01-25T05:53:55.896 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.705+0000 7f2c028e6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:53:55.897 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.705+0000 7f2c028e6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc19a2b0 con 0x7f2bfc104460 2023-01-25T05:53:55.897 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bfbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:53:55.897 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bfbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47804/0 (socket says 172.21.15.88:47804) 2023-01-25T05:53:55.897 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bfbfff700 1 -- 172.21.15.88:0/2242056036 learned_addr learned my addr 172.21.15.88:0/2242056036 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:53:55.898 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bfbfff700 1 -- 172.21.15.88:0/2242056036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009550 con 0x7f2bfc104460 2023-01-25T05:53:55.898 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bfbfff700 1 --2- 172.21.15.88:0/2242056036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc199d70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2bec003f20 tx=0x7f2bec011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:53:55.898 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bf97fa700 1 -- 172.21.15.88:0/2242056036 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bec004110 con 0x7f2bfc104460 2023-01-25T05:53:55.898 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bf97fa700 1 -- 172.21.15.88:0/2242056036 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f2bec01b440 con 0x7f2bfc104460 2023-01-25T05:53:55.899 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bf97fa700 1 -- 172.21.15.88:0/2242056036 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bec0193d0 con 0x7f2bfc104460 2023-01-25T05:53:55.899 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2c028e6700 1 -- 172.21.15.88:0/2242056036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc102cc0 con 0x7f2bfc104460 2023-01-25T05:53:55.899 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2c028e6700 1 -- 172.21.15.88:0/2242056036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc102b30 con 0x7f2bfc104460 2023-01-25T05:53:55.899 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bf97fa700 1 -- 172.21.15.88:0/2242056036 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2bec02a070 con 0x7f2bfc104460 2023-01-25T05:53:55.900 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bf97fa700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-01-25T05:53:55.900 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bf97fa700 4 mgrc handle_mgr_map Got map version 1 2023-01-25T05:53:55.902 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bf97fa700 4 mgrc handle_mgr_map Active mgr is now 2023-01-25T05:53:55.902 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bf97fa700 4 mgrc reconnect No active mgr available yet 2023-01-25T05:53:55.902 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.706+0000 7f2bf97fa700 1 -- 172.21.15.88:0/2242056036 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2bec023840 con 0x7f2bfc104460 2023-01-25T05:53:55.902 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.707+0000 7f2c028e6700 1 -- 172.21.15.88:0/2242056036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc102e50 con 0x7f2bfc104460 2023-01-25T05:53:55.903 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.709+0000 7f2bf97fa700 1 -- 172.21.15.88:0/2242056036 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71752 (secure 0 0 0) 0x7f2bec028060 con 0x7f2bfc104460 2023-01-25T05:53:55.903 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.778+0000 7f2c028e6700 1 -- 172.21.15.88:0/2242056036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f2bfc193b20 con 0x7f2bfc104460 2023-01-25T05:53:55.903 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.778+0000 7f2bf97fa700 1 -- 172.21.15.88:0/2242056036 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f2bec01b950 con 0x7f2bfc104460 2023-01-25T05:53:55.904 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.779+0000 7f2c028e6700 10 mgrc shutdown 2023-01-25T05:53:55.904 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.779+0000 7f2c028e6700 1 -- 172.21.15.88:0/2242056036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 msgr2=0x7f2bfc199d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:53:55.904 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.779+0000 7f2c028e6700 1 --2- 172.21.15.88:0/2242056036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc199d70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2bec003f20 tx=0x7f2bec011ae0 comp rx=0 tx=0).stop 2023-01-25T05:53:55.904 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.779+0000 7f2c028e6700 1 -- 172.21.15.88:0/2242056036 shutdown_connections 2023-01-25T05:53:55.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.779+0000 7f2c028e6700 1 --2- 172.21.15.88:0/2242056036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bfc104460 0x7f2bfc199d70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:53:55.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.779+0000 7f2c028e6700 1 -- 172.21.15.88:0/2242056036 >> 172.21.15.88:0/2242056036 conn(0x7f2bfc0fdbb0 msgr2=0x7f2bfc190c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:53:55.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.779+0000 7f2c028e6700 1 -- 172.21.15.88:0/2242056036 shutdown_connections 2023-01-25T05:53:55.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:54.779+0000 7f2c028e6700 1 -- 172.21.15.88:0/2242056036 wait complete. 2023-01-25T05:53:55.906 INFO:teuthology.orchestra.run.smithi088.stdout:Restarting the monitor... 2023-01-25T05:53:56.221 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:55 smithi088 systemd[1]: Stopping Ceph mon.a for 8e1fe42c-9c74-11ed-9e56-001a4aab830c... 2023-01-25T05:53:56.482 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:56 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mon-a[101787]: 2023-01-25T05:53:56.220+0000 7f056cd0e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-01-25T05:53:56.483 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:56 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mon-a[101787]: 2023-01-25T05:53:56.220+0000 7f056cd0e700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-01-25T05:53:56.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:56 smithi088 bash[102053]: ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mon-a 2023-01-25T05:53:56.740 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:56 smithi088 systemd[1]: ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mon.a.service: Succeeded. 2023-01-25T05:53:56.740 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:56 smithi088 systemd[1]: Stopped Ceph mon.a for 8e1fe42c-9c74-11ed-9e56-001a4aab830c. 2023-01-25T05:53:56.740 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:56 smithi088 systemd[1]: Starting Ceph mon.a for 8e1fe42c-9c74-11ed-9e56-001a4aab830c... 2023-01-25T05:53:57.585 INFO:teuthology.orchestra.run.smithi088.stdout:Setting mon public_network to 172.21.0.0/20 2023-01-25T05:53:57.615 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 podman[102145]: 2023-01-25T05:53:57.615 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 bash[102145]: 8852caef6868abeba09bd4dce903c37b5321247adceb2c13e37c9d2bdb2583db 2023-01-25T05:53:57.616 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: set uid:gid to 167:167 (ceph:ceph) 2023-01-25T05:53:57.616 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: ceph version 18.0.0-1963-g61996d73 (61996d73ab738798e4ee0055c86457f5c459da4a) reef (dev), process ceph-mon, pid 2 2023-01-25T05:53:57.616 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: pidfile_write: ignore empty --pid-file 2023-01-25T05:53:57.616 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: load: jerasure load: lrc 2023-01-25T05:53:57.616 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: RocksDB version: 6.15.5 2023-01-25T05:53:57.617 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-01-25T05:53:57.617 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Compile date Jan 23 2023 2023-01-25T05:53:57.617 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: DB SUMMARY 2023-01-25T05:53:57.617 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: DB Session ID: RNH39115JGBP93MORTUI 2023-01-25T05:53:57.617 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: CURRENT file: CURRENT 2023-01-25T05:53:57.618 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: IDENTITY file: IDENTITY 2023-01-25T05:53:57.618 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-01-25T05:53:57.618 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-01-25T05:53:57.618 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 90665 ; 2023-01-25T05:53:57.618 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.error_if_exists: 0 2023-01-25T05:53:57.619 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.create_if_missing: 0 2023-01-25T05:53:57.619 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.paranoid_checks: 1 2023-01-25T05:53:57.619 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-01-25T05:53:57.619 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.env: 0x5566947113a0 2023-01-25T05:53:57.619 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.fs: Posix File System 2023-01-25T05:53:57.620 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.info_log: 0x5566963ce360 2023-01-25T05:53:57.620 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_file_opening_threads: 16 2023-01-25T05:53:57.620 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.statistics: (nil) 2023-01-25T05:53:57.620 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.use_fsync: 0 2023-01-25T05:53:57.620 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_log_file_size: 0 2023-01-25T05:53:57.621 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-01-25T05:53:57.621 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.log_file_time_to_roll: 0 2023-01-25T05:53:57.621 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.keep_log_file_num: 1000 2023-01-25T05:53:57.621 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.recycle_log_file_num: 0 2023-01-25T05:53:57.621 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.allow_fallocate: 1 2023-01-25T05:53:57.621 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.allow_mmap_reads: 0 2023-01-25T05:53:57.622 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.allow_mmap_writes: 0 2023-01-25T05:53:57.622 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.use_direct_reads: 0 2023-01-25T05:53:57.622 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-01-25T05:53:57.622 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.create_missing_column_families: 0 2023-01-25T05:53:57.622 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.db_log_dir: 2023-01-25T05:53:57.623 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2023-01-25T05:53:57.623 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.table_cache_numshardbits: 6 2023-01-25T05:53:57.623 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.WAL_ttl_seconds: 0 2023-01-25T05:53:57.623 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.WAL_size_limit_MB: 0 2023-01-25T05:53:57.623 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-01-25T05:53:57.624 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-01-25T05:53:57.624 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.is_fd_close_on_exec: 1 2023-01-25T05:53:57.624 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.advise_random_on_open: 1 2023-01-25T05:53:57.624 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.db_write_buffer_size: 0 2023-01-25T05:53:57.624 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.write_buffer_manager: 0x5566965baf30 2023-01-25T05:53:57.625 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-01-25T05:53:57.625 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-01-25T05:53:57.625 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-01-25T05:53:57.625 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.use_adaptive_mutex: 0 2023-01-25T05:53:57.625 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.rate_limiter: (nil) 2023-01-25T05:53:57.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-01-25T05:53:57.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.wal_recovery_mode: 2 2023-01-25T05:53:57.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.enable_thread_tracking: 0 2023-01-25T05:53:57.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.enable_pipelined_write: 0 2023-01-25T05:53:57.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.unordered_write: 0 2023-01-25T05:53:57.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-01-25T05:53:57.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-01-25T05:53:57.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-01-25T05:53:57.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-01-25T05:53:57.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.row_cache: None 2023-01-25T05:53:57.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.wal_filter: None 2023-01-25T05:53:57.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-01-25T05:53:57.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.allow_ingest_behind: 0 2023-01-25T05:53:57.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.preserve_deletes: 0 2023-01-25T05:53:57.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.two_write_queues: 0 2023-01-25T05:53:57.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.manual_wal_flush: 0 2023-01-25T05:53:57.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.atomic_flush: 0 2023-01-25T05:53:57.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-01-25T05:53:57.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.persist_stats_to_disk: 0 2023-01-25T05:53:57.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.write_dbid_to_manifest: 0 2023-01-25T05:53:57.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.log_readahead_size: 0 2023-01-25T05:53:57.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-01-25T05:53:57.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.best_efforts_recovery: 0 2023-01-25T05:53:57.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-01-25T05:53:57.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-01-25T05:53:57.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.allow_data_in_errors: 0 2023-01-25T05:53:57.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.db_host_id: __hostname__ 2023-01-25T05:53:57.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_background_jobs: 2 2023-01-25T05:53:57.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_background_compactions: -1 2023-01-25T05:53:57.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_subcompactions: 1 2023-01-25T05:53:57.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-01-25T05:53:57.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-01-25T05:53:57.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.delayed_write_rate : 16777216 2023-01-25T05:53:57.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_total_wal_size: 0 2023-01-25T05:53:57.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-01-25T05:53:57.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.stats_dump_period_sec: 600 2023-01-25T05:53:57.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.stats_persist_period_sec: 600 2023-01-25T05:53:57.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-01-25T05:53:57.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_open_files: -1 2023-01-25T05:53:57.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bytes_per_sync: 0 2023-01-25T05:53:57.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.wal_bytes_per_sync: 0 2023-01-25T05:53:57.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.strict_bytes_per_sync: 0 2023-01-25T05:53:57.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_readahead_size: 0 2023-01-25T05:53:57.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_background_flushes: -1 2023-01-25T05:53:57.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Compression algorithms supported: 2023-01-25T05:53:57.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-01-25T05:53:57.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: kZSTD supported: 0 2023-01-25T05:53:57.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: kXpressCompression supported: 0 2023-01-25T05:53:57.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: kLZ4HCCompression supported: 1 2023-01-25T05:53:57.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: kZlibCompression supported: 1 2023-01-25T05:53:57.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: kSnappyCompression supported: 1 2023-01-25T05:53:57.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: kLZ4Compression supported: 1 2023-01-25T05:53:57.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: kBZip2Compression supported: 0 2023-01-25T05:53:57.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Fast CRC32 supported: Supported on x86 2023-01-25T05:53:57.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2023-01-25T05:53:57.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-01-25T05:53:57.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-01-25T05:53:57.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.merge_operator: 2023-01-25T05:53:57.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_filter: None 2023-01-25T05:53:57.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_filter_factory: None 2023-01-25T05:53:57.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.sst_partitioner_factory: None 2023-01-25T05:53:57.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.memtable_factory: SkipListFactory 2023-01-25T05:53:57.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.table_factory: BlockBasedTable 2023-01-25T05:53:57.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5566962c7b20) 2023-01-25T05:53:57.641 INFO:journalctl@ceph.mon.a.smithi088.stdout: cache_index_and_filter_blocks: 1 2023-01-25T05:53:57.642 INFO:journalctl@ceph.mon.a.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-01-25T05:53:57.642 INFO:journalctl@ceph.mon.a.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-01-25T05:53:57.642 INFO:journalctl@ceph.mon.a.smithi088.stdout: pin_top_level_index_and_filter: 1 2023-01-25T05:53:57.643 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_type: 0 2023-01-25T05:53:57.643 INFO:journalctl@ceph.mon.a.smithi088.stdout: data_block_index_type: 0 2023-01-25T05:53:57.643 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_shortening: 1 2023-01-25T05:53:57.643 INFO:journalctl@ceph.mon.a.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2023-01-25T05:53:57.643 INFO:journalctl@ceph.mon.a.smithi088.stdout: hash_index_allow_collision: 1 2023-01-25T05:53:57.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: checksum: 1 2023-01-25T05:53:57.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: no_block_cache: 0 2023-01-25T05:53:57.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache: 0x556696385350 2023-01-25T05:53:57.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_name: BinnedLRUCache 2023-01-25T05:53:57.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_options: 2023-01-25T05:53:57.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: capacity : 536870912 2023-01-25T05:53:57.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: num_shard_bits : 4 2023-01-25T05:53:57.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: strict_capacity_limit : 0 2023-01-25T05:53:57.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: high_pri_pool_ratio: 0.000 2023-01-25T05:53:57.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_compressed: (nil) 2023-01-25T05:53:57.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: persistent_cache: (nil) 2023-01-25T05:53:57.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_size: 4096 2023-01-25T05:53:57.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_size_deviation: 10 2023-01-25T05:53:57.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_restart_interval: 16 2023-01-25T05:53:57.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_block_restart_interval: 1 2023-01-25T05:53:57.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: metadata_block_size: 4096 2023-01-25T05:53:57.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: partition_filters: 0 2023-01-25T05:53:57.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_delta_encoding: 1 2023-01-25T05:53:57.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-01-25T05:53:57.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: whole_key_filtering: 1 2023-01-25T05:53:57.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: verify_compression: 0 2023-01-25T05:53:57.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: read_amp_bytes_per_bit: 0 2023-01-25T05:53:57.649 INFO:journalctl@ceph.mon.a.smithi088.stdout: format_version: 4 2023-01-25T05:53:57.649 INFO:journalctl@ceph.mon.a.smithi088.stdout: enable_index_compression: 1 2023-01-25T05:53:57.649 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_align: 0 2023-01-25T05:53:57.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.write_buffer_size: 33554432 2023-01-25T05:53:57.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_write_buffer_number: 2 2023-01-25T05:53:57.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compression: NoCompression 2023-01-25T05:53:57.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bottommost_compression: Disabled 2023-01-25T05:53:57.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.prefix_extractor: nullptr 2023-01-25T05:53:57.651 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-01-25T05:53:57.651 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.num_levels: 7 2023-01-25T05:53:57.651 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-01-25T05:53:57.652 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-01-25T05:53:57.652 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-01-25T05:53:57.652 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-01-25T05:53:57.652 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-01-25T05:53:57.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-01-25T05:53:57.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-01-25T05:53:57.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-01-25T05:53:57.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-01-25T05:53:57.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-01-25T05:53:57.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compression_opts.window_bits: -14 2023-01-25T05:53:57.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compression_opts.level: 32767 2023-01-25T05:53:57.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compression_opts.strategy: 0 2023-01-25T05:53:57.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-01-25T05:53:57.655 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-01-25T05:53:57.655 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-01-25T05:53:57.655 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compression_opts.enabled: false 2023-01-25T05:53:57.655 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-01-25T05:53:57.656 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-01-25T05:53:57.656 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-01-25T05:53:57.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.target_file_size_base: 67108864 2023-01-25T05:53:57.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.target_file_size_multiplier: 1 2023-01-25T05:53:57.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-01-25T05:53:57.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-01-25T05:53:57.658 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-01-25T05:53:57.658 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-01-25T05:53:57.658 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-01-25T05:53:57.659 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-01-25T05:53:57.659 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-01-25T05:53:57.659 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-01-25T05:53:57.659 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-01-25T05:53:57.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-01-25T05:53:57.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-01-25T05:53:57.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-01-25T05:53:57.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.arena_block_size: 4194304 2023-01-25T05:53:57.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-01-25T05:53:57.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-01-25T05:53:57.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-01-25T05:53:57.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.disable_auto_compactions: 0 2023-01-25T05:53:57.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-01-25T05:53:57.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-01-25T05:53:57.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-01-25T05:53:57.663 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-01-25T05:53:57.663 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-01-25T05:53:57.663 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-01-25T05:53:57.663 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-01-25T05:53:57.664 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-01-25T05:53:57.664 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-01-25T05:53:57.664 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-01-25T05:53:57.664 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.table_properties_collectors: 2023-01-25T05:53:57.664 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.inplace_update_support: 0 2023-01-25T05:53:57.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.inplace_update_num_locks: 10000 2023-01-25T05:53:57.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-01-25T05:53:57.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-01-25T05:53:57.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.memtable_huge_page_size: 0 2023-01-25T05:53:57.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.bloom_locality: 0 2023-01-25T05:53:57.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.max_successive_merges: 0 2023-01-25T05:53:57.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.optimize_filters_for_hits: 0 2023-01-25T05:53:57.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.paranoid_file_checks: 0 2023-01-25T05:53:57.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.force_consistency_checks: 1 2023-01-25T05:53:57.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.report_bg_io_stats: 0 2023-01-25T05:53:57.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.ttl: 2592000 2023-01-25T05:53:57.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.periodic_compaction_seconds: 0 2023-01-25T05:53:57.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.enable_blob_files: false 2023-01-25T05:53:57.668 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.min_blob_size: 0 2023-01-25T05:53:57.668 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.blob_file_size: 268435456 2023-01-25T05:53:57.668 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.blob_compression_type: NoCompression 2023-01-25T05:53:57.668 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.enable_blob_garbage_collection: false 2023-01-25T05:53:57.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-01-25T05:53:57.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-01-25T05:53:57.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-01-25T05:53:57.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-01-25T05:53:57.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: EVENT_LOG_v1 {"time_micros": 1674626037533963, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-01-25T05:53:57.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-01-25T05:53:57.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-01-25T05:53:57.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: EVENT_LOG_v1 {"time_micros": 1674626037534654, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 86450, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 84544, "index_size": 266, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 11553, "raw_average_key_size": 48, "raw_value_size": 78159, "raw_average_value_size": 325, "num_data_blocks": 11, "num_entries": 240, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1674626037, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "bf88105e-dc45-4d88-8794-0332cb771d09", "db_session_id": "RNH39115JGBP93MORTUI"}} 2023-01-25T05:53:57.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-01-25T05:53:57.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: EVENT_LOG_v1 {"time_micros": 1674626037535006, "job": 1, "event": "recovery_finished"} 2023-01-25T05:53:57.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-01-25T05:53:57.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x556696319880 2023-01-25T05:53:57.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: DB pointer 0x55669634a000 2023-01-25T05:53:57.672 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-01-25T05:53:57.672 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-01-25T05:53:57.672 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** DB Stats ** 2023-01-25T05:53:57.673 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-01-25T05:53:57.673 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-01-25T05:53:57.673 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-01-25T05:53:57.673 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-25T05:53:57.674 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-01-25T05:53:57.674 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-01-25T05:53:57.674 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-25T05:53:57.674 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2023-01-25T05:53:57.674 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2023-01-25T05:53:57.675 INFO:journalctl@ceph.mon.a.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-25T05:53:57.675 INFO:journalctl@ceph.mon.a.smithi088.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-25T05:53:57.675 INFO:journalctl@ceph.mon.a.smithi088.stdout: L0 2/0 86.18 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 182.0 0.00 0.00 1 0.000 0 0 2023-01-25T05:53:57.675 INFO:journalctl@ceph.mon.a.smithi088.stdout: Sum 2/0 86.18 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 182.0 0.00 0.00 1 0.000 0 0 2023-01-25T05:53:57.675 INFO:journalctl@ceph.mon.a.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 182.0 0.00 0.00 1 0.000 0 0 2023-01-25T05:53:57.676 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2023-01-25T05:53:57.676 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2023-01-25T05:53:57.676 INFO:journalctl@ceph.mon.a.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-25T05:53:57.676 INFO:journalctl@ceph.mon.a.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-25T05:53:57.676 INFO:journalctl@ceph.mon.a.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 182.0 0.00 0.00 1 0.000 0 0 2023-01-25T05:53:57.677 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-01-25T05:53:57.677 INFO:journalctl@ceph.mon.a.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-01-25T05:53:57.677 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-25T05:53:57.678 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-01-25T05:53:57.678 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-01-25T05:53:57.678 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2023-01-25T05:53:57.678 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative compaction: 0.00 GB write, 27.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-25T05:53:57.678 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval compaction: 0.00 GB write, 27.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-25T05:53:57.679 INFO:journalctl@ceph.mon.a.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-25T05:53:57.679 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2023-01-25T05:53:57.679 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2023-01-25T05:53:57.679 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2023-01-25T05:53:57.679 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2023-01-25T05:53:57.680 INFO:journalctl@ceph.mon.a.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-25T05:53:57.680 INFO:journalctl@ceph.mon.a.smithi088.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-25T05:53:57.680 INFO:journalctl@ceph.mon.a.smithi088.stdout: L0 2/0 86.18 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 182.0 0.00 0.00 1 0.000 0 0 2023-01-25T05:53:57.680 INFO:journalctl@ceph.mon.a.smithi088.stdout: Sum 2/0 86.18 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 182.0 0.00 0.00 1 0.000 0 0 2023-01-25T05:53:57.680 INFO:journalctl@ceph.mon.a.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-25T05:53:57.681 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2023-01-25T05:53:57.681 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2023-01-25T05:53:57.681 INFO:journalctl@ceph.mon.a.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-25T05:53:57.681 INFO:journalctl@ceph.mon.a.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-25T05:53:57.682 INFO:journalctl@ceph.mon.a.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 182.0 0.00 0.00 1 0.000 0 0 2023-01-25T05:53:57.682 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-01-25T05:53:57.682 INFO:journalctl@ceph.mon.a.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-01-25T05:53:57.682 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-25T05:53:57.682 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-01-25T05:53:57.683 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-01-25T05:53:57.683 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2023-01-25T05:53:57.683 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative compaction: 0.00 GB write, 27.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-25T05:53:57.684 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-25T05:53:57.684 INFO:journalctl@ceph.mon.a.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-25T05:53:57.684 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2023-01-25T05:53:57.684 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2023-01-25T05:53:57.685 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: starting mon.a rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:53:57.685 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mon.a@-1(???) e1 preinit fsid 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:53:57.685 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mon.a@-1(???).mds e1 new map 2023-01-25T05:53:57.685 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mon.a@-1(???).mds e1 print_map 2023-01-25T05:53:57.685 INFO:journalctl@ceph.mon.a.smithi088.stdout: e1 2023-01-25T05:53:57.686 INFO:journalctl@ceph.mon.a.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-01-25T05:53:57.686 INFO:journalctl@ceph.mon.a.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-25T05:53:57.686 INFO:journalctl@ceph.mon.a.smithi088.stdout: legacy client fscid: -1 2023-01-25T05:53:57.686 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2023-01-25T05:53:57.687 INFO:journalctl@ceph.mon.a.smithi088.stdout: No filesystems configured 2023-01-25T05:53:57.687 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-01-25T05:53:57.687 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-01-25T05:53:57.687 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-01-25T05:53:57.688 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-01-25T05:53:57.688 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-01-25T05:53:57.688 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 systemd[1]: Started Ceph mon.a for 8e1fe42c-9c74-11ed-9e56-001a4aab830c. 2023-01-25T05:53:57.688 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mon.a is new leader, mons a in quorum (ranks 0) 2023-01-25T05:53:57.689 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: monmap e1: 1 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0]} removed_ranks: {} 2023-01-25T05:53:57.689 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: fsmap 2023-01-25T05:53:57.689 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: osdmap e1: 0 total, 0 up, 0 in 2023-01-25T05:53:57.689 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:57 smithi088 ceph-mon[102165]: mgrmap e1: no daemons active 2023-01-25T05:53:58.529 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.039+0000 7f522f0d6700 1 Processor -- start 2023-01-25T05:53:58.529 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.039+0000 7f522f0d6700 1 -- start start 2023-01-25T05:53:58.529 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.039+0000 7f522f0d6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:53:58.530 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.039+0000 7f522f0d6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52281048a0 con 0x7f5228073710 2023-01-25T05:53:58.530 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.039+0000 7f522ce72700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:53:58.530 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.039+0000 7f522ce72700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228108eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48048/0 (socket says 172.21.15.88:48048) 2023-01-25T05:53:58.530 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.039+0000 7f522ce72700 1 -- 172.21.15.88:0/3984449829 learned_addr learned my addr 172.21.15.88:0/3984449829 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:53:58.531 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.039+0000 7f522ce72700 1 -- 172.21.15.88:0/3984449829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52281093f0 con 0x7f5228073710 2023-01-25T05:53:58.531 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f522ce72700 1 --2- 172.21.15.88:0/3984449829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228108eb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f521c0098a0 tx=0x7f521c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ed0792196592e5 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:53:58.531 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f52277fe700 1 -- 172.21.15.88:0/3984449829 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f521c004160 con 0x7f5228073710 2023-01-25T05:53:58.531 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f52277fe700 1 -- 172.21.15.88:0/3984449829 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f521c0036a0 con 0x7f5228073710 2023-01-25T05:53:58.531 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f52277fe700 1 -- 172.21.15.88:0/3984449829 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f521c011870 con 0x7f5228073710 2023-01-25T05:53:58.532 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f522f0d6700 1 -- 172.21.15.88:0/3984449829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 msgr2=0x7f5228108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:53:58.532 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f522f0d6700 1 --2- 172.21.15.88:0/3984449829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228108eb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f521c0098a0 tx=0x7f521c009bb0 comp rx=0 tx=0).stop 2023-01-25T05:53:58.532 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f522f0d6700 1 -- 172.21.15.88:0/3984449829 shutdown_connections 2023-01-25T05:53:58.532 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f522f0d6700 1 --2- 172.21.15.88:0/3984449829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228108eb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:53:58.532 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f522f0d6700 1 -- 172.21.15.88:0/3984449829 >> 172.21.15.88:0/3984449829 conn(0x7f52280fe400 msgr2=0x7f5228100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:53:58.533 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f522f0d6700 1 -- 172.21.15.88:0/3984449829 shutdown_connections 2023-01-25T05:53:58.533 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.040+0000 7f522f0d6700 1 -- 172.21.15.88:0/3984449829 wait complete. 2023-01-25T05:53:58.533 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.041+0000 7f522f0d6700 1 Processor -- start 2023-01-25T05:53:58.533 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.041+0000 7f522f0d6700 1 -- start start 2023-01-25T05:53:58.533 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.041+0000 7f522f0d6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:53:58.534 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.041+0000 7f522f0d6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522819a240 con 0x7f5228073710 2023-01-25T05:53:58.534 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.041+0000 7f522ce72700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:53:58.534 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.041+0000 7f522ce72700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48062/0 (socket says 172.21.15.88:48062) 2023-01-25T05:53:58.534 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.041+0000 7f522ce72700 1 -- 172.21.15.88:0/1121529334 learned_addr learned my addr 172.21.15.88:0/1121529334 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:53:58.534 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.042+0000 7f522ce72700 1 -- 172.21.15.88:0/1121529334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c009550 con 0x7f5228073710 2023-01-25T05:53:58.535 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.042+0000 7f522ce72700 1 --2- 172.21.15.88:0/1121529334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228199d00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f521c003b60 tx=0x7f521c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:53:58.535 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.042+0000 7f5225ffb700 1 -- 172.21.15.88:0/1121529334 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f521c004110 con 0x7f5228073710 2023-01-25T05:53:58.535 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.042+0000 7f5225ffb700 1 -- 172.21.15.88:0/1121529334 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f521c01b440 con 0x7f5228073710 2023-01-25T05:53:58.535 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.042+0000 7f5225ffb700 1 -- 172.21.15.88:0/1121529334 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f521c0193d0 con 0x7f5228073710 2023-01-25T05:53:58.535 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.042+0000 7f522f0d6700 1 -- 172.21.15.88:0/1121529334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522810a2c0 con 0x7f5228073710 2023-01-25T05:53:58.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.043+0000 7f522f0d6700 1 -- 172.21.15.88:0/1121529334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522810a130 con 0x7f5228073710 2023-01-25T05:53:58.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.043+0000 7f5225ffb700 1 -- 172.21.15.88:0/1121529334 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f521c017020 con 0x7f5228073710 2023-01-25T05:53:58.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.043+0000 7f5225ffb700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-01-25T05:53:58.536 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.043+0000 7f5225ffb700 4 mgrc handle_mgr_map Got map version 1 2023-01-25T05:53:58.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.043+0000 7f5225ffb700 4 mgrc handle_mgr_map Active mgr is now 2023-01-25T05:53:58.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.043+0000 7f5225ffb700 4 mgrc reconnect No active mgr available yet 2023-01-25T05:53:58.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.043+0000 7f5225ffb700 1 -- 172.21.15.88:0/1121529334 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f521c019c30 con 0x7f5228073710 2023-01-25T05:53:58.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.043+0000 7f522f0d6700 1 -- 172.21.15.88:0/1121529334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522810a450 con 0x7f5228073710 2023-01-25T05:53:58.537 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.046+0000 7f5225ffb700 1 -- 172.21.15.88:0/1121529334 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71752 (secure 0 0 0) 0x7f521c041860 con 0x7f5228073710 2023-01-25T05:53:58.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.112+0000 7f522f0d6700 1 -- 172.21.15.88:0/1121529334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f522819a8e0 con 0x7f5228073710 2023-01-25T05:53:58.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.114+0000 7f5225ffb700 1 -- 172.21.15.88:0/1121529334 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f521c030020 con 0x7f5228073710 2023-01-25T05:53:58.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.115+0000 7f522f0d6700 10 mgrc shutdown 2023-01-25T05:53:58.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.115+0000 7f522f0d6700 1 -- 172.21.15.88:0/1121529334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 msgr2=0x7f5228199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:53:58.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.115+0000 7f522f0d6700 1 --2- 172.21.15.88:0/1121529334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228199d00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f521c003b60 tx=0x7f521c011a50 comp rx=0 tx=0).stop 2023-01-25T05:53:58.538 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.115+0000 7f522f0d6700 1 -- 172.21.15.88:0/1121529334 shutdown_connections 2023-01-25T05:53:58.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.115+0000 7f522f0d6700 1 --2- 172.21.15.88:0/1121529334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5228073710 0x7f5228199d00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:53:58.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.115+0000 7f522f0d6700 1 -- 172.21.15.88:0/1121529334 >> 172.21.15.88:0/1121529334 conn(0x7f52280fe400 msgr2=0x7f52280ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:53:58.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.115+0000 7f522f0d6700 1 -- 172.21.15.88:0/1121529334 shutdown_connections 2023-01-25T05:53:58.539 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:53:58.115+0000 7f522f0d6700 1 -- 172.21.15.88:0/1121529334 wait complete. 2023-01-25T05:53:58.539 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote config to /etc/ceph/ceph.conf 2023-01-25T05:53:58.540 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-01-25T05:53:58.540 INFO:teuthology.orchestra.run.smithi088.stdout:Creating mgr... 2023-01-25T05:53:58.540 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying port 9283 ... 2023-01-25T05:53:58.540 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying port 8765 ... 2023-01-25T05:53:58.652 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mgr.a 2023-01-25T05:53:58.652 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mgr.a.service: Unit ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mgr.a.service not loaded. 2023-01-25T05:53:58.742 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c.target.wants/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@mgr.a.service → /etc/systemd/system/ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c@.service. 2023-01-25T05:53:58.988 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:53:58 smithi088 systemd[1]: Starting Ceph mgr.a for 8e1fe42c-9c74-11ed-9e56-001a4aab830c... 2023-01-25T05:53:59.427 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:53:59 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/1121529334' entity='client.admin' 2023-01-25T05:53:59.629 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-01-25T05:53:59.630 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2023-01-25T05:53:59.638 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-01-25T05:53:59.638 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-01-25T05:53:59.638 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2023-01-25T05:53:59.638 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to enable service . firewalld.service is not available 2023-01-25T05:53:59.646 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-01-25T05:53:59.646 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2023-01-25T05:53:59.654 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-01-25T05:53:59.654 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-01-25T05:53:59.655 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2023-01-25T05:53:59.655 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-01-25T05:53:59.655 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr to start... 2023-01-25T05:53:59.655 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr... 2023-01-25T05:53:59.738 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:53:59 smithi088 podman[102374]: 2023-01-25T05:53:59.739 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:53:59 smithi088 bash[102374]: 16da689d1cc3abd398a0b26c3fd463e6774e1399d3349a96bf11395272559ef7 2023-01-25T05:53:59.739 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:53:59 smithi088 systemd[1]: Started Ceph mgr.a for 8e1fe42c-9c74-11ed-9e56-001a4aab830c. 2023-01-25T05:54:00.488 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:00 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/4182519478' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-01-25T05:54:00.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:54:00.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-01-25T05:54:00.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "8e1fe42c-9c74-11ed-9e56-001a4aab830c", 2023-01-25T05:54:00.600 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2023-01-25T05:54:00.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-01-25T05:54:00.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-01-25T05:54:00.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-01-25T05:54:00.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:00.601 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-01-25T05:54:00.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-01-25T05:54:00.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2023-01-25T05:54:00.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:00.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-01-25T05:54:00.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "a" 2023-01-25T05:54:00.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:00.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-01-25T05:54:00.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2023-01-25T05:54:00.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:00.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-01-25T05:54:00.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-01-25T05:54:00.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:00.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-01-25T05:54:00.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:00.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-01-25T05:54:00.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-01-25T05:54:00.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-01-25T05:54:00.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-01-25T05:54:00.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-01-25T05:54:00.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-01-25T05:54:00.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:00.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-01-25T05:54:00.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-01-25T05:54:00.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-01-25T05:54:00.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-01-25T05:54:00.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-01-25T05:54:00.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-01-25T05:54:00.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-01-25T05:54:00.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-01-25T05:54:00.616 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-01-25T05:54:00.616 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:00.616 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-01-25T05:54:00.616 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:00.616 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-01-25T05:54:00.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-01-25T05:54:00.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:00.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-01-25T05:54:00.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2023-01-25T05:54:00.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-01-25T05:54:00.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2023-01-25T05:54:00.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2023-01-25T05:54:00.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2023-01-25T05:54:00.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2023-01-25T05:54:00.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:00.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-01-25T05:54:00.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:00.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-01-25T05:54:00.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:00.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2023-01-25T05:53:50.547790+0000", 2023-01-25T05:54:00.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-01-25T05:54:00.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:00.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-01-25T05:54:00.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-01-25T05:54:00.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.088+0000 7f1ada81b700 1 Processor -- start 2023-01-25T05:54:00.621 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.088+0000 7f1ada81b700 1 -- start start 2023-01-25T05:54:00.621 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.088+0000 7f1ada81b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4105940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:00.621 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.088+0000 7f1ada81b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4105f10 con 0x7f1ad4105530 2023-01-25T05:54:00.621 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.088+0000 7f1ad3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:00.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.088+0000 7f1ad3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4105940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48076/0 (socket says 172.21.15.88:48076) 2023-01-25T05:54:00.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.088+0000 7f1ad3fff700 1 -- 172.21.15.88:0/3495021098 learned_addr learned my addr 172.21.15.88:0/3495021098 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:00.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.089+0000 7f1ad3fff700 1 -- 172.21.15.88:0/3495021098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4106050 con 0x7f1ad4105530 2023-01-25T05:54:00.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.089+0000 7f1ad3fff700 1 --2- 172.21.15.88:0/3495021098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4105940 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40098a0 tx=0x7f1ac4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20cf23e77b779ed server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:00.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.089+0000 7f1ad2ffd700 1 -- 172.21.15.88:0/3495021098 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac4004160 con 0x7f1ad4105530 2023-01-25T05:54:00.623 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.089+0000 7f1ad2ffd700 1 -- 172.21.15.88:0/3495021098 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f1ac40036a0 con 0x7f1ad4105530 2023-01-25T05:54:00.623 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.089+0000 7f1ad2ffd700 1 -- 172.21.15.88:0/3495021098 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac4011870 con 0x7f1ad4105530 2023-01-25T05:54:00.623 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.089+0000 7f1ada81b700 1 -- 172.21.15.88:0/3495021098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 msgr2=0x7f1ad4105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:00.623 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.089+0000 7f1ada81b700 1 --2- 172.21.15.88:0/3495021098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4105940 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40098a0 tx=0x7f1ac4009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:00.623 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.090+0000 7f1ada81b700 1 -- 172.21.15.88:0/3495021098 shutdown_connections 2023-01-25T05:54:00.624 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.090+0000 7f1ada81b700 1 --2- 172.21.15.88:0/3495021098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4105940 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:00.624 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.090+0000 7f1ada81b700 1 -- 172.21.15.88:0/3495021098 >> 172.21.15.88:0/3495021098 conn(0x7f1ad40fdb10 msgr2=0x7f1ad40fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:00.624 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.090+0000 7f1ada81b700 1 -- 172.21.15.88:0/3495021098 shutdown_connections 2023-01-25T05:54:00.624 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.090+0000 7f1ada81b700 1 -- 172.21.15.88:0/3495021098 wait complete. 2023-01-25T05:54:00.624 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.090+0000 7f1ada81b700 1 Processor -- start 2023-01-25T05:54:00.625 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.090+0000 7f1ada81b700 1 -- start start 2023-01-25T05:54:00.625 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ada81b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:00.625 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ada81b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad419a2f0 con 0x7f1ad4105530 2023-01-25T05:54:00.625 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ad3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:00.625 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ad3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48088/0 (socket says 172.21.15.88:48088) 2023-01-25T05:54:00.626 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ad3fff700 1 -- 172.21.15.88:0/4182519478 learned_addr learned my addr 172.21.15.88:0/4182519478 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:00.626 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ad3fff700 1 -- 172.21.15.88:0/4182519478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4009550 con 0x7f1ad4105530 2023-01-25T05:54:00.626 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ad3fff700 1 --2- 172.21.15.88:0/4182519478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4199db0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009130 tx=0x7f1ac4011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:00.626 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ad17fa700 1 -- 172.21.15.88:0/4182519478 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac4004110 con 0x7f1ad4105530 2023-01-25T05:54:00.626 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ad17fa700 1 -- 172.21.15.88:0/4182519478 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f1ac401b440 con 0x7f1ad4105530 2023-01-25T05:54:00.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ada81b700 1 -- 172.21.15.88:0/4182519478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad4102c80 con 0x7f1ad4105530 2023-01-25T05:54:00.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ad17fa700 1 -- 172.21.15.88:0/4182519478 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40193f0 con 0x7f1ad4105530 2023-01-25T05:54:00.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.091+0000 7f1ada81b700 1 -- 172.21.15.88:0/4182519478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad4102af0 con 0x7f1ad4105530 2023-01-25T05:54:00.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.092+0000 7f1ad17fa700 1 -- 172.21.15.88:0/4182519478 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f1ac402b070 con 0x7f1ad4105530 2023-01-25T05:54:00.627 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.092+0000 7f1ad17fa700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-01-25T05:54:00.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.092+0000 7f1ad17fa700 4 mgrc handle_mgr_map Got map version 1 2023-01-25T05:54:00.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.092+0000 7f1ad17fa700 4 mgrc handle_mgr_map Active mgr is now 2023-01-25T05:54:00.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.092+0000 7f1ad17fa700 4 mgrc reconnect No active mgr available yet 2023-01-25T05:54:00.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.092+0000 7f1ad17fa700 1 -- 172.21.15.88:0/4182519478 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1ac4024450 con 0x7f1ad4105530 2023-01-25T05:54:00.628 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.092+0000 7f1ada81b700 1 -- 172.21.15.88:0/4182519478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad4102e10 con 0x7f1ad4105530 2023-01-25T05:54:00.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.094+0000 7f1ad17fa700 1 -- 172.21.15.88:0/4182519478 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71752 (secure 0 0 0) 0x7f1ad4102e10 con 0x7f1ad4105530 2023-01-25T05:54:00.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.165+0000 7f1ada81b700 1 -- 172.21.15.88:0/4182519478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1ad419a840 con 0x7f1ad4105530 2023-01-25T05:54:00.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.166+0000 7f1ad17fa700 1 -- 172.21.15.88:0/4182519478 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f1ac4029060 con 0x7f1ad4105530 2023-01-25T05:54:00.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.167+0000 7f1ada81b700 10 mgrc shutdown 2023-01-25T05:54:00.629 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.167+0000 7f1ada81b700 1 -- 172.21.15.88:0/4182519478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 msgr2=0x7f1ad4199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:00.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.167+0000 7f1ada81b700 1 --2- 172.21.15.88:0/4182519478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4199db0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009130 tx=0x7f1ac4011980 comp rx=0 tx=0).stop 2023-01-25T05:54:00.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.167+0000 7f1ada81b700 1 -- 172.21.15.88:0/4182519478 shutdown_connections 2023-01-25T05:54:00.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.167+0000 7f1ada81b700 1 --2- 172.21.15.88:0/4182519478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ad4105530 0x7f1ad4199db0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:00.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.167+0000 7f1ada81b700 1 -- 172.21.15.88:0/4182519478 >> 172.21.15.88:0/4182519478 conn(0x7f1ad40fdb10 msgr2=0x7f1ad40fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:00.630 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.167+0000 7f1ada81b700 1 -- 172.21.15.88:0/4182519478 shutdown_connections 2023-01-25T05:54:00.631 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:00.167+0000 7f1ada81b700 1 -- 172.21.15.88:0/4182519478 wait complete. 2023-01-25T05:54:00.631 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (1/15)... 2023-01-25T05:54:00.988 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:00 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:00.493+0000 7f20d742e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T05:54:01.319 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:01 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:01.060+0000 7f20d742e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T05:54:01.319 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:01 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:01.147+0000 7f20d742e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T05:54:01.738 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:01 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:01.318+0000 7f20d742e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T05:54:02.488 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:02 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:02.106+0000 7f20d742e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T05:54:02.489 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:02 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:02.285+0000 7f20d742e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T05:54:02.794 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:02 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:02.536+0000 7f20d742e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T05:54:02.795 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:02 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:02.621+0000 7f20d742e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T05:54:03.097 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:02 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:02.794+0000 7f20d742e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T05:54:03.488 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:03 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:03.097+0000 7f20d742e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T05:54:03.489 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:03 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:03.191+0000 7f20d742e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T05:54:03.543 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:54:03.544 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-01-25T05:54:03.544 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "8e1fe42c-9c74-11ed-9e56-001a4aab830c", 2023-01-25T05:54:03.544 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2023-01-25T05:54:03.544 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-01-25T05:54:03.545 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-01-25T05:54:03.545 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-01-25T05:54:03.545 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:03.545 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-01-25T05:54:03.545 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-01-25T05:54:03.546 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2023-01-25T05:54:03.546 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:03.546 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-01-25T05:54:03.546 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "a" 2023-01-25T05:54:03.546 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:03.547 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-01-25T05:54:03.547 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2023-01-25T05:54:03.547 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:03.547 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-01-25T05:54:03.547 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-01-25T05:54:03.548 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:03.548 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-01-25T05:54:03.548 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:03.548 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-01-25T05:54:03.548 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-01-25T05:54:03.549 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-01-25T05:54:03.556 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-01-25T05:54:03.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-01-25T05:54:03.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-01-25T05:54:03.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:03.557 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-01-25T05:54:03.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-01-25T05:54:03.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-01-25T05:54:03.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-01-25T05:54:03.558 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-01-25T05:54:03.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-01-25T05:54:03.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-01-25T05:54:03.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-01-25T05:54:03.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-01-25T05:54:03.559 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:03.560 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-01-25T05:54:03.560 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:03.560 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-01-25T05:54:03.560 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-01-25T05:54:03.560 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:03.561 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-01-25T05:54:03.561 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2023-01-25T05:54:03.561 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-01-25T05:54:03.561 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2023-01-25T05:54:03.561 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2023-01-25T05:54:03.562 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2023-01-25T05:54:03.562 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2023-01-25T05:54:03.562 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:03.562 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-01-25T05:54:03.562 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:03.563 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-01-25T05:54:03.563 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:03.563 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2023-01-25T05:53:50.547790+0000", 2023-01-25T05:54:03.563 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-01-25T05:54:03.564 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:03.564 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-01-25T05:54:03.564 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-01-25T05:54:03.564 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.994+0000 7f2d66508700 1 Processor -- start 2023-01-25T05:54:03.565 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.994+0000 7f2d66508700 1 -- start start 2023-01-25T05:54:03.565 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.994+0000 7f2d66508700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60104850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:03.565 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.994+0000 7f2d66508700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60104e20 con 0x7f2d60104440 2023-01-25T05:54:03.566 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.995+0000 7f2d5ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60104850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:03.566 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.995+0000 7f2d5ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60104850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48092/0 (socket says 172.21.15.88:48092) 2023-01-25T05:54:03.566 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.995+0000 7f2d5ffff700 1 -- 172.21.15.88:0/3338945030 learned_addr learned my addr 172.21.15.88:0/3338945030 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:03.566 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.995+0000 7f2d5ffff700 1 -- 172.21.15.88:0/3338945030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60103090 con 0x7f2d60104440 2023-01-25T05:54:03.567 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.995+0000 7f2d5ffff700 1 --2- 172.21.15.88:0/3338945030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60104850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2d500098a0 tx=0x7f2d50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975ba8cba7e195c5 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:03.567 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.995+0000 7f2d5effd700 1 -- 172.21.15.88:0/3338945030 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d50004160 con 0x7f2d60104440 2023-01-25T05:54:03.567 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.995+0000 7f2d5effd700 1 -- 172.21.15.88:0/3338945030 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f2d500036a0 con 0x7f2d60104440 2023-01-25T05:54:03.567 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.995+0000 7f2d5effd700 1 -- 172.21.15.88:0/3338945030 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d50011870 con 0x7f2d60104440 2023-01-25T05:54:03.567 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.996+0000 7f2d66508700 1 -- 172.21.15.88:0/3338945030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 msgr2=0x7f2d60104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:03.568 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.996+0000 7f2d66508700 1 --2- 172.21.15.88:0/3338945030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60104850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2d500098a0 tx=0x7f2d50009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:03.568 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.996+0000 7f2d66508700 1 -- 172.21.15.88:0/3338945030 shutdown_connections 2023-01-25T05:54:03.568 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.996+0000 7f2d66508700 1 --2- 172.21.15.88:0/3338945030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60104850 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:03.568 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.996+0000 7f2d66508700 1 -- 172.21.15.88:0/3338945030 >> 172.21.15.88:0/3338945030 conn(0x7f2d600fdb10 msgr2=0x7f2d600fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:03.568 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.996+0000 7f2d66508700 1 -- 172.21.15.88:0/3338945030 shutdown_connections 2023-01-25T05:54:03.569 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.996+0000 7f2d66508700 1 -- 172.21.15.88:0/3338945030 wait complete. 2023-01-25T05:54:03.569 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d66508700 1 Processor -- start 2023-01-25T05:54:03.569 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d66508700 1 -- start start 2023-01-25T05:54:03.569 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d66508700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:03.569 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d66508700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d601980a0 con 0x7f2d60104440 2023-01-25T05:54:03.570 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d5ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:03.570 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d5ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48102/0 (socket says 172.21.15.88:48102) 2023-01-25T05:54:03.570 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d5ffff700 1 -- 172.21.15.88:0/203945947 learned_addr learned my addr 172.21.15.88:0/203945947 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:03.570 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d5ffff700 1 -- 172.21.15.88:0/203945947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50009550 con 0x7f2d60104440 2023-01-25T05:54:03.570 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d5ffff700 1 --2- 172.21.15.88:0/203945947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60197b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2d50000c00 tx=0x7f2d50011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:03.571 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.997+0000 7f2d5d7fa700 1 -- 172.21.15.88:0/203945947 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d50004110 con 0x7f2d60104440 2023-01-25T05:54:03.571 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d5d7fa700 1 -- 172.21.15.88:0/203945947 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f2d5001b440 con 0x7f2d60104440 2023-01-25T05:54:03.571 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d66508700 1 -- 172.21.15.88:0/203945947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d601072d0 con 0x7f2d60104440 2023-01-25T05:54:03.571 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d5d7fa700 1 -- 172.21.15.88:0/203945947 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d500193f0 con 0x7f2d60104440 2023-01-25T05:54:03.571 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d66508700 1 -- 172.21.15.88:0/203945947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d60103e40 con 0x7f2d60104440 2023-01-25T05:54:03.572 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d5d7fa700 1 -- 172.21.15.88:0/203945947 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2d5002b070 con 0x7f2d60104440 2023-01-25T05:54:03.572 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d5d7fa700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-01-25T05:54:03.572 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d5d7fa700 4 mgrc handle_mgr_map Got map version 1 2023-01-25T05:54:03.572 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d5d7fa700 4 mgrc handle_mgr_map Active mgr is now 2023-01-25T05:54:03.572 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d5d7fa700 4 mgrc reconnect No active mgr available yet 2023-01-25T05:54:03.573 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d5d7fa700 1 -- 172.21.15.88:0/203945947 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2d50024950 con 0x7f2d60104440 2023-01-25T05:54:03.573 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:02.998+0000 7f2d66508700 1 -- 172.21.15.88:0/203945947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d60107460 con 0x7f2d60104440 2023-01-25T05:54:03.573 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.001+0000 7f2d5d7fa700 1 -- 172.21.15.88:0/203945947 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71752 (secure 0 0 0) 0x7f2d50029060 con 0x7f2d60104440 2023-01-25T05:54:03.573 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.073+0000 7f2d66508700 1 -- 172.21.15.88:0/203945947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2d60198780 con 0x7f2d60104440 2023-01-25T05:54:03.574 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.074+0000 7f2d5d7fa700 1 -- 172.21.15.88:0/203945947 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f2d5001f070 con 0x7f2d60104440 2023-01-25T05:54:03.574 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.075+0000 7f2d66508700 10 mgrc shutdown 2023-01-25T05:54:03.574 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.075+0000 7f2d66508700 1 -- 172.21.15.88:0/203945947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 msgr2=0x7f2d60197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:03.574 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.075+0000 7f2d66508700 1 --2- 172.21.15.88:0/203945947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60197b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2d50000c00 tx=0x7f2d50011ae0 comp rx=0 tx=0).stop 2023-01-25T05:54:03.574 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.075+0000 7f2d66508700 1 -- 172.21.15.88:0/203945947 shutdown_connections 2023-01-25T05:54:03.575 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.075+0000 7f2d66508700 1 --2- 172.21.15.88:0/203945947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d60104440 0x7f2d60197b60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:03.575 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.075+0000 7f2d66508700 1 -- 172.21.15.88:0/203945947 >> 172.21.15.88:0/203945947 conn(0x7f2d600fdb10 msgr2=0x7f2d60102870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:03.575 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.075+0000 7f2d66508700 1 -- 172.21.15.88:0/203945947 shutdown_connections 2023-01-25T05:54:03.575 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:03.075+0000 7f2d66508700 1 -- 172.21.15.88:0/203945947 wait complete. 2023-01-25T05:54:03.575 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (2/15)... 2023-01-25T05:54:03.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:03 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/203945947' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-01-25T05:54:03.775 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:03 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:03.494+0000 7f20d742e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T05:54:03.776 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:03 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:03.625+0000 7f20d742e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T05:54:04.238 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:03 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:03.797+0000 7f20d742e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T05:54:04.239 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:03 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:03.888+0000 7f20d742e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T05:54:04.239 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:03 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:03.982+0000 7f20d742e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T05:54:04.738 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:04 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:04.257+0000 7f20d742e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T05:54:05.231 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:04 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:04.948+0000 7f20d742e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T05:54:05.232 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:05.044+0000 7f20d742e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T05:54:05.232 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:05.134+0000 7f20d742e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T05:54:05.488 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:05.231+0000 7f20d742e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T05:54:05.926 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:05.655+0000 7f20d742e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T05:54:05.927 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:05.744+0000 7f20d742e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T05:54:06.196 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:05.926+0000 7f20d742e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T05:54:06.196 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: Activating manager daemon a 2023-01-25T05:54:06.197 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: mgrmap e2: a(active, starting, since 0.00299025s) 2023-01-25T05:54:06.197 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-25T05:54:06.197 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-25T05:54:06.198 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-25T05:54:06.198 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-01-25T05:54:06.198 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2023-01-25T05:54:06.198 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: Manager daemon a is now available 2023-01-25T05:54:06.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2023-01-25T05:54:06.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2023-01-25T05:54:06.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' 2023-01-25T05:54:06.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' 2023-01-25T05:54:06.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:05 smithi088 ceph-mon[102165]: from='mgr.14100 172.21.15.88:0/3227074575' entity='mgr.a' 2023-01-25T05:54:07.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:06 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/180868134' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-01-25T05:54:07.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:06 smithi088 ceph-mon[102165]: mgrmap e3: a(active, since 1.0086s) 2023-01-25T05:54:07.999 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:54:07.999 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-01-25T05:54:07.999 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "8e1fe42c-9c74-11ed-9e56-001a4aab830c", 2023-01-25T05:54:08.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2023-01-25T05:54:08.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-01-25T05:54:08.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-01-25T05:54:08.000 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-01-25T05:54:08.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:08.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-01-25T05:54:08.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-01-25T05:54:08.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2023-01-25T05:54:08.001 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:08.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-01-25T05:54:08.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "a" 2023-01-25T05:54:08.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:08.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-01-25T05:54:08.002 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2023-01-25T05:54:08.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:08.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-01-25T05:54:08.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-01-25T05:54:08.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:08.003 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-01-25T05:54:08.004 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:08.004 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-01-25T05:54:08.004 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-01-25T05:54:08.004 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-01-25T05:54:08.004 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-01-25T05:54:08.005 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-01-25T05:54:08.005 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-01-25T05:54:08.005 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:08.005 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-01-25T05:54:08.005 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-01-25T05:54:08.005 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-01-25T05:54:08.006 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-01-25T05:54:08.006 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-01-25T05:54:08.006 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-01-25T05:54:08.006 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-01-25T05:54:08.006 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-01-25T05:54:08.007 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-01-25T05:54:08.007 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:08.007 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-01-25T05:54:08.007 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:08.007 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-01-25T05:54:08.008 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-01-25T05:54:08.008 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:08.008 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-01-25T05:54:08.008 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": false, 2023-01-25T05:54:08.008 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-01-25T05:54:08.009 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2023-01-25T05:54:08.009 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2023-01-25T05:54:08.009 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2023-01-25T05:54:08.009 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2023-01-25T05:54:08.009 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:08.009 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-01-25T05:54:08.010 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:08.010 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-01-25T05:54:08.010 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:08.010 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2023-01-25T05:53:50.547790+0000", 2023-01-25T05:54:08.010 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-01-25T05:54:08.011 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:08.011 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-01-25T05:54:08.011 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-01-25T05:54:08.011 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.100+0000 7f558d6c8700 1 Processor -- start 2023-01-25T05:54:08.011 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.100+0000 7f558d6c8700 1 -- start start 2023-01-25T05:54:08.012 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.100+0000 7f558d6c8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f55881048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:08.012 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.100+0000 7f558d6c8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588104e80 con 0x7f55881044a0 2023-01-25T05:54:08.012 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.100+0000 7f5586ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f55881048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:08.012 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.100+0000 7f5586ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f55881048b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48178/0 (socket says 172.21.15.88:48178) 2023-01-25T05:54:08.012 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.100+0000 7f5586ffd700 1 -- 172.21.15.88:0/1177689776 learned_addr learned my addr 172.21.15.88:0/1177689776 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:08.013 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.100+0000 7f5586ffd700 1 -- 172.21.15.88:0/1177689776 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588104fc0 con 0x7f55881044a0 2023-01-25T05:54:08.013 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.100+0000 7f5586ffd700 1 --2- 172.21.15.88:0/1177689776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f55881048b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f55780098a0 tx=0x7f5578009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b670ec76897a17 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:08.013 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f5585ffb700 1 -- 172.21.15.88:0/1177689776 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5578004160 con 0x7f55881044a0 2023-01-25T05:54:08.013 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f5585ffb700 1 -- 172.21.15.88:0/1177689776 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f55780036a0 con 0x7f55881044a0 2023-01-25T05:54:08.013 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f5585ffb700 1 -- 172.21.15.88:0/1177689776 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5578011870 con 0x7f55881044a0 2023-01-25T05:54:08.014 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f558d6c8700 1 -- 172.21.15.88:0/1177689776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 msgr2=0x7f55881048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:08.014 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f558d6c8700 1 --2- 172.21.15.88:0/1177689776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f55881048b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f55780098a0 tx=0x7f5578009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:08.014 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f558d6c8700 1 -- 172.21.15.88:0/1177689776 shutdown_connections 2023-01-25T05:54:08.014 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f558d6c8700 1 --2- 172.21.15.88:0/1177689776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f55881048b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:08.014 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f558d6c8700 1 -- 172.21.15.88:0/1177689776 >> 172.21.15.88:0/1177689776 conn(0x7f55880fdbb0 msgr2=0x7f55880fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:08.015 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f558d6c8700 1 -- 172.21.15.88:0/1177689776 shutdown_connections 2023-01-25T05:54:08.015 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.101+0000 7f558d6c8700 1 -- 172.21.15.88:0/1177689776 wait complete. 2023-01-25T05:54:08.015 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.102+0000 7f558d6c8700 1 Processor -- start 2023-01-25T05:54:08.015 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.102+0000 7f558d6c8700 1 -- start start 2023-01-25T05:54:08.015 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.102+0000 7f558d6c8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f5588199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:08.016 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.102+0000 7f558d6c8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558819a300 con 0x7f55881044a0 2023-01-25T05:54:08.016 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.102+0000 7f5586ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f5588199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:08.016 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.102+0000 7f5586ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f5588199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48190/0 (socket says 172.21.15.88:48190) 2023-01-25T05:54:08.016 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.102+0000 7f5586ffd700 1 -- 172.21.15.88:0/180868134 learned_addr learned my addr 172.21.15.88:0/180868134 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:08.016 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.102+0000 7f5586ffd700 1 -- 172.21.15.88:0/180868134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578009550 con 0x7f55881044a0 2023-01-25T05:54:08.017 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.103+0000 7f5586ffd700 1 --2- 172.21.15.88:0/180868134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f5588199dc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5578009fb0 tx=0x7f5578011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:08.017 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.103+0000 7f556ffff700 1 -- 172.21.15.88:0/180868134 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5578004110 con 0x7f55881044a0 2023-01-25T05:54:08.017 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.103+0000 7f556ffff700 1 -- 172.21.15.88:0/180868134 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f557801b440 con 0x7f55881044a0 2023-01-25T05:54:08.017 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.103+0000 7f558d6c8700 1 -- 172.21.15.88:0/180868134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5588102d00 con 0x7f55881044a0 2023-01-25T05:54:08.018 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.103+0000 7f556ffff700 1 -- 172.21.15.88:0/180868134 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5578023400 con 0x7f55881044a0 2023-01-25T05:54:08.018 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.103+0000 7f558d6c8700 1 -- 172.21.15.88:0/180868134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5588102b70 con 0x7f55881044a0 2023-01-25T05:54:08.018 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.103+0000 7f556ffff700 1 -- 172.21.15.88:0/180868134 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 2) v1 ==== 43308+0+0 (secure 0 0 0) 0x7f5578017020 con 0x7f55881044a0 2023-01-25T05:54:08.018 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.103+0000 7f556ffff700 20 mgrc handle_mgr_map mgrmap(e 2) v1 2023-01-25T05:54:08.018 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.104+0000 7f558d6c8700 1 -- 172.21.15.88:0/180868134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5588102e90 con 0x7f55881044a0 2023-01-25T05:54:08.019 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.104+0000 7f556ffff700 4 mgrc handle_mgr_map Got map version 2 2023-01-25T05:54:08.019 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.104+0000 7f556ffff700 4 mgrc handle_mgr_map Active mgr is now 2023-01-25T05:54:08.019 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.104+0000 7f556ffff700 4 mgrc reconnect No active mgr available yet 2023-01-25T05:54:08.019 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.104+0000 7f556ffff700 1 -- 172.21.15.88:0/180868134 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5578049b60 con 0x7f55881044a0 2023-01-25T05:54:08.019 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.106+0000 7f556ffff700 1 -- 172.21.15.88:0/180868134 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71752 (secure 0 0 0) 0x7f557802c3f0 con 0x7f55881044a0 2023-01-25T05:54:08.020 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.175+0000 7f558d6c8700 1 -- 172.21.15.88:0/180868134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5588193b60 con 0x7f55881044a0 2023-01-25T05:54:08.020 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.176+0000 7f556ffff700 1 -- 172.21.15.88:0/180868134 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f557802bab0 con 0x7f55881044a0 2023-01-25T05:54:08.020 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.176+0000 7f558d6c8700 10 mgrc shutdown 2023-01-25T05:54:08.020 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.176+0000 7f558d6c8700 1 -- 172.21.15.88:0/180868134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 msgr2=0x7f5588199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:08.020 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.176+0000 7f558d6c8700 1 --2- 172.21.15.88:0/180868134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f5588199dc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5578009fb0 tx=0x7f5578011a70 comp rx=0 tx=0).stop 2023-01-25T05:54:08.021 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.176+0000 7f558d6c8700 1 -- 172.21.15.88:0/180868134 shutdown_connections 2023-01-25T05:54:08.021 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.176+0000 7f558d6c8700 1 --2- 172.21.15.88:0/180868134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55881044a0 0x7f5588199dc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:08.021 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.176+0000 7f558d6c8700 1 -- 172.21.15.88:0/180868134 >> 172.21.15.88:0/180868134 conn(0x7f55880fdbb0 msgr2=0x7f5588190ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:08.021 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.177+0000 7f558d6c8700 1 -- 172.21.15.88:0/180868134 shutdown_connections 2023-01-25T05:54:08.021 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:06.177+0000 7f558d6c8700 1 -- 172.21.15.88:0/180868134 wait complete. 2023-01-25T05:54:08.022 INFO:teuthology.orchestra.run.smithi088.stdout:mgr not available, waiting (3/15)... 2023-01-25T05:54:09.988 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:09 smithi088 ceph-mon[102165]: mgrmap e4: a(active, since 2s) 2023-01-25T05:54:13.703 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:13 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/1020093752' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-01-25T05:54:14.048 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:54:14.049 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-01-25T05:54:14.049 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsid": "8e1fe42c-9c74-11ed-9e56-001a4aab830c", 2023-01-25T05:54:14.049 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "health": { 2023-01-25T05:54:14.049 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-01-25T05:54:14.050 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-01-25T05:54:14.050 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-01-25T05:54:14.050 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:14.050 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-01-25T05:54:14.050 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-01-25T05:54:14.051 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 0 2023-01-25T05:54:14.051 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:14.051 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-01-25T05:54:14.051 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "a" 2023-01-25T05:54:14.052 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:14.052 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2023-01-25T05:54:14.052 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "monmap": { 2023-01-25T05:54:14.053 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:14.053 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-01-25T05:54:14.054 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-01-25T05:54:14.054 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:14.054 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-01-25T05:54:14.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:14.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-01-25T05:54:14.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-01-25T05:54:14.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-01-25T05:54:14.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-01-25T05:54:14.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-01-25T05:54:14.071 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-01-25T05:54:14.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:14.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-01-25T05:54:14.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-01-25T05:54:14.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-01-25T05:54:14.072 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-01-25T05:54:14.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-01-25T05:54:14.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-01-25T05:54:14.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-01-25T05:54:14.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-01-25T05:54:14.073 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-01-25T05:54:14.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:14.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-01-25T05:54:14.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:14.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-01-25T05:54:14.074 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-01-25T05:54:14.075 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:14.075 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-01-25T05:54:14.075 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2023-01-25T05:54:14.075 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-01-25T05:54:14.075 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modules": [ 2023-01-25T05:54:14.076 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "iostat", 2023-01-25T05:54:14.076 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "nfs", 2023-01-25T05:54:14.076 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "restful" 2023-01-25T05:54:14.076 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ], 2023-01-25T05:54:14.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-01-25T05:54:14.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:14.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-01-25T05:54:14.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-01-25T05:54:14.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "modified": "2023-01-25T05:53:50.547790+0000", 2023-01-25T05:54:14.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "services": {} 2023-01-25T05:54:14.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout }, 2023-01-25T05:54:14.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-01-25T05:54:14.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-01-25T05:54:14.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.021+0000 7f987d6c1700 1 Processor -- start 2023-01-25T05:54:14.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.021+0000 7f987d6c1700 1 -- start start 2023-01-25T05:54:14.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.021+0000 7f987d6c1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:14.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.021+0000 7f987d6c1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98781048a0 con 0x7f9878073710 2023-01-25T05:54:14.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.021+0000 7f9876ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:14.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.022+0000 7f9876ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878108eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51128/0 (socket says 172.21.15.88:51128) 2023-01-25T05:54:14.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.022+0000 7f9876ffd700 1 -- 172.21.15.88:0/2216573842 learned_addr learned my addr 172.21.15.88:0/2216573842 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:14.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.022+0000 7f9876ffd700 1 -- 172.21.15.88:0/2216573842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98781093f0 con 0x7f9878073710 2023-01-25T05:54:14.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.022+0000 7f9876ffd700 1 --2- 172.21.15.88:0/2216573842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878108eb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f98680098a0 tx=0x7f9868009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1af3408a4502af server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:14.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.022+0000 7f98767fc700 1 -- 172.21.15.88:0/2216573842 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9868004160 con 0x7f9878073710 2023-01-25T05:54:14.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.022+0000 7f98767fc700 1 -- 172.21.15.88:0/2216573842 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f98680036a0 con 0x7f9878073710 2023-01-25T05:54:14.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.022+0000 7f98767fc700 1 -- 172.21.15.88:0/2216573842 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9868011870 con 0x7f9878073710 2023-01-25T05:54:14.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.023+0000 7f987d6c1700 1 -- 172.21.15.88:0/2216573842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 msgr2=0x7f9878108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:14.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.023+0000 7f987d6c1700 1 --2- 172.21.15.88:0/2216573842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878108eb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f98680098a0 tx=0x7f9868009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:14.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.023+0000 7f987d6c1700 1 -- 172.21.15.88:0/2216573842 shutdown_connections 2023-01-25T05:54:14.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.023+0000 7f987d6c1700 1 --2- 172.21.15.88:0/2216573842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878108eb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:14.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.023+0000 7f987d6c1700 1 -- 172.21.15.88:0/2216573842 >> 172.21.15.88:0/2216573842 conn(0x7f98780fe400 msgr2=0x7f9878100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:14.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.023+0000 7f987d6c1700 1 -- 172.21.15.88:0/2216573842 shutdown_connections 2023-01-25T05:54:14.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.023+0000 7f987d6c1700 1 -- 172.21.15.88:0/2216573842 wait complete. 2023-01-25T05:54:14.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.023+0000 7f987d6c1700 1 Processor -- start 2023-01-25T05:54:14.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.024+0000 7f987d6c1700 1 -- start start 2023-01-25T05:54:14.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.024+0000 7f987d6c1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:14.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.024+0000 7f987d6c1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987819a280 con 0x7f9878073710 2023-01-25T05:54:14.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.024+0000 7f9876ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:14.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.024+0000 7f9876ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51138/0 (socket says 172.21.15.88:51138) 2023-01-25T05:54:14.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.024+0000 7f9876ffd700 1 -- 172.21.15.88:0/1020093752 learned_addr learned my addr 172.21.15.88:0/1020093752 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:14.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.024+0000 7f9876ffd700 1 -- 172.21.15.88:0/1020093752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868009550 con 0x7f9878073710 2023-01-25T05:54:14.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.024+0000 7f9876ffd700 1 --2- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878199d40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9868003b60 tx=0x7f9868011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:14.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.025+0000 7f9874ff9700 1 -- 172.21.15.88:0/1020093752 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9868004110 con 0x7f9878073710 2023-01-25T05:54:14.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.025+0000 7f9874ff9700 1 -- 172.21.15.88:0/1020093752 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f986801b440 con 0x7f9878073710 2023-01-25T05:54:14.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.025+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987810a2c0 con 0x7f9878073710 2023-01-25T05:54:14.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.025+0000 7f9874ff9700 1 -- 172.21.15.88:0/1020093752 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98680193d0 con 0x7f9878073710 2023-01-25T05:54:14.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.025+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987810a130 con 0x7f9878073710 2023-01-25T05:54:14.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f9874ff9700 1 -- 172.21.15.88:0/1020093752 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 43498+0+0 (secure 0 0 0) 0x7f986802a070 con 0x7f9878073710 2023-01-25T05:54:14.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f9874ff9700 20 mgrc handle_mgr_map mgrmap(e 4) v1 2023-01-25T05:54:14.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987810a450 con 0x7f9878073710 2023-01-25T05:54:14.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f9874ff9700 4 mgrc handle_mgr_map Got map version 4 2023-01-25T05:54:14.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f9874ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:14.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f9874ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:14.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f9874ff9700 1 --2- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f9864036760 0x7f9864038c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:14.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f9874ff9700 1 -- 172.21.15.88:0/1020093752 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9868049a50 con 0x7f9878073710 2023-01-25T05:54:14.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f986e7fc700 1 --2- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f9864036760 0x7f9864038c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:14.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.026+0000 7f986e7fc700 1 --2- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f9864036760 0x7f9864038c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f9860006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:14.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.031+0000 7f9874ff9700 1 -- 172.21.15.88:0/1020093752 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7f986802b920 con 0x7f9878073710 2023-01-25T05:54:14.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.294+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9878061b90 con 0x7f9878073710 2023-01-25T05:54:14.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.294+0000 7f9874ff9700 1 -- 172.21.15.88:0/1020093752 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f986802b350 con 0x7f9878073710 2023-01-25T05:54:14.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 10 mgrc shutdown 2023-01-25T05:54:14.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f9864036760 msgr2=0x7f9864038c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:14.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 --2- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f9864036760 0x7f9864038c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f9860006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:14.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 msgr2=0x7f9878199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:14.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 --2- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878199d40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9868003b60 tx=0x7f9868011a50 comp rx=0 tx=0).stop 2023-01-25T05:54:14.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 shutdown_connections 2023-01-25T05:54:14.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 --2- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f9864036760 0x7f9864038c10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:14.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 --2- 172.21.15.88:0/1020093752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9878073710 0x7f9878199d40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:14.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 >> 172.21.15.88:0/1020093752 conn(0x7f98780fe400 msgr2=0x7f98780ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:14.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 shutdown_connections 2023-01-25T05:54:14.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:13.296+0000 7f987d6c1700 1 -- 172.21.15.88:0/1020093752 wait complete. 2023-01-25T05:54:14.091 INFO:teuthology.orchestra.run.smithi088.stdout:mgr is available 2023-01-25T05:54:14.988 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:14 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/4150546935' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-01-25T05:54:15.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:54:15.095 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [global] 2023-01-25T05:54:15.095 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout fsid = 8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:54:15.096 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-01-25T05:54:15.096 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-01-25T05:54:15.096 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-01-25T05:54:15.096 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-01-25T05:54:15.096 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:54:15.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [mgr] 2023-01-25T05:54:15.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-01-25T05:54:15.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 2023-01-25T05:54:15.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout [osd] 2023-01-25T05:54:15.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-01-25T05:54:15.098 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-01-25T05:54:15.098 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-01-25T05:54:15.098 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-01-25T05:54:15.098 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-01-25T05:54:15.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.457+0000 7efeeb83b700 1 Processor -- start 2023-01-25T05:54:15.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.457+0000 7efeeb83b700 1 -- start start 2023-01-25T05:54:15.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.457+0000 7efeeb83b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:15.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.457+0000 7efeeb83b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee4077ec0 con 0x7efee41049b0 2023-01-25T05:54:15.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.457+0000 7efee95d7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:15.100 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.457+0000 7efee95d7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51146/0 (socket says 172.21.15.88:51146) 2023-01-25T05:54:15.100 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.457+0000 7efee95d7700 1 -- 172.21.15.88:0/363065617 learned_addr learned my addr 172.21.15.88:0/363065617 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:15.100 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.458+0000 7efee95d7700 1 -- 172.21.15.88:0/363065617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee41072d0 con 0x7efee41049b0 2023-01-25T05:54:15.100 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.458+0000 7efee95d7700 1 --2- 172.21.15.88:0/363065617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4106d90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efee00098a0 tx=0x7efee0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f59b507591b7 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:15.100 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.458+0000 7efedbfff700 1 -- 172.21.15.88:0/363065617 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efee0004160 con 0x7efee41049b0 2023-01-25T05:54:15.101 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.458+0000 7efedbfff700 1 -- 172.21.15.88:0/363065617 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7efee00036a0 con 0x7efee41049b0 2023-01-25T05:54:15.101 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.458+0000 7efedbfff700 1 -- 172.21.15.88:0/363065617 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efee0011870 con 0x7efee41049b0 2023-01-25T05:54:15.101 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.458+0000 7efeeb83b700 1 -- 172.21.15.88:0/363065617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 msgr2=0x7efee4106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:15.101 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.458+0000 7efeeb83b700 1 --2- 172.21.15.88:0/363065617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4106d90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efee00098a0 tx=0x7efee0009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:15.101 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efeeb83b700 1 -- 172.21.15.88:0/363065617 shutdown_connections 2023-01-25T05:54:15.102 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efeeb83b700 1 --2- 172.21.15.88:0/363065617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4106d90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:15.102 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efeeb83b700 1 -- 172.21.15.88:0/363065617 >> 172.21.15.88:0/363065617 conn(0x7efee40fe3b0 msgr2=0x7efee4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:15.102 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efeeb83b700 1 -- 172.21.15.88:0/363065617 shutdown_connections 2023-01-25T05:54:15.102 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efeeb83b700 1 -- 172.21.15.88:0/363065617 wait complete. 2023-01-25T05:54:15.102 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efeeb83b700 1 Processor -- start 2023-01-25T05:54:15.103 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efeeb83b700 1 -- start start 2023-01-25T05:54:15.103 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efeeb83b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:15.103 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efeeb83b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee4198010 con 0x7efee41049b0 2023-01-25T05:54:15.103 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efee95d7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:15.103 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efee95d7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51162/0 (socket says 172.21.15.88:51162) 2023-01-25T05:54:15.104 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.459+0000 7efee95d7700 1 -- 172.21.15.88:0/4150546935 learned_addr learned my addr 172.21.15.88:0/4150546935 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:15.104 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.460+0000 7efee95d7700 1 -- 172.21.15.88:0/4150546935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee0009550 con 0x7efee41049b0 2023-01-25T05:54:15.104 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.460+0000 7efee95d7700 1 --2- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4197ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efee00119a0 tx=0x7efee0011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:15.104 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.460+0000 7efeda7fc700 1 -- 172.21.15.88:0/4150546935 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efee0004110 con 0x7efee41049b0 2023-01-25T05:54:15.104 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.460+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee41081a0 con 0x7efee41049b0 2023-01-25T05:54:15.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.460+0000 7efeda7fc700 1 -- 172.21.15.88:0/4150546935 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7efee001b440 con 0x7efee41049b0 2023-01-25T05:54:15.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.460+0000 7efeda7fc700 1 -- 172.21.15.88:0/4150546935 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efee00193d0 con 0x7efee41049b0 2023-01-25T05:54:15.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.460+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee4108010 con 0x7efee41049b0 2023-01-25T05:54:15.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efeda7fc700 1 -- 172.21.15.88:0/4150546935 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 43498+0+0 (secure 0 0 0) 0x7efee002a070 con 0x7efee41049b0 2023-01-25T05:54:15.105 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efeda7fc700 20 mgrc handle_mgr_map mgrmap(e 4) v1 2023-01-25T05:54:15.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efeda7fc700 4 mgrc handle_mgr_map Got map version 4 2023-01-25T05:54:15.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efeda7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:15.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efeda7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:15.106 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efeda7fc700 1 --2- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7efed00367b0 0x7efed0038c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:15.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efeda7fc700 1 -- 172.21.15.88:0/4150546935 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efee0049a10 con 0x7efee41049b0 2023-01-25T05:54:15.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee4108330 con 0x7efee41049b0 2023-01-25T05:54:15.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efee8dd6700 1 --2- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7efed00367b0 0x7efed0038c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:15.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.461+0000 7efee8dd6700 1 --2- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7efed00367b0 0x7efed0038c60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efed4006fd0 tx=0x7efed4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:15.107 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.466+0000 7efeda7fc700 1 -- 172.21.15.88:0/4150546935 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7efee002b530 con 0x7efee41049b0 2023-01-25T05:54:15.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.651+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7efee4061b90 con 0x7efee41049b0 2023-01-25T05:54:15.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.652+0000 7efeda7fc700 1 -- 172.21.15.88:0/4150546935 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7efee002b350 con 0x7efee41049b0 2023-01-25T05:54:15.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 10 mgrc shutdown 2023-01-25T05:54:15.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7efed00367b0 msgr2=0x7efed0038c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:15.108 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 --2- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7efed00367b0 0x7efed0038c60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efed4006fd0 tx=0x7efed4006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:15.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 msgr2=0x7efee4197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:15.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 --2- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4197ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efee00119a0 tx=0x7efee0011b30 comp rx=0 tx=0).stop 2023-01-25T05:54:15.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 shutdown_connections 2023-01-25T05:54:15.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 --2- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7efed00367b0 0x7efed0038c60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:15.109 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 --2- 172.21.15.88:0/4150546935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efee41049b0 0x7efee4197ad0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:15.110 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 >> 172.21.15.88:0/4150546935 conn(0x7efee40fe3b0 msgr2=0x7efee40ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:15.110 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 shutdown_connections 2023-01-25T05:54:15.110 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:14.654+0000 7efeeb83b700 1 -- 172.21.15.88:0/4150546935 wait complete. 2023-01-25T05:54:15.110 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling cephadm module... 2023-01-25T05:54:16.038 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:15 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: ignoring --setuser ceph since I am not root 2023-01-25T05:54:16.038 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:15 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: ignoring --setgroup ceph since I am not root 2023-01-25T05:54:16.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:15 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/2195895795' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-01-25T05:54:16.334 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 Processor -- start 2023-01-25T05:54:16.335 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 -- start start 2023-01-25T05:54:16.335 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48104350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:16.339 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b48104890 con 0x7f3b48103f40 2023-01-25T05:54:16.339 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b477fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48104350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:16.339 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b477fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48104350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51170/0 (socket says 172.21.15.88:51170) 2023-01-25T05:54:16.340 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b477fe700 1 -- 172.21.15.88:0/2017296493 learned_addr learned my addr 172.21.15.88:0/2017296493 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:16.340 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b477fe700 1 -- 172.21.15.88:0/2017296493 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b481049d0 con 0x7f3b48103f40 2023-01-25T05:54:16.340 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b477fe700 1 --2- 172.21.15.88:0/2017296493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48104350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3b380098a0 tx=0x7f3b38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a946abae1b8943 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:16.340 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b467fc700 1 -- 172.21.15.88:0/2017296493 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b38004160 con 0x7f3b48103f40 2023-01-25T05:54:16.340 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b467fc700 1 -- 172.21.15.88:0/2017296493 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f3b380036a0 con 0x7f3b48103f40 2023-01-25T05:54:16.341 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b467fc700 1 -- 172.21.15.88:0/2017296493 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b38011870 con 0x7f3b48103f40 2023-01-25T05:54:16.341 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 -- 172.21.15.88:0/2017296493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 msgr2=0x7f3b48104350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:16.341 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 --2- 172.21.15.88:0/2017296493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48104350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3b380098a0 tx=0x7f3b38009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:16.341 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 -- 172.21.15.88:0/2017296493 shutdown_connections 2023-01-25T05:54:16.341 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 --2- 172.21.15.88:0/2017296493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48104350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:16.342 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 -- 172.21.15.88:0/2017296493 >> 172.21.15.88:0/2017296493 conn(0x7f3b480ff560 msgr2=0x7f3b48101990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:16.342 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 -- 172.21.15.88:0/2017296493 shutdown_connections 2023-01-25T05:54:16.342 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.487+0000 7f3b4e123700 1 -- 172.21.15.88:0/2017296493 wait complete. 2023-01-25T05:54:16.342 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.488+0000 7f3b4e123700 1 Processor -- start 2023-01-25T05:54:16.342 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.488+0000 7f3b4e123700 1 -- start start 2023-01-25T05:54:16.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.488+0000 7f3b4e123700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:16.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.488+0000 7f3b4e123700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b48198020 con 0x7f3b48103f40 2023-01-25T05:54:16.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.488+0000 7f3b477fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:16.343 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.488+0000 7f3b477fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51174/0 (socket says 172.21.15.88:51174) 2023-01-25T05:54:16.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.488+0000 7f3b477fe700 1 -- 172.21.15.88:0/2195895795 learned_addr learned my addr 172.21.15.88:0/2195895795 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:16.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.488+0000 7f3b477fe700 1 -- 172.21.15.88:0/2195895795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38009550 con 0x7f3b48103f40 2023-01-25T05:54:16.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.489+0000 7f3b477fe700 1 --2- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48197ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3b38000c00 tx=0x7f3b38011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:16.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.489+0000 7f3b44ff9700 1 -- 172.21.15.88:0/2195895795 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b38004110 con 0x7f3b48103f40 2023-01-25T05:54:16.344 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.489+0000 7f3b44ff9700 1 -- 172.21.15.88:0/2195895795 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f3b3801b440 con 0x7f3b48103f40 2023-01-25T05:54:16.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.489+0000 7f3b44ff9700 1 -- 172.21.15.88:0/2195895795 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b380193f0 con 0x7f3b48103f40 2023-01-25T05:54:16.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.489+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b48105f10 con 0x7f3b48103f40 2023-01-25T05:54:16.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.489+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b48105d80 con 0x7f3b48103f40 2023-01-25T05:54:16.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b44ff9700 1 -- 172.21.15.88:0/2195895795 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 43498+0+0 (secure 0 0 0) 0x7f3b3802b070 con 0x7f3b48103f40 2023-01-25T05:54:16.345 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b44ff9700 20 mgrc handle_mgr_map mgrmap(e 4) v1 2023-01-25T05:54:16.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b44ff9700 4 mgrc handle_mgr_map Got map version 4 2023-01-25T05:54:16.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b44ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:16.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b44ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:16.346 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b48108400 con 0x7f3b48103f40 2023-01-25T05:54:16.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b44ff9700 1 --2- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f3b30036820 0x7f3b30038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:16.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b44ff9700 1 -- 172.21.15.88:0/2195895795 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3b38049a20 con 0x7f3b48103f40 2023-01-25T05:54:16.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b46ffd700 1 --2- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f3b30036820 0x7f3b30038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:16.347 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.490+0000 7f3b46ffd700 1 --2- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f3b30036820 0x7f3b30038cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c006fd0 tx=0x7f3b3c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:16.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.495+0000 7f3b44ff9700 1 -- 172.21.15.88:0/2195895795 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7f3b38004270 con 0x7f3b48103f40 2023-01-25T05:54:16.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.731+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f3b48061b90 con 0x7f3b48103f40 2023-01-25T05:54:16.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.783+0000 7f3b44ff9700 1 -- 172.21.15.88:0/2195895795 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 5) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f3b38021030 con 0x7f3b48103f40 2023-01-25T05:54:16.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.783+0000 7f3b44ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-01-25T05:54:16.348 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.784+0000 7f3b44ff9700 4 mgrc handle_mgr_map Got map version 5 2023-01-25T05:54:16.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.784+0000 7f3b44ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:16.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.785+0000 7f3b44ff9700 1 -- 172.21.15.88:0/2195895795 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f3b3801b690 con 0x7f3b48103f40 2023-01-25T05:54:16.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 10 mgrc shutdown 2023-01-25T05:54:16.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f3b30036820 msgr2=0x7f3b30038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:16.349 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 --2- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f3b30036820 0x7f3b30038cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c006fd0 tx=0x7f3b3c006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:16.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 msgr2=0x7f3b48197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:16.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 --2- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48197ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3b38000c00 tx=0x7f3b38011ae0 comp rx=0 tx=0).stop 2023-01-25T05:54:16.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 shutdown_connections 2023-01-25T05:54:16.350 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 --2- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f3b30036820 0x7f3b30038cd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:16.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 --2- 172.21.15.88:0/2195895795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b48103f40 0x7f3b48197ae0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:16.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 >> 172.21.15.88:0/2195895795 conn(0x7f3b480ff560 msgr2=0x7f3b48100220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:16.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 shutdown_connections 2023-01-25T05:54:16.351 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:15.788+0000 7f3b4e123700 1 -- 172.21.15.88:0/2195895795 wait complete. 2023-01-25T05:54:16.988 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:16 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/2195895795' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-01-25T05:54:16.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:16 smithi088 ceph-mon[102165]: mgrmap e5: a(active, since 9s) 2023-01-25T05:54:16.989 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:16 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:16.705+0000 7f3d81016200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T05:54:17.372 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:17 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:17.282+0000 7f3d81016200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T05:54:17.482 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-01-25T05:54:17.483 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-01-25T05:54:17.483 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2023-01-25T05:54:17.483 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "active_name": "a", 2023-01-25T05:54:17.484 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-01-25T05:54:17.484 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-01-25T05:54:17.484 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.762+0000 7fb8cad51700 1 Processor -- start 2023-01-25T05:54:17.484 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.762+0000 7fb8cad51700 1 -- start start 2023-01-25T05:54:17.485 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.762+0000 7fb8cad51700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4104750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:17.485 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.762+0000 7fb8cad51700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4104c90 con 0x7fb8c4104340 2023-01-25T05:54:17.485 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.762+0000 7fb8c8aed700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4104750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:17.485 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.762+0000 7fb8c8aed700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4104750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33852/0 (socket says 172.21.15.88:33852) 2023-01-25T05:54:17.486 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.762+0000 7fb8c8aed700 1 -- 172.21.15.88:0/3282655920 learned_addr learned my addr 172.21.15.88:0/3282655920 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:17.486 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.763+0000 7fb8c8aed700 1 -- 172.21.15.88:0/3282655920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4104dd0 con 0x7fb8c4104340 2023-01-25T05:54:17.486 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.763+0000 7fb8c8aed700 1 --2- 172.21.15.88:0/3282655920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4104750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800bb40 tx=0x7fb8b800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c1abdc92f13beb server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:17.486 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.763+0000 7fb8c37fe700 1 -- 172.21.15.88:0/3282655920 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8b800dbe0 con 0x7fb8c4104340 2023-01-25T05:54:17.487 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.763+0000 7fb8c37fe700 1 -- 172.21.15.88:0/3282655920 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7fb8b8004480 con 0x7fb8c4104340 2023-01-25T05:54:17.487 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.763+0000 7fb8c37fe700 1 -- 172.21.15.88:0/3282655920 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8b8003d20 con 0x7fb8c4104340 2023-01-25T05:54:17.487 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 -- 172.21.15.88:0/3282655920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 msgr2=0x7fb8c4104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:17.487 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 --2- 172.21.15.88:0/3282655920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4104750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800bb40 tx=0x7fb8b800be50 comp rx=0 tx=0).stop 2023-01-25T05:54:17.487 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 -- 172.21.15.88:0/3282655920 shutdown_connections 2023-01-25T05:54:17.488 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 --2- 172.21.15.88:0/3282655920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4104750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:17.488 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 -- 172.21.15.88:0/3282655920 >> 172.21.15.88:0/3282655920 conn(0x7fb8c40fdb10 msgr2=0x7fb8c40fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:17.488 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 -- 172.21.15.88:0/3282655920 shutdown_connections 2023-01-25T05:54:17.488 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 -- 172.21.15.88:0/3282655920 wait complete. 2023-01-25T05:54:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 Processor -- start 2023-01-25T05:54:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 -- start start 2023-01-25T05:54:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.764+0000 7fb8cad51700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c419a290 con 0x7fb8c4104340 2023-01-25T05:54:17.489 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8c8aed700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:17.490 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8c8aed700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33854/0 (socket says 172.21.15.88:33854) 2023-01-25T05:54:17.490 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8c8aed700 1 -- 172.21.15.88:0/3178052297 learned_addr learned my addr 172.21.15.88:0/3178052297 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:17.490 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8c8aed700 1 -- 172.21.15.88:0/3178052297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b800b7f0 con 0x7fb8c4104340 2023-01-25T05:54:17.490 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8c8aed700 1 --2- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4199d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800b340 tx=0x7fb8b8004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:17.490 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8c1ffb700 1 -- 172.21.15.88:0/3178052297 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8b8010680 con 0x7fb8c4104340 2023-01-25T05:54:17.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8c1ffb700 1 -- 172.21.15.88:0/3178052297 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7fb8b8010c30 con 0x7fb8c4104340 2023-01-25T05:54:17.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c4103d40 con 0x7fb8c4104340 2023-01-25T05:54:17.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8c1ffb700 1 -- 172.21.15.88:0/3178052297 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8b8019a00 con 0x7fb8c4104340 2023-01-25T05:54:17.495 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.765+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c4103bb0 con 0x7fb8c4104340 2023-01-25T05:54:17.496 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.766+0000 7fb8c1ffb700 1 -- 172.21.15.88:0/3178052297 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 43509+0+0 (secure 0 0 0) 0x7fb8b8019c70 con 0x7fb8c4104340 2023-01-25T05:54:17.496 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.766+0000 7fb8c1ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-01-25T05:54:17.496 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.767+0000 7fb8c1ffb700 4 mgrc handle_mgr_map Got map version 5 2023-01-25T05:54:17.496 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.767+0000 7fb8c1ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:17.496 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.767+0000 7fb8c1ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:17.497 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.766+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c418f6a0 con 0x7fb8c4104340 2023-01-25T05:54:17.497 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.767+0000 7fb8c1ffb700 1 --2- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7fb8b4036870 0x7fb8b4038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:17.497 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.767+0000 7fb8c1ffb700 1 -- 172.21.15.88:0/3178052297 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb8b804a050 con 0x7fb8c4104340 2023-01-25T05:54:17.497 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.767+0000 7fb8c3fff700 1 -- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7fb8b4036870 msgr2=0x7fb8b4038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/1245326124 2023-01-25T05:54:17.497 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.767+0000 7fb8c3fff700 1 --2- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7fb8b4036870 0x7fb8b4038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-25T05:54:17.498 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.771+0000 7fb8c1ffb700 1 -- 172.21.15.88:0/3178052297 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7fb8b807b6d0 con 0x7fb8c4104340 2023-01-25T05:54:17.498 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.968+0000 7fb8c3fff700 1 -- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7fb8b4036870 msgr2=0x7fb8b4038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/1245326124 2023-01-25T05:54:17.498 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:16.968+0000 7fb8c3fff700 1 --2- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7fb8b4036870 0x7fb8b4038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-25T05:54:17.498 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.022+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb8c4101e40 con 0x7fb8c4104340 2023-01-25T05:54:17.498 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.022+0000 7fb8c1ffb700 1 -- 172.21.15.88:0/3178052297 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fb8b8028940 con 0x7fb8c4104340 2023-01-25T05:54:17.499 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.024+0000 7fb8cad51700 10 mgrc shutdown 2023-01-25T05:54:17.499 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.024+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7fb8b4036870 msgr2=0x7fb8b4038d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-25T05:54:17.499 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.024+0000 7fb8cad51700 1 --2- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7fb8b4036870 0x7fb8b4038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:17.500 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.024+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 msgr2=0x7fb8c4199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:17.500 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.024+0000 7fb8cad51700 1 --2- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4199d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800b340 tx=0x7fb8b8004230 comp rx=0 tx=0).stop 2023-01-25T05:54:17.500 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.024+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 shutdown_connections 2023-01-25T05:54:17.500 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.024+0000 7fb8cad51700 1 --2- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7fb8b4036870 0x7fb8b4038d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:17.500 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.024+0000 7fb8cad51700 1 --2- 172.21.15.88:0/3178052297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8c4104340 0x7fb8c4199d50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:17.501 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.025+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 >> 172.21.15.88:0/3178052297 conn(0x7fb8c40fdb10 msgr2=0x7fb8c418c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:17.501 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.025+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 shutdown_connections 2023-01-25T05:54:17.501 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.025+0000 7fb8cad51700 1 -- 172.21.15.88:0/3178052297 wait complete. 2023-01-25T05:54:17.501 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for the mgr to restart... 2023-01-25T05:54:17.502 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr epoch 5... 2023-01-25T05:54:17.722 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:17 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:17.372+0000 7f3d81016200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T05:54:17.723 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:17 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:17.554+0000 7f3d81016200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T05:54:17.988 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:17 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/3178052297' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-01-25T05:54:18.738 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:18 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:18.363+0000 7f3d81016200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T05:54:18.739 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:18 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:18.543+0000 7f3d81016200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T05:54:19.046 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:18 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:18.795+0000 7f3d81016200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T05:54:19.046 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:18 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:18.880+0000 7f3d81016200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T05:54:19.331 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:19 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:19.046+0000 7f3d81016200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T05:54:19.716 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:19 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:19.331+0000 7f3d81016200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T05:54:19.716 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:19 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:19.418+0000 7f3d81016200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T05:54:19.988 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:19 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:19.716+0000 7f3d81016200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T05:54:19.989 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:19 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:19.845+0000 7f3d81016200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T05:54:20.476 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:20 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:20.015+0000 7f3d81016200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T05:54:20.477 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:20 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:20.108+0000 7f3d81016200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T05:54:20.477 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:20 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:20.201+0000 7f3d81016200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T05:54:20.738 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:20 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:20.476+0000 7f3d81016200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T05:54:21.454 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:21 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:21.171+0000 7f3d81016200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T05:54:21.454 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:21 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:21.268+0000 7f3d81016200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T05:54:21.455 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:21 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:21.357+0000 7f3d81016200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T05:54:21.738 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:21 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:21.454+0000 7f3d81016200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T05:54:22.131 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:21 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:21.866+0000 7f3d81016200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T05:54:22.132 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:21 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:21.951+0000 7f3d81016200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T05:54:22.488 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:22 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:22.131+0000 7f3d81016200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T05:54:22.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:22 smithi088 ceph-mon[102165]: Active manager daemon a restarted 2023-01-25T05:54:22.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:22 smithi088 ceph-mon[102165]: Activating manager daemon a 2023-01-25T05:54:22.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:22 smithi088 ceph-mon[102165]: osdmap e2: 0 total, 0 up, 0 in 2023-01-25T05:54:23.488 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: mgrmap e6: a(active, starting, since 0.0553112s) 2023-01-25T05:54:23.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-01-25T05:54:23.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2023-01-25T05:54:23.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-25T05:54:23.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-25T05:54:23.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-25T05:54:23.490 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: Manager daemon a is now available 2023-01-25T05:54:23.490 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: Found migration_current of "None". Setting to last migration. 2023-01-25T05:54:23.490 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:23.491 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:23.491 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-25T05:54:23.491 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-25T05:54:23.491 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-25T05:54:23.491 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2023-01-25T05:54:23.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2023-01-25T05:54:23.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:23.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:23 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:23.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-01-25T05:54:23.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-01-25T05:54:23.640 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "initialized": true 2023-01-25T05:54:23.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-01-25T05:54:23.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.904+0000 7f689062e700 1 Processor -- start 2023-01-25T05:54:23.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.904+0000 7f689062e700 1 -- start start 2023-01-25T05:54:23.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f689062e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888106e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:23.641 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f689062e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888073730 con 0x7f6888104a80 2023-01-25T05:54:23.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f688e3ca700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:23.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f688e3ca700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888106e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33858/0 (socket says 172.21.15.88:33858) 2023-01-25T05:54:23.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f688e3ca700 1 -- 172.21.15.88:0/3774885258 learned_addr learned my addr 172.21.15.88:0/3774885258 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:23.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f688e3ca700 1 -- 172.21.15.88:0/3774885258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6888073870 con 0x7f6888104a80 2023-01-25T05:54:23.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f688e3ca700 1 --2- 172.21.15.88:0/3774885258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888106e60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f68840098a0 tx=0x7f6884009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c832e3886927fccd server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:23.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f688d3c8700 1 -- 172.21.15.88:0/3774885258 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6884004160 con 0x7f6888104a80 2023-01-25T05:54:23.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f688d3c8700 1 -- 172.21.15.88:0/3774885258 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f68840036a0 con 0x7f6888104a80 2023-01-25T05:54:23.643 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.905+0000 7f688d3c8700 1 -- 172.21.15.88:0/3774885258 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6884011870 con 0x7f6888104a80 2023-01-25T05:54:23.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.906+0000 7f689062e700 1 -- 172.21.15.88:0/3774885258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 msgr2=0x7f6888106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:23.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.906+0000 7f689062e700 1 --2- 172.21.15.88:0/3774885258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888106e60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f68840098a0 tx=0x7f6884009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:23.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.906+0000 7f689062e700 1 -- 172.21.15.88:0/3774885258 shutdown_connections 2023-01-25T05:54:23.644 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.906+0000 7f689062e700 1 --2- 172.21.15.88:0/3774885258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888106e60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:23.645 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.906+0000 7f689062e700 1 -- 172.21.15.88:0/3774885258 >> 172.21.15.88:0/3774885258 conn(0x7f68880fe400 msgr2=0x7f6888100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:23.645 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.906+0000 7f689062e700 1 -- 172.21.15.88:0/3774885258 shutdown_connections 2023-01-25T05:54:23.645 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.906+0000 7f689062e700 1 -- 172.21.15.88:0/3774885258 wait complete. 2023-01-25T05:54:23.645 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.907+0000 7f689062e700 1 Processor -- start 2023-01-25T05:54:23.645 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.907+0000 7f689062e700 1 -- start start 2023-01-25T05:54:23.646 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.907+0000 7f689062e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:23.646 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.907+0000 7f689062e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888198080 con 0x7f6888104a80 2023-01-25T05:54:23.646 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.907+0000 7f688e3ca700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:23.646 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.907+0000 7f688e3ca700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33870/0 (socket says 172.21.15.88:33870) 2023-01-25T05:54:23.646 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.907+0000 7f688e3ca700 1 -- 172.21.15.88:0/3335272466 learned_addr learned my addr 172.21.15.88:0/3335272466 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:23.647 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.907+0000 7f688e3ca700 1 -- 172.21.15.88:0/3335272466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884009550 con 0x7f6888104a80 2023-01-25T05:54:23.647 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.908+0000 7f688e3ca700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888197b40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6884003b60 tx=0x7f6884011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:23.647 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.908+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6884004110 con 0x7f6888104a80 2023-01-25T05:54:23.647 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.908+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f688401b440 con 0x7f6888104a80 2023-01-25T05:54:23.648 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.908+0000 7f689062e700 1 -- 172.21.15.88:0/3335272466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68881080e0 con 0x7f6888104a80 2023-01-25T05:54:23.648 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.908+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68840193d0 con 0x7f6888104a80 2023-01-25T05:54:23.648 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.908+0000 7f689062e700 1 -- 172.21.15.88:0/3335272466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6888107f50 con 0x7f6888104a80 2023-01-25T05:54:23.648 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.908+0000 7f689062e700 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2023-01-25T05:54:23.649 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.908+0000 7f689062e700 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2023-01-25T05:54:23.649 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f688402a070 con 0x7f6888104a80 2023-01-25T05:54:23.649 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f687f7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-01-25T05:54:23.649 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f687f7fe700 4 mgrc handle_mgr_map Got map version 5 2023-01-25T05:54:23.650 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f687f7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:23.650 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f687f7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] 2023-01-25T05:54:23.650 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f687f7fe700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 0x7f6874038c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:23.650 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f687f7fe700 10 mgrc reconnect resending 0 (tell) 2023-01-25T05:54:23.650 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 --> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6874039370 con 0x7f68740367b0 2023-01-25T05:54:23.651 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f688dbc9700 1 -- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 msgr2=0x7f6874038c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/1245326124 2023-01-25T05:54:23.651 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6884049ac0 con 0x7f6888104a80 2023-01-25T05:54:23.651 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:17.909+0000 7f688dbc9700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 0x7f6874038c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-25T05:54:23.651 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:18.110+0000 7f688dbc9700 1 -- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 msgr2=0x7f6874038c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/1245326124 2023-01-25T05:54:23.651 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:18.110+0000 7f688dbc9700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 0x7f6874038c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-25T05:54:23.652 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:18.511+0000 7f688dbc9700 1 -- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 msgr2=0x7f6874038c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/1245326124 2023-01-25T05:54:23.652 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:18.511+0000 7f688dbc9700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 0x7f6874038c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-25T05:54:23.652 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:19.312+0000 7f688dbc9700 1 -- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 msgr2=0x7f6874038c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/1245326124 2023-01-25T05:54:23.652 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:19.312+0000 7f688dbc9700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 0x7f6874038c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-25T05:54:23.652 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:20.913+0000 7f688dbc9700 1 -- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 msgr2=0x7f6874038c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/1245326124 2023-01-25T05:54:23.653 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:20.913+0000 7f688dbc9700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 0x7f6874038c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-01-25T05:54:23.653 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:22.198+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mgrmap(e 6) v1 ==== 43319+0+0 (secure 0 0 0) 0x7f6884017020 con 0x7f6888104a80 2023-01-25T05:54:23.653 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:22.198+0000 7f687f7fe700 20 mgrc handle_mgr_map mgrmap(e 6) v1 2023-01-25T05:54:23.653 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:22.198+0000 7f687f7fe700 4 mgrc handle_mgr_map Got map version 6 2023-01-25T05:54:23.653 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:22.198+0000 7f687f7fe700 4 mgrc handle_mgr_map Active mgr is now 2023-01-25T05:54:23.654 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:22.198+0000 7f687f7fe700 4 mgrc reconnect Terminating session with v2:172.21.15.88:6800/1245326124 2023-01-25T05:54:23.654 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:22.198+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 msgr2=0x7f6874038c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-25T05:54:23.654 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:22.198+0000 7f687f7fe700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 0x7f6874038c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:23.654 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:22.198+0000 7f687f7fe700 4 mgrc reconnect No active mgr available yet 2023-01-25T05:54:23.654 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.204+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 7) v1 ==== 43429+0+0 (secure 0 0 0) 0x7f688400f050 con 0x7f6888104a80 2023-01-25T05:54:23.655 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.204+0000 7f687f7fe700 20 mgrc handle_mgr_map mgrmap(e 7) v1 2023-01-25T05:54:23.655 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.204+0000 7f687f7fe700 4 mgrc handle_mgr_map Got map version 7 2023-01-25T05:54:23.655 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.204+0000 7f687f7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:23.655 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.204+0000 7f687f7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:23.655 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.204+0000 7f687f7fe700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f6874039ff0 0x7f687403c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:23.656 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.204+0000 7f687f7fe700 10 mgrc reconnect resending 0 (tell) 2023-01-25T05:54:23.656 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.204+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6874039370 con 0x7f6874039ff0 2023-01-25T05:54:23.656 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.205+0000 7f688dbc9700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f6874039ff0 0x7f687403c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:23.656 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.205+0000 7f688dbc9700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f6874039ff0 0x7f687403c3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6878003a10 tx=0x7f6878009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:23.657 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.206+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 <== mgr.14120 v2:172.21.15.88:6800/2989680299 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f6874039370 con 0x7f6874039ff0 2023-01-25T05:54:23.657 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.206+0000 7f687f7fe700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:23.657 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2023-01-25T05:54:23.657 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 -- 172.21.15.88:0/3335272466 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6888198e70 con 0x7f6874039ff0 2023-01-25T05:54:23.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f687f7fe700 1 -- 172.21.15.88:0/3335272466 <== mgr.14120 v2:172.21.15.88:6800/2989680299 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6888198e70 con 0x7f6874039ff0 2023-01-25T05:54:23.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f687f7fe700 20 mgrc handle_command_reply tid 1 r 0 2023-01-25T05:54:23.658 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 10 mgrc shutdown 2023-01-25T05:54:23.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 -- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f6874039ff0 msgr2=0x7f687403c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:23.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f6874039ff0 0x7f687403c3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6878003a10 tx=0x7f6878009290 comp rx=0 tx=0).stop 2023-01-25T05:54:23.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 -- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 msgr2=0x7f6888197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:23.659 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888197b40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6884003b60 tx=0x7f6884011a50 comp rx=0 tx=0).stop 2023-01-25T05:54:23.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 -- 172.21.15.88:0/3335272466 shutdown_connections 2023-01-25T05:54:23.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6888104a80 0x7f6888197b40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:23.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f6874039ff0 0x7f687403c3d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:23.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 --2- 172.21.15.88:0/3335272466 >> [v2:172.21.15.88:6800/1245326124,v1:172.21.15.88:6801/1245326124] conn(0x7f68740367b0 0x7f6874038c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:23.660 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 -- 172.21.15.88:0/3335272466 >> 172.21.15.88:0/3335272466 conn(0x7f68880fe400 msgr2=0x7f68880ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:23.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 -- 172.21.15.88:0/3335272466 shutdown_connections 2023-01-25T05:54:23.661 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:23.212+0000 7f689062e700 1 -- 172.21.15.88:0/3335272466 wait complete. 2023-01-25T05:54:23.661 INFO:teuthology.orchestra.run.smithi088.stdout:mgr epoch 5 is available 2023-01-25T05:54:23.661 INFO:teuthology.orchestra.run.smithi088.stdout:Setting orchestrator backend to cephadm... 2023-01-25T05:54:24.488 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:24 smithi088 ceph-mon[102165]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-01-25T05:54:24.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:24 smithi088 ceph-mon[102165]: mgrmap e7: a(active, since 1.06225s) 2023-01-25T05:54:24.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:24 smithi088 ceph-mon[102165]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-01-25T05:54:24.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:24 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:24.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:24 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:25.076 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.344+0000 7fcec1cfc700 1 Processor -- start 2023-01-25T05:54:25.076 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.344+0000 7fcec1cfc700 1 -- start start 2023-01-25T05:54:25.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.344+0000 7fcec1cfc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc106e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:25.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.344+0000 7fcec1cfc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc073750 con 0x7fcebc104a60 2023-01-25T05:54:25.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.345+0000 7fcebb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:25.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.345+0000 7fcebb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc106e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33926/0 (socket says 172.21.15.88:33926) 2023-01-25T05:54:25.077 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.345+0000 7fcebb7fe700 1 -- 172.21.15.88:0/1863297252 learned_addr learned my addr 172.21.15.88:0/1863297252 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:25.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.345+0000 7fcebb7fe700 1 -- 172.21.15.88:0/1863297252 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc073890 con 0x7fcebc104a60 2023-01-25T05:54:25.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.345+0000 7fcebb7fe700 1 --2- 172.21.15.88:0/1863297252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc106e40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fceac0098a0 tx=0x7fceac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2038a5564cfb7135 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:25.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.345+0000 7fceba7fc700 1 -- 172.21.15.88:0/1863297252 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac004160 con 0x7fcebc104a60 2023-01-25T05:54:25.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.345+0000 7fceba7fc700 1 -- 172.21.15.88:0/1863297252 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7fceac0036a0 con 0x7fcebc104a60 2023-01-25T05:54:25.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.345+0000 7fceba7fc700 1 -- 172.21.15.88:0/1863297252 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac011870 con 0x7fcebc104a60 2023-01-25T05:54:25.078 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.346+0000 7fcec1cfc700 1 -- 172.21.15.88:0/1863297252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 msgr2=0x7fcebc106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:25.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.346+0000 7fcec1cfc700 1 --2- 172.21.15.88:0/1863297252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc106e40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fceac0098a0 tx=0x7fceac009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:25.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.346+0000 7fcec1cfc700 1 -- 172.21.15.88:0/1863297252 shutdown_connections 2023-01-25T05:54:25.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.346+0000 7fcec1cfc700 1 --2- 172.21.15.88:0/1863297252 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc106e40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:25.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.346+0000 7fcec1cfc700 1 -- 172.21.15.88:0/1863297252 >> 172.21.15.88:0/1863297252 conn(0x7fcebc0fe400 msgr2=0x7fcebc100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:25.079 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.346+0000 7fcec1cfc700 1 -- 172.21.15.88:0/1863297252 shutdown_connections 2023-01-25T05:54:25.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.346+0000 7fcec1cfc700 1 -- 172.21.15.88:0/1863297252 wait complete. 2023-01-25T05:54:25.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.346+0000 7fcec1cfc700 1 Processor -- start 2023-01-25T05:54:25.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fcec1cfc700 1 -- start start 2023-01-25T05:54:25.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fcec1cfc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc1043d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:25.080 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fcec1cfc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc104910 con 0x7fcebc104a60 2023-01-25T05:54:25.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fcebb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc1043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:25.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fcebb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc1043d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33940/0 (socket says 172.21.15.88:33940) 2023-01-25T05:54:25.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fcebb7fe700 1 -- 172.21.15.88:0/377450444 learned_addr learned my addr 172.21.15.88:0/377450444 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:25.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fcebb7fe700 1 -- 172.21.15.88:0/377450444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac009550 con 0x7fcebc104a60 2023-01-25T05:54:25.081 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fcebb7fe700 1 --2- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc1043d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fceac000c00 tx=0x7fceac011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:25.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fceb8ff9700 1 -- 172.21.15.88:0/377450444 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac004110 con 0x7fcebc104a60 2023-01-25T05:54:25.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fceb8ff9700 1 -- 172.21.15.88:0/377450444 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7fceac01b440 con 0x7fcebc104a60 2023-01-25T05:54:25.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc1080c0 con 0x7fcebc104a60 2023-01-25T05:54:25.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.347+0000 7fceb8ff9700 1 -- 172.21.15.88:0/377450444 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceac0193f0 con 0x7fcebc104a60 2023-01-25T05:54:25.082 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.348+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc107f30 con 0x7fcebc104a60 2023-01-25T05:54:25.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.348+0000 7fceb8ff9700 1 -- 172.21.15.88:0/377450444 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7fceac02b070 con 0x7fcebc104a60 2023-01-25T05:54:25.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.348+0000 7fceb8ff9700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:25.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.348+0000 7fceb8ff9700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:25.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.348+0000 7fceb8ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:25.083 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.348+0000 7fceb8ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:25.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.348+0000 7fceb8ff9700 1 --2- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fcea4036870 0x7fcea4038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:25.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.348+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc108250 con 0x7fcebc104a60 2023-01-25T05:54:25.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.349+0000 7fceb8ff9700 1 -- 172.21.15.88:0/377450444 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fceac049a70 con 0x7fcebc104a60 2023-01-25T05:54:25.084 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.349+0000 7fcebaffd700 1 --2- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fcea4036870 0x7fcea4038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:25.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.349+0000 7fcebaffd700 1 --2- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fcea4036870 0x7fcea4038d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fceb0006fd0 tx=0x7fceb0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:25.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.353+0000 7fceb8ff9700 1 -- 172.21.15.88:0/377450444 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7fceac018350 con 0x7fcebc104a60 2023-01-25T05:54:25.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.560+0000 7fcec1cfc700 20 mgrc start_command cmd: [{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}] 2023-01-25T05:54:25.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.560+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fcebc061b90 con 0x7fcea4036870 2023-01-25T05:54:25.085 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.566+0000 7fceb8ff9700 1 -- 172.21.15.88:0/377450444 <== mgr.14120 v2:172.21.15.88:6800/2989680299 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcebc061b90 con 0x7fcea4036870 2023-01-25T05:54:25.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.566+0000 7fceb8ff9700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:25.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 10 mgrc shutdown 2023-01-25T05:54:25.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fcea4036870 msgr2=0x7fcea4038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:25.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 --2- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fcea4036870 0x7fcea4038d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fceb0006fd0 tx=0x7fceb0006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:25.086 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 msgr2=0x7fcebc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:25.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 --2- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc1043d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fceac000c00 tx=0x7fceac011ae0 comp rx=0 tx=0).stop 2023-01-25T05:54:25.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 shutdown_connections 2023-01-25T05:54:25.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 --2- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fcea4036870 0x7fcea4038d20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:25.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 --2- 172.21.15.88:0/377450444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcebc104a60 0x7fcebc1043d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:25.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 >> 172.21.15.88:0/377450444 conn(0x7fcebc0fe400 msgr2=0x7fcebc0ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:25.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 shutdown_connections 2023-01-25T05:54:25.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:24.568+0000 7fcec1cfc700 1 -- 172.21.15.88:0/377450444 wait complete. 2023-01-25T05:54:25.299 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:25 smithi088 ceph-mon[102165]: mgrmap e8: a(active, since 2s) 2023-01-25T05:54:25.300 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:25 smithi088 ceph-mon[102165]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-01-25T05:54:25.300 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:25 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:25.300 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:25 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-25T05:54:26.124 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout value unchanged 2023-01-25T05:54:26.125 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.488+0000 7f1d4bc84700 1 Processor -- start 2023-01-25T05:54:26.125 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.488+0000 7f1d4bc84700 1 -- start start 2023-01-25T05:54:26.125 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.488+0000 7f1d4bc84700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44102620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:26.125 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.488+0000 7f1d4bc84700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d44102b60 con 0x7f1d44102210 2023-01-25T05:54:26.126 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.489+0000 7f1d49a20700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44102620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:26.126 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.489+0000 7f1d49a20700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44102620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33946/0 (socket says 172.21.15.88:33946) 2023-01-25T05:54:26.126 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.489+0000 7f1d49a20700 1 -- 172.21.15.88:0/3689154324 learned_addr learned my addr 172.21.15.88:0/3689154324 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:26.126 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.489+0000 7f1d49a20700 1 -- 172.21.15.88:0/3689154324 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44102ca0 con 0x7f1d44102210 2023-01-25T05:54:26.126 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.489+0000 7f1d49a20700 1 --2- 172.21.15.88:0/3689154324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44102620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1d340098a0 tx=0x7f1d34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3593c0f5987421b8 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:26.127 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.489+0000 7f1d48a1e700 1 -- 172.21.15.88:0/3689154324 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d34004160 con 0x7f1d44102210 2023-01-25T05:54:26.127 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.489+0000 7f1d48a1e700 1 -- 172.21.15.88:0/3689154324 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f1d340036a0 con 0x7f1d44102210 2023-01-25T05:54:26.127 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.489+0000 7f1d48a1e700 1 -- 172.21.15.88:0/3689154324 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d34011870 con 0x7f1d44102210 2023-01-25T05:54:26.127 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.490+0000 7f1d4bc84700 1 -- 172.21.15.88:0/3689154324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 msgr2=0x7f1d44102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:26.127 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.490+0000 7f1d4bc84700 1 --2- 172.21.15.88:0/3689154324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44102620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1d340098a0 tx=0x7f1d34009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:26.128 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.490+0000 7f1d4bc84700 1 -- 172.21.15.88:0/3689154324 shutdown_connections 2023-01-25T05:54:26.128 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.490+0000 7f1d4bc84700 1 --2- 172.21.15.88:0/3689154324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44102620 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:26.128 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.490+0000 7f1d4bc84700 1 -- 172.21.15.88:0/3689154324 >> 172.21.15.88:0/3689154324 conn(0x7f1d440fdbe0 msgr2=0x7f1d440ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:26.128 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.490+0000 7f1d4bc84700 1 -- 172.21.15.88:0/3689154324 shutdown_connections 2023-01-25T05:54:26.128 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.490+0000 7f1d4bc84700 1 -- 172.21.15.88:0/3689154324 wait complete. 2023-01-25T05:54:26.129 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.490+0000 7f1d4bc84700 1 Processor -- start 2023-01-25T05:54:26.129 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.490+0000 7f1d4bc84700 1 -- start start 2023-01-25T05:54:26.129 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d4bc84700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:26.129 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d4bc84700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4419a290 con 0x7f1d44102210 2023-01-25T05:54:26.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d49a20700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:26.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d49a20700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33960/0 (socket says 172.21.15.88:33960) 2023-01-25T05:54:26.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d49a20700 1 -- 172.21.15.88:0/599448961 learned_addr learned my addr 172.21.15.88:0/599448961 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:26.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d49a20700 1 -- 172.21.15.88:0/599448961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34009550 con 0x7f1d44102210 2023-01-25T05:54:26.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d49a20700 1 --2- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44199d50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009fb0 tx=0x7f1d34011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:26.130 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d3affd700 1 -- 172.21.15.88:0/599448961 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d34003fe0 con 0x7f1d44102210 2023-01-25T05:54:26.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d3affd700 1 -- 172.21.15.88:0/599448961 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f1d34004590 con 0x7f1d44102210 2023-01-25T05:54:26.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d44105f10 con 0x7f1d44102210 2023-01-25T05:54:26.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d3affd700 1 -- 172.21.15.88:0/599448961 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d3401a3d0 con 0x7f1d44102210 2023-01-25T05:54:26.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.491+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d44105d80 con 0x7f1d44102210 2023-01-25T05:54:26.131 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.492+0000 7f1d3affd700 1 -- 172.21.15.88:0/599448961 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f1d3402a070 con 0x7f1d44102210 2023-01-25T05:54:26.132 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.492+0000 7f1d3affd700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:26.132 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.492+0000 7f1d3affd700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:26.132 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.492+0000 7f1d3affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:26.132 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.492+0000 7f1d3affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:26.132 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.492+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d441060a0 con 0x7f1d44102210 2023-01-25T05:54:26.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.492+0000 7f1d3affd700 1 --2- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1d30036800 0x7f1d30038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:26.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.492+0000 7f1d3affd700 1 -- 172.21.15.88:0/599448961 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1d34049980 con 0x7f1d44102210 2023-01-25T05:54:26.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.492+0000 7f1d4921f700 1 --2- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1d30036800 0x7f1d30038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:26.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.493+0000 7f1d4921f700 1 --2- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1d30036800 0x7f1d30038cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1d40006fd0 tx=0x7f1d40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:26.133 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.497+0000 7f1d3affd700 1 -- 172.21.15.88:0/599448961 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7f1d441060a0 con 0x7f1d44102210 2023-01-25T05:54:26.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.692+0000 7f1d4bc84700 20 mgrc start_command cmd: [{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}] 2023-01-25T05:54:26.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.692+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d441060a0 con 0x7f1d30036800 2023-01-25T05:54:26.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.693+0000 7f1d3affd700 1 -- 172.21.15.88:0/599448961 <== mgr.14120 v2:172.21.15.88:6800/2989680299 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f1d441060a0 con 0x7f1d30036800 2023-01-25T05:54:26.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.693+0000 7f1d3affd700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:26.134 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.694+0000 7f1d4bc84700 10 mgrc shutdown 2023-01-25T05:54:26.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.694+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1d30036800 msgr2=0x7f1d30038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:26.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.695+0000 7f1d4bc84700 1 --2- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1d30036800 0x7f1d30038cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1d40006fd0 tx=0x7f1d40006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:26.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.695+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 msgr2=0x7f1d44199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:26.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.695+0000 7f1d4bc84700 1 --2- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44199d50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009fb0 tx=0x7f1d34011980 comp rx=0 tx=0).stop 2023-01-25T05:54:26.135 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.695+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 shutdown_connections 2023-01-25T05:54:26.136 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.695+0000 7f1d4bc84700 1 --2- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1d30036800 0x7f1d30038cb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:26.136 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.695+0000 7f1d4bc84700 1 --2- 172.21.15.88:0/599448961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d44102210 0x7f1d44199d50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:26.136 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.695+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 >> 172.21.15.88:0/599448961 conn(0x7f1d440fdbe0 msgr2=0x7f1d440fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:26.136 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.695+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 shutdown_connections 2023-01-25T05:54:26.136 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:25.695+0000 7f1d4bc84700 1 -- 172.21.15.88:0/599448961 wait complete. 2023-01-25T05:54:26.137 INFO:teuthology.orchestra.run.smithi088.stdout:Generating ssh key... 2023-01-25T05:54:26.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-mon[102165]: [25/Jan/2023:05:54:25] ENGINE Bus STARTING 2023-01-25T05:54:26.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-mon[102165]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-01-25T05:54:26.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-mon[102165]: [25/Jan/2023:05:54:25] ENGINE Serving on https://172.21.15.88:7150 2023-01-25T05:54:26.380 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-25T05:54:27.208 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: Generating public/private rsa key pair. 2023-01-25T05:54:27.208 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: Your identification has been saved in /tmp/tmpdpyawilh/key. 2023-01-25T05:54:27.209 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: Your public key has been saved in /tmp/tmpdpyawilh/key.pub. 2023-01-25T05:54:27.209 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: The key fingerprint is: 2023-01-25T05:54:27.209 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: SHA256:5ZDXzj9AznD76hpKLbBERsu/yotA0WKaEDOLn3Qj+sc ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:54:27.209 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: The key's randomart image is: 2023-01-25T05:54:27.209 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: +---[RSA 3072]----+ 2023-01-25T05:54:27.210 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: |+ . | 2023-01-25T05:54:27.210 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: |.= . o . . . | 2023-01-25T05:54:27.210 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: |+ * + = o + + | 2023-01-25T05:54:27.210 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: |.B * + . = O . | 2023-01-25T05:54:27.210 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: |+ + o S . B | 2023-01-25T05:54:27.211 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: | o . . o o + | 2023-01-25T05:54:27.211 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: | o E . + o + | 2023-01-25T05:54:27.211 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: | o o o o . . . | 2023-01-25T05:54:27.211 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: | . +.. .oo | 2023-01-25T05:54:27.211 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:26 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: +----[SHA256]-----+ 2023-01-25T05:54:27.265 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.524+0000 7faf84252700 1 Processor -- start 2023-01-25T05:54:27.266 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.525+0000 7faf84252700 1 -- start start 2023-01-25T05:54:27.266 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.525+0000 7faf84252700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c106e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:27.266 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.525+0000 7faf84252700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c073730 con 0x7faf7c104a80 2023-01-25T05:54:27.266 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.525+0000 7faf81fee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:27.266 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.525+0000 7faf81fee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c106e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44164/0 (socket says 172.21.15.88:44164) 2023-01-25T05:54:27.267 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.525+0000 7faf81fee700 1 -- 172.21.15.88:0/157243381 learned_addr learned my addr 172.21.15.88:0/157243381 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:27.267 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf81fee700 1 -- 172.21.15.88:0/157243381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c073870 con 0x7faf7c104a80 2023-01-25T05:54:27.267 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf81fee700 1 --2- 172.21.15.88:0/157243381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c106e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faf780098a0 tx=0x7faf78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda8a17fbd6650cc server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:27.267 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf80fec700 1 -- 172.21.15.88:0/157243381 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf78004160 con 0x7faf7c104a80 2023-01-25T05:54:27.267 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf80fec700 1 -- 172.21.15.88:0/157243381 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7faf780036a0 con 0x7faf7c104a80 2023-01-25T05:54:27.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf80fec700 1 -- 172.21.15.88:0/157243381 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf78011870 con 0x7faf7c104a80 2023-01-25T05:54:27.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf84252700 1 -- 172.21.15.88:0/157243381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 msgr2=0x7faf7c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:27.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf84252700 1 --2- 172.21.15.88:0/157243381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c106e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faf780098a0 tx=0x7faf78009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:27.268 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf84252700 1 -- 172.21.15.88:0/157243381 shutdown_connections 2023-01-25T05:54:27.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf84252700 1 --2- 172.21.15.88:0/157243381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c106e60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:27.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.526+0000 7faf84252700 1 -- 172.21.15.88:0/157243381 >> 172.21.15.88:0/157243381 conn(0x7faf7c0fe400 msgr2=0x7faf7c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:27.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.527+0000 7faf84252700 1 -- 172.21.15.88:0/157243381 shutdown_connections 2023-01-25T05:54:27.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.527+0000 7faf84252700 1 -- 172.21.15.88:0/157243381 wait complete. 2023-01-25T05:54:27.269 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.527+0000 7faf84252700 1 Processor -- start 2023-01-25T05:54:27.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.527+0000 7faf84252700 1 -- start start 2023-01-25T05:54:27.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.527+0000 7faf84252700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:27.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.527+0000 7faf84252700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c198080 con 0x7faf7c104a80 2023-01-25T05:54:27.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.527+0000 7faf81fee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:27.270 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.527+0000 7faf81fee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44180/0 (socket says 172.21.15.88:44180) 2023-01-25T05:54:27.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.527+0000 7faf81fee700 1 -- 172.21.15.88:0/1735029457 learned_addr learned my addr 172.21.15.88:0/1735029457 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:27.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.528+0000 7faf81fee700 1 -- 172.21.15.88:0/1735029457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009550 con 0x7faf7c104a80 2023-01-25T05:54:27.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.528+0000 7faf81fee700 1 --2- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c197b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf78003b60 tx=0x7faf78011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:27.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.528+0000 7faf72ffd700 1 -- 172.21.15.88:0/1735029457 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf78004110 con 0x7faf7c104a80 2023-01-25T05:54:27.271 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.528+0000 7faf72ffd700 1 -- 172.21.15.88:0/1735029457 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7faf7801b440 con 0x7faf7c104a80 2023-01-25T05:54:27.272 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.528+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c1080e0 con 0x7faf7c104a80 2023-01-25T05:54:27.272 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.528+0000 7faf72ffd700 1 -- 172.21.15.88:0/1735029457 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf780193d0 con 0x7faf7c104a80 2023-01-25T05:54:27.272 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.528+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c107f50 con 0x7faf7c104a80 2023-01-25T05:54:27.272 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.529+0000 7faf72ffd700 1 -- 172.21.15.88:0/1735029457 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7faf7802a070 con 0x7faf7c104a80 2023-01-25T05:54:27.273 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.529+0000 7faf72ffd700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:27.273 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.529+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c108270 con 0x7faf7c104a80 2023-01-25T05:54:27.273 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.529+0000 7faf72ffd700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:27.273 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.529+0000 7faf72ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:27.273 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.529+0000 7faf72ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:27.274 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.529+0000 7faf72ffd700 1 --2- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7faf680367b0 0x7faf68038c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:27.274 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.529+0000 7faf72ffd700 1 -- 172.21.15.88:0/1735029457 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7faf78049ca0 con 0x7faf7c104a80 2023-01-25T05:54:27.274 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.529+0000 7faf817ed700 1 --2- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7faf680367b0 0x7faf68038c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:27.274 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.530+0000 7faf817ed700 1 --2- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7faf680367b0 0x7faf68038c60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faf6c006fd0 tx=0x7faf6c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:27.274 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.534+0000 7faf72ffd700 1 -- 172.21.15.88:0/1735029457 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7faf7804e070 con 0x7faf7c104a80 2023-01-25T05:54:27.275 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.724+0000 7faf84252700 20 mgrc start_command cmd: [{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}] 2023-01-25T05:54:27.275 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.724+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7faf7c0ff8c0 con 0x7faf680367b0 2023-01-25T05:54:27.275 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.846+0000 7faf72ffd700 1 -- 172.21.15.88:0/1735029457 <== mgr.14120 v2:172.21.15.88:6800/2989680299 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faf7c0ff8c0 con 0x7faf680367b0 2023-01-25T05:54:27.275 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.846+0000 7faf72ffd700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:27.275 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 10 mgrc shutdown 2023-01-25T05:54:27.276 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7faf680367b0 msgr2=0x7faf68038c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:27.276 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 --2- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7faf680367b0 0x7faf68038c60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faf6c006fd0 tx=0x7faf6c006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:27.276 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 msgr2=0x7faf7c197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:27.276 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 --2- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c197b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf78003b60 tx=0x7faf78011a50 comp rx=0 tx=0).stop 2023-01-25T05:54:27.276 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 shutdown_connections 2023-01-25T05:54:27.277 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 --2- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7faf680367b0 0x7faf68038c60 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faf6c006fd0 tx=0x7faf6c006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:27.277 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 --2- 172.21.15.88:0/1735029457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf7c104a80 0x7faf7c197b40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:27.277 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 >> 172.21.15.88:0/1735029457 conn(0x7faf7c0fe400 msgr2=0x7faf7c0ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:27.277 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 shutdown_connections 2023-01-25T05:54:27.277 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:26.848+0000 7faf84252700 1 -- 172.21.15.88:0/1735029457 wait complete. 2023-01-25T05:54:27.488 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:27 smithi088 ceph-mon[102165]: [25/Jan/2023:05:54:25] ENGINE Serving on https://172.21.15.88:8765 2023-01-25T05:54:27.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:27 smithi088 ceph-mon[102165]: [25/Jan/2023:05:54:25] ENGINE Bus STARTED 2023-01-25T05:54:27.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:27 smithi088 ceph-mon[102165]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-01-25T05:54:27.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:27 smithi088 ceph-mon[102165]: Generating ssh key... 2023-01-25T05:54:27.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:27 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:27.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:27 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:28.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzZYthLjvtTgAv+cJgUpLf2kMe4t3hJ1bY7FYvaXs7wPtr7LROdXaXFfeG4bdqlyuM2rfaW+NBhu2sQa7axYKHkVPfhF7Env6M1FJv1o6vZz1VlgOqnS/xVnApnrQfdP2Pg3nGlbxhd99JCnCeinM69fNK1PydCHGR67vYzY3dyt0W8h9CAZ+/KAIv1o4Gq8bMSGQbiRah3ycrBT3s3B9oXm/9XR0Ocg63r9GQBUefNvXjAM3FGjYTVvYQ28dP1NiFd/qjUoZnGJ+1oW1lVJK4dNiqK7dMmFDsJJw54MSmVPUbccZXvEstKwrkHJYnesDCgliJlLRAlJhc5a55EtB0Ux13j4tfXhH6ZoM9TsDWzaAUYnuCrz9DS260ckegCT3VFC2KzvY9kAuRFkmNfH4dpd9bXUfmc1MsVPHt+2T9q0imdzNyg3PGYmrT4SGUxzbSAbK0TFmEhIR/DJ/TjPfrOPLWzvlBnzAYAPe1E6KkI8iFGPBtPa8s0tfqQCNlkrM= ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c 2023-01-25T05:54:28.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.691+0000 7f7f970e9700 1 Processor -- start 2023-01-25T05:54:28.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.691+0000 7f7f970e9700 1 -- start start 2023-01-25T05:54:28.404 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.691+0000 7f7f970e9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90104860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:28.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.691+0000 7f7f970e9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90104e30 con 0x7f7f90104450 2023-01-25T05:54:28.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.691+0000 7f7f94e85700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90104860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:28.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.691+0000 7f7f94e85700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90104860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44186/0 (socket says 172.21.15.88:44186) 2023-01-25T05:54:28.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.691+0000 7f7f94e85700 1 -- 172.21.15.88:0/216407378 learned_addr learned my addr 172.21.15.88:0/216407378 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:28.405 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f94e85700 1 -- 172.21.15.88:0/216407378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90103050 con 0x7f7f90104450 2023-01-25T05:54:28.406 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f94e85700 1 --2- 172.21.15.88:0/216407378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90104860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7f840098a0 tx=0x7f7f84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da172630e33f8d5c server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:28.406 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f8f7fe700 1 -- 172.21.15.88:0/216407378 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f84004160 con 0x7f7f90104450 2023-01-25T05:54:28.406 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f8f7fe700 1 -- 172.21.15.88:0/216407378 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f7f840036a0 con 0x7f7f90104450 2023-01-25T05:54:28.406 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f8f7fe700 1 -- 172.21.15.88:0/216407378 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f84011870 con 0x7f7f90104450 2023-01-25T05:54:28.407 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f970e9700 1 -- 172.21.15.88:0/216407378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 msgr2=0x7f7f90104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:28.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f970e9700 1 --2- 172.21.15.88:0/216407378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90104860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7f840098a0 tx=0x7f7f84009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:28.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f970e9700 1 -- 172.21.15.88:0/216407378 shutdown_connections 2023-01-25T05:54:28.408 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f970e9700 1 --2- 172.21.15.88:0/216407378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90104860 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:28.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f970e9700 1 -- 172.21.15.88:0/216407378 >> 172.21.15.88:0/216407378 conn(0x7f7f900fdbb0 msgr2=0x7f7f900fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:28.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.692+0000 7f7f970e9700 1 -- 172.21.15.88:0/216407378 shutdown_connections 2023-01-25T05:54:28.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.693+0000 7f7f970e9700 1 -- 172.21.15.88:0/216407378 wait complete. 2023-01-25T05:54:28.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.693+0000 7f7f970e9700 1 Processor -- start 2023-01-25T05:54:28.409 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.693+0000 7f7f970e9700 1 -- start start 2023-01-25T05:54:28.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.693+0000 7f7f970e9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:28.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.693+0000 7f7f970e9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90195e70 con 0x7f7f90104450 2023-01-25T05:54:28.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.693+0000 7f7f94e85700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:28.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.693+0000 7f7f94e85700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90195930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44200/0 (socket says 172.21.15.88:44200) 2023-01-25T05:54:28.410 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.693+0000 7f7f94e85700 1 -- 172.21.15.88:0/2721750428 learned_addr learned my addr 172.21.15.88:0/2721750428 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:28.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.694+0000 7f7f94e85700 1 -- 172.21.15.88:0/2721750428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f84009550 con 0x7f7f90104450 2023-01-25T05:54:28.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.694+0000 7f7f94e85700 1 --2- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90195930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f84003b60 tx=0x7f7f84011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:28.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.694+0000 7f7f8dffb700 1 -- 172.21.15.88:0/2721750428 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f84004110 con 0x7f7f90104450 2023-01-25T05:54:28.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.694+0000 7f7f8dffb700 1 -- 172.21.15.88:0/2721750428 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f7f8401b440 con 0x7f7f90104450 2023-01-25T05:54:28.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.694+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f90103ed0 con 0x7f7f90104450 2023-01-25T05:54:28.411 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.694+0000 7f7f8dffb700 1 -- 172.21.15.88:0/2721750428 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f840193d0 con 0x7f7f90104450 2023-01-25T05:54:28.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.694+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f90103d40 con 0x7f7f90104450 2023-01-25T05:54:28.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.695+0000 7f7f8dffb700 1 -- 172.21.15.88:0/2721750428 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f7f8402a070 con 0x7f7f90104450 2023-01-25T05:54:28.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.695+0000 7f7f8dffb700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:28.412 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.695+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f90101f40 con 0x7f7f90104450 2023-01-25T05:54:28.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.695+0000 7f7f8dffb700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:28.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.695+0000 7f7f8dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:28.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.695+0000 7f7f8dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:28.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.695+0000 7f7f8dffb700 1 --2- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f7f800389d0 0x7f7f8003ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:28.413 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.695+0000 7f7f8dffb700 1 -- 172.21.15.88:0/2721750428 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7f84049cb0 con 0x7f7f90104450 2023-01-25T05:54:28.414 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.695+0000 7f7f8ffff700 1 --2- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f7f800389d0 0x7f7f8003ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:28.414 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.696+0000 7f7f8ffff700 1 --2- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f7f800389d0 0x7f7f8003ae80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c006fd0 tx=0x7f7f7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:28.414 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.700+0000 7f7f8dffb700 1 -- 172.21.15.88:0/2721750428 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7f7f84018940 con 0x7f7f90104450 2023-01-25T05:54:28.414 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.887+0000 7f7f970e9700 20 mgrc start_command cmd: [{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}] 2023-01-25T05:54:28.414 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.887+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f901964d0 con 0x7f7f800389d0 2023-01-25T05:54:28.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.888+0000 7f7f8dffb700 1 -- 172.21.15.88:0/2721750428 <== mgr.14120 v2:172.21.15.88:6800/2989680299 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f7f901964d0 con 0x7f7f800389d0 2023-01-25T05:54:28.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.888+0000 7f7f8dffb700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:28.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 10 mgrc shutdown 2023-01-25T05:54:28.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f7f800389d0 msgr2=0x7f7f8003ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:28.415 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 --2- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f7f800389d0 0x7f7f8003ae80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c006fd0 tx=0x7f7f7c006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:28.416 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 msgr2=0x7f7f90195930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:28.416 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 --2- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90195930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f84003b60 tx=0x7f7f84011a50 comp rx=0 tx=0).stop 2023-01-25T05:54:28.416 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 shutdown_connections 2023-01-25T05:54:28.416 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 --2- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f7f800389d0 0x7f7f8003ae80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:28.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 --2- 172.21.15.88:0/2721750428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f90104450 0x7f7f90195930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:28.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 >> 172.21.15.88:0/2721750428 conn(0x7f7f900fdbb0 msgr2=0x7f7f9018c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:28.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 shutdown_connections 2023-01-25T05:54:28.417 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:27.890+0000 7f7f970e9700 1 -- 172.21.15.88:0/2721750428 wait complete. 2023-01-25T05:54:28.417 INFO:teuthology.orchestra.run.smithi088.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-01-25T05:54:28.418 INFO:teuthology.orchestra.run.smithi088.stdout:Adding key to root@localhost authorized_keys... 2023-01-25T05:54:28.418 INFO:teuthology.orchestra.run.smithi088.stdout:Adding host smithi088... 2023-01-25T05:54:29.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:28 smithi088 ceph-mon[102165]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-01-25T05:54:30.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:29 smithi088 ceph-mon[102165]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi088", "addr": "172.21.15.88", "target": ["mon-mgr", ""]}]: dispatch 2023-01-25T05:54:30.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:29 smithi088 ceph-mon[102165]: Deploying cephadm binary to smithi088 2023-01-25T05:54:31.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Added host 'smithi088' with addr '172.21.15.88' 2023-01-25T05:54:31.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.804+0000 7f4c7d5a1700 1 Processor -- start 2023-01-25T05:54:31.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c7d5a1700 1 -- start start 2023-01-25T05:54:31.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c7d5a1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78106e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:31.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c7d5a1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78073790 con 0x7f4c78104a20 2023-01-25T05:54:31.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:31.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44202/0 (socket says 172.21.15.88:44202) 2023-01-25T05:54:31.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c76ffd700 1 -- 172.21.15.88:0/1276279863 learned_addr learned my addr 172.21.15.88:0/1276279863 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:31.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c76ffd700 1 -- 172.21.15.88:0/1276279863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c780738d0 con 0x7f4c78104a20 2023-01-25T05:54:31.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c76ffd700 1 --2- 172.21.15.88:0/1276279863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78106e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c680098a0 tx=0x7f4c68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d9a75d938ff0fc server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:31.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c767fc700 1 -- 172.21.15.88:0/1276279863 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c68004160 con 0x7f4c78104a20 2023-01-25T05:54:31.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c767fc700 1 -- 172.21.15.88:0/1276279863 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f4c680036a0 con 0x7f4c78104a20 2023-01-25T05:54:31.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.805+0000 7f4c767fc700 1 -- 172.21.15.88:0/1276279863 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c68011870 con 0x7f4c78104a20 2023-01-25T05:54:31.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.806+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1276279863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 msgr2=0x7f4c78106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:31.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.806+0000 7f4c7d5a1700 1 --2- 172.21.15.88:0/1276279863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78106e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c680098a0 tx=0x7f4c68009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:31.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.806+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1276279863 shutdown_connections 2023-01-25T05:54:31.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.806+0000 7f4c7d5a1700 1 --2- 172.21.15.88:0/1276279863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78106e00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:31.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.806+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1276279863 >> 172.21.15.88:0/1276279863 conn(0x7f4c780fe400 msgr2=0x7f4c78100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:31.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.806+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1276279863 shutdown_connections 2023-01-25T05:54:31.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.806+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1276279863 wait complete. 2023-01-25T05:54:31.252 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c7d5a1700 1 Processor -- start 2023-01-25T05:54:31.252 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c7d5a1700 1 -- start start 2023-01-25T05:54:31.252 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c7d5a1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:31.252 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c7d5a1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78198050 con 0x7f4c78104a20 2023-01-25T05:54:31.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:31.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44210/0 (socket says 172.21.15.88:44210) 2023-01-25T05:54:31.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c76ffd700 1 -- 172.21.15.88:0/1774534248 learned_addr learned my addr 172.21.15.88:0/1774534248 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:31.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c76ffd700 1 -- 172.21.15.88:0/1774534248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68009550 con 0x7f4c78104a20 2023-01-25T05:54:31.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c76ffd700 1 --2- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78197b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c68000c00 tx=0x7f4c68011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:31.254 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.807+0000 7f4c74ff9700 1 -- 172.21.15.88:0/1774534248 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c68004110 con 0x7f4c78104a20 2023-01-25T05:54:31.254 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c74ff9700 1 -- 172.21.15.88:0/1774534248 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7f4c6801b440 con 0x7f4c78104a20 2023-01-25T05:54:31.254 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c781080e0 con 0x7f4c78104a20 2023-01-25T05:54:31.254 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c78107f50 con 0x7f4c78104a20 2023-01-25T05:54:31.254 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c74ff9700 1 -- 172.21.15.88:0/1774534248 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c680193f0 con 0x7f4c78104a20 2023-01-25T05:54:31.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c74ff9700 1 -- 172.21.15.88:0/1774534248 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f4c6802b070 con 0x7f4c78104a20 2023-01-25T05:54:31.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c74ff9700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:31.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c74ff9700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:31.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c74ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:31.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c74ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:31.256 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c74ff9700 1 --2- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f4c64036820 0x7f4c64038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:31.256 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c74ff9700 1 -- 172.21.15.88:0/1774534248 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4c68049ab0 con 0x7f4c78104a20 2023-01-25T05:54:31.256 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.808+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c58005110 con 0x7f4c78104a20 2023-01-25T05:54:31.256 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.809+0000 7f4c6ffff700 1 --2- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f4c64036820 0x7f4c64038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:31.257 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.809+0000 7f4c6ffff700 1 --2- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f4c64036820 0x7f4c64038cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c60006fd0 tx=0x7f4c60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:31.257 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:28.813+0000 7f4c74ff9700 1 -- 172.21.15.88:0/1774534248 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7f4c6801f020 con 0x7f4c78104a20 2023-01-25T05:54:31.257 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:29.004+0000 7f4c7d5a1700 20 mgrc start_command cmd: [{"prefix": "orch host add", "hostname": "smithi088", "addr": "172.21.15.88", "target": ["mon-mgr", ""]}] 2023-01-25T05:54:31.257 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:29.004+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi088", "addr": "172.21.15.88", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c58005d60 con 0x7f4c64036820 2023-01-25T05:54:31.257 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.854+0000 7f4c74ff9700 1 -- 172.21.15.88:0/1774534248 <== mgr.14120 v2:172.21.15.88:6800/2989680299 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f4c58005d60 con 0x7f4c64036820 2023-01-25T05:54:31.258 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.854+0000 7f4c74ff9700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:31.258 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 10 mgrc shutdown 2023-01-25T05:54:31.258 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f4c64036820 msgr2=0x7f4c64038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:31.258 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 --2- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f4c64036820 0x7f4c64038cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c60006fd0 tx=0x7f4c60006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:31.258 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 msgr2=0x7f4c78197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:31.259 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 --2- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78197b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c68000c00 tx=0x7f4c68011ae0 comp rx=0 tx=0).stop 2023-01-25T05:54:31.259 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 shutdown_connections 2023-01-25T05:54:31.259 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 --2- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f4c64036820 0x7f4c64038cd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:31.259 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 --2- 172.21.15.88:0/1774534248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c78104a20 0x7f4c78197b10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:31.259 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 >> 172.21.15.88:0/1774534248 conn(0x7f4c780fe400 msgr2=0x7f4c780ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:31.259 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 shutdown_connections 2023-01-25T05:54:31.260 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:30.857+0000 7f4c7d5a1700 1 -- 172.21.15.88:0/1774534248 wait complete. 2023-01-25T05:54:31.260 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying unmanaged mon service... 2023-01-25T05:54:32.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:31 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:32.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:31 smithi088 ceph-mon[102165]: Added host smithi088 2023-01-25T05:54:32.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:31 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-25T05:54:32.285 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-01-25T05:54:32.286 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.650+0000 7fd23fab3700 1 Processor -- start 2023-01-25T05:54:32.286 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.650+0000 7fd23fab3700 1 -- start start 2023-01-25T05:54:32.286 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.650+0000 7fd23fab3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238102630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:32.286 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.650+0000 7fd23fab3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd238102c00 con 0x7fd238102220 2023-01-25T05:54:32.287 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.651+0000 7fd23d84f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:32.287 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.651+0000 7fd23d84f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238102630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44224/0 (socket says 172.21.15.88:44224) 2023-01-25T05:54:32.287 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.651+0000 7fd23d84f700 1 -- 172.21.15.88:0/3991650484 learned_addr learned my addr 172.21.15.88:0/3991650484 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:32.287 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.651+0000 7fd23d84f700 1 -- 172.21.15.88:0/3991650484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2381051a0 con 0x7fd238102220 2023-01-25T05:54:32.287 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.651+0000 7fd23d84f700 1 --2- 172.21.15.88:0/3991650484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238102630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd2340098a0 tx=0x7fd234009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a061b9385e09e3e3 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:32.288 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.651+0000 7fd23c84d700 1 -- 172.21.15.88:0/3991650484 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd234004160 con 0x7fd238102220 2023-01-25T05:54:32.288 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.651+0000 7fd23c84d700 1 -- 172.21.15.88:0/3991650484 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7fd2340036a0 con 0x7fd238102220 2023-01-25T05:54:32.288 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.651+0000 7fd23c84d700 1 -- 172.21.15.88:0/3991650484 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd234011870 con 0x7fd238102220 2023-01-25T05:54:32.288 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.652+0000 7fd23fab3700 1 -- 172.21.15.88:0/3991650484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 msgr2=0x7fd238102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:32.289 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.652+0000 7fd23fab3700 1 --2- 172.21.15.88:0/3991650484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238102630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd2340098a0 tx=0x7fd234009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:32.289 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.652+0000 7fd23fab3700 1 -- 172.21.15.88:0/3991650484 shutdown_connections 2023-01-25T05:54:32.289 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.652+0000 7fd23fab3700 1 --2- 172.21.15.88:0/3991650484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238102630 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:32.289 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.652+0000 7fd23fab3700 1 -- 172.21.15.88:0/3991650484 >> 172.21.15.88:0/3991650484 conn(0x7fd2380fdb10 msgr2=0x7fd2380fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:32.289 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.652+0000 7fd23fab3700 1 -- 172.21.15.88:0/3991650484 shutdown_connections 2023-01-25T05:54:32.290 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.652+0000 7fd23fab3700 1 -- 172.21.15.88:0/3991650484 wait complete. 2023-01-25T05:54:32.290 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.652+0000 7fd23fab3700 1 Processor -- start 2023-01-25T05:54:32.290 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.652+0000 7fd23fab3700 1 -- start start 2023-01-25T05:54:32.290 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd23fab3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238104b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:32.290 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd23fab3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd238105050 con 0x7fd238102220 2023-01-25T05:54:32.291 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd23d84f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:32.291 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd23d84f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238104b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44230/0 (socket says 172.21.15.88:44230) 2023-01-25T05:54:32.291 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd23d84f700 1 -- 172.21.15.88:0/1591546912 learned_addr learned my addr 172.21.15.88:0/1591546912 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:32.291 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd23d84f700 1 -- 172.21.15.88:0/1591546912 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234009550 con 0x7fd238102220 2023-01-25T05:54:32.292 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd23d84f700 1 --2- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238104b10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd234000c00 tx=0x7fd234011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:32.292 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd22effd700 1 -- 172.21.15.88:0/1591546912 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd234004110 con 0x7fd238102220 2023-01-25T05:54:32.292 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2381083d0 con 0x7fd238102220 2023-01-25T05:54:32.292 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd22effd700 1 -- 172.21.15.88:0/1591546912 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7fd23401b440 con 0x7fd238102220 2023-01-25T05:54:32.292 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd22effd700 1 -- 172.21.15.88:0/1591546912 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2340193f0 con 0x7fd238102220 2023-01-25T05:54:32.293 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.653+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd238105f50 con 0x7fd238102220 2023-01-25T05:54:32.293 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.654+0000 7fd22effd700 1 -- 172.21.15.88:0/1591546912 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7fd23402b070 con 0x7fd238102220 2023-01-25T05:54:32.293 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.654+0000 7fd22effd700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:32.293 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.654+0000 7fd22effd700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:32.293 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.654+0000 7fd22effd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:32.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.654+0000 7fd22effd700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:32.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.654+0000 7fd22effd700 1 --2- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fd224036870 0x7fd224038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:32.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.654+0000 7fd22effd700 1 -- 172.21.15.88:0/1591546912 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd234049aa0 con 0x7fd238102220 2023-01-25T05:54:32.294 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.654+0000 7fd23d04e700 1 --2- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fd224036870 0x7fd224038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:32.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.655+0000 7fd23d04e700 1 --2- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fd224036870 0x7fd224038d20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd228006fd0 tx=0x7fd228006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:32.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.655+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd238108560 con 0x7fd238102220 2023-01-25T05:54:32.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.659+0000 7fd22effd700 1 -- 172.21.15.88:0/1591546912 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7fd23401f020 con 0x7fd238102220 2023-01-25T05:54:32.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.864+0000 7fd23fab3700 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}] 2023-01-25T05:54:32.295 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.864+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd2381046a0 con 0x7fd224036870 2023-01-25T05:54:32.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.868+0000 7fd22effd700 1 -- 172.21.15.88:0/1591546912 <== mgr.14120 v2:172.21.15.88:6800/2989680299 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd2381046a0 con 0x7fd224036870 2023-01-25T05:54:32.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.868+0000 7fd22effd700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:32.296 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.870+0000 7fd23fab3700 10 mgrc shutdown 2023-01-25T05:54:32.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.870+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fd224036870 msgr2=0x7fd224038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:32.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.870+0000 7fd23fab3700 1 --2- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fd224036870 0x7fd224038d20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd228006fd0 tx=0x7fd228006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:32.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.870+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 msgr2=0x7fd238104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:32.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.870+0000 7fd23fab3700 1 --2- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238104b10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd234000c00 tx=0x7fd234011ae0 comp rx=0 tx=0).stop 2023-01-25T05:54:32.297 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.870+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 shutdown_connections 2023-01-25T05:54:32.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.870+0000 7fd23fab3700 1 --2- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fd224036870 0x7fd224038d20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:32.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.870+0000 7fd23fab3700 1 --2- 172.21.15.88:0/1591546912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd238102220 0x7fd238104b10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:32.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.870+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 >> 172.21.15.88:0/1591546912 conn(0x7fd2380fdb10 msgr2=0x7fd2380fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:32.298 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.871+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 shutdown_connections 2023-01-25T05:54:32.299 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:31.871+0000 7fd23fab3700 1 -- 172.21.15.88:0/1591546912 wait complete. 2023-01-25T05:54:32.299 INFO:teuthology.orchestra.run.smithi088.stdout:Deploying unmanaged mgr service... 2023-01-25T05:54:32.980 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:32 smithi088 ceph-mon[102165]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-01-25T05:54:32.980 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:32 smithi088 ceph-mon[102165]: Saving service mon spec with placement count:5 2023-01-25T05:54:32.980 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:32 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:33.861 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-01-25T05:54:33.862 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.164+0000 7ff5b3bef700 1 Processor -- start 2023-01-25T05:54:33.862 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.164+0000 7ff5b3bef700 1 -- start start 2023-01-25T05:54:33.862 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.165+0000 7ff5b3bef700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac077640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:33.862 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.165+0000 7ff5b3bef700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac078f70 con 0x7ff5ac077230 2023-01-25T05:54:33.862 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.165+0000 7ff5b198b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac077640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:33.863 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.165+0000 7ff5b198b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac077640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44238/0 (socket says 172.21.15.88:44238) 2023-01-25T05:54:33.863 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.165+0000 7ff5b198b700 1 -- 172.21.15.88:0/604525807 learned_addr learned my addr 172.21.15.88:0/604525807 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:33.863 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.165+0000 7ff5b198b700 1 -- 172.21.15.88:0/604525807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac077b80 con 0x7ff5ac077230 2023-01-25T05:54:33.863 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.165+0000 7ff5b198b700 1 --2- 172.21.15.88:0/604525807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac077640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40098a0 tx=0x7ff5a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc392840286004a server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:33.863 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.166+0000 7ff5b0989700 1 -- 172.21.15.88:0/604525807 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a4004160 con 0x7ff5ac077230 2023-01-25T05:54:33.864 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.166+0000 7ff5b0989700 1 -- 172.21.15.88:0/604525807 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7ff5a40036a0 con 0x7ff5ac077230 2023-01-25T05:54:33.864 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.166+0000 7ff5b0989700 1 -- 172.21.15.88:0/604525807 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a4011870 con 0x7ff5ac077230 2023-01-25T05:54:33.864 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.166+0000 7ff5b3bef700 1 -- 172.21.15.88:0/604525807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 msgr2=0x7ff5ac077640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:33.864 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.166+0000 7ff5b3bef700 1 --2- 172.21.15.88:0/604525807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac077640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40098a0 tx=0x7ff5a4009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:33.865 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.166+0000 7ff5b3bef700 1 -- 172.21.15.88:0/604525807 shutdown_connections 2023-01-25T05:54:33.865 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.166+0000 7ff5b3bef700 1 --2- 172.21.15.88:0/604525807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac077640 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:33.865 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.166+0000 7ff5b3bef700 1 -- 172.21.15.88:0/604525807 >> 172.21.15.88:0/604525807 conn(0x7ff5ac0ff480 msgr2=0x7ff5ac1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:33.865 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.167+0000 7ff5b3bef700 1 -- 172.21.15.88:0/604525807 shutdown_connections 2023-01-25T05:54:33.865 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.167+0000 7ff5b3bef700 1 -- 172.21.15.88:0/604525807 wait complete. 2023-01-25T05:54:33.865 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.167+0000 7ff5b3bef700 1 Processor -- start 2023-01-25T05:54:33.866 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.167+0000 7ff5b3bef700 1 -- start start 2023-01-25T05:54:33.866 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.167+0000 7ff5b3bef700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:33.866 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.167+0000 7ff5b3bef700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac19a340 con 0x7ff5ac077230 2023-01-25T05:54:33.866 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.167+0000 7ff5b198b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:33.866 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.168+0000 7ff5b198b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44244/0 (socket says 172.21.15.88:44244) 2023-01-25T05:54:33.867 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.168+0000 7ff5b198b700 1 -- 172.21.15.88:0/1373993422 learned_addr learned my addr 172.21.15.88:0/1373993422 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:33.867 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.168+0000 7ff5b198b700 1 -- 172.21.15.88:0/1373993422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4009550 con 0x7ff5ac077230 2023-01-25T05:54:33.867 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.168+0000 7ff5b198b700 1 --2- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac199e00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000c00 tx=0x7ff5a4011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:33.867 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.168+0000 7ff5aaffd700 1 -- 172.21.15.88:0/1373993422 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a4004110 con 0x7ff5ac077230 2023-01-25T05:54:33.867 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.168+0000 7ff5aaffd700 1 -- 172.21.15.88:0/1373993422 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1004+0+0 (secure 0 0 0) 0x7ff5a401b440 con 0x7ff5ac077230 2023-01-25T05:54:33.868 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.168+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac10a4b0 con 0x7ff5ac077230 2023-01-25T05:54:33.868 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.168+0000 7ff5aaffd700 1 -- 172.21.15.88:0/1373993422 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a40193f0 con 0x7ff5ac077230 2023-01-25T05:54:33.868 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.168+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac10a320 con 0x7ff5ac077230 2023-01-25T05:54:33.869 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.169+0000 7ff5aaffd700 1 -- 172.21.15.88:0/1373993422 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7ff5a402b070 con 0x7ff5ac077230 2023-01-25T05:54:33.869 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.169+0000 7ff5aaffd700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:33.869 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.169+0000 7ff5aaffd700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:33.869 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.169+0000 7ff5aaffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:33.869 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.169+0000 7ff5aaffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:33.870 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.169+0000 7ff5aaffd700 1 --2- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7ff594036820 0x7ff594038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:33.870 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.169+0000 7ff5aaffd700 1 -- 172.21.15.88:0/1373993422 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff5a401b5b0 con 0x7ff5ac077230 2023-01-25T05:54:33.870 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.169+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac10a640 con 0x7ff5ac077230 2023-01-25T05:54:33.870 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.169+0000 7ff5b118a700 1 --2- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7ff594036820 0x7ff594038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:33.870 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.170+0000 7ff5b118a700 1 --2- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7ff594036820 0x7ff594038cd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0006fd0 tx=0x7ff5a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:33.871 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.171+0000 7ff5aaffd700 1 -- 172.21.15.88:0/1373993422 <== mon.0 v2:172.21.15.88:3300/0 6 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff5a4018350 con 0x7ff5ac077230 2023-01-25T05:54:33.871 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.177+0000 7ff5aaffd700 1 -- 172.21.15.88:0/1373993422 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7ff5a401f020 con 0x7ff5ac077230 2023-01-25T05:54:33.871 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.385+0000 7ff5b3bef700 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}] 2023-01-25T05:54:33.871 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.385+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff5ac19b130 con 0x7ff594036820 2023-01-25T05:54:33.872 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.390+0000 7ff5aaffd700 1 -- 172.21.15.88:0/1373993422 <== mgr.14120 v2:172.21.15.88:6800/2989680299 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff5ac19b130 con 0x7ff594036820 2023-01-25T05:54:33.872 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.390+0000 7ff5aaffd700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:33.872 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 10 mgrc shutdown 2023-01-25T05:54:33.872 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7ff594036820 msgr2=0x7ff594038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:33.872 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 --2- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7ff594036820 0x7ff594038cd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0006fd0 tx=0x7ff5a0006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:33.873 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 msgr2=0x7ff5ac199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:33.873 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 --2- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac199e00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000c00 tx=0x7ff5a4011ae0 comp rx=0 tx=0).stop 2023-01-25T05:54:33.873 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 shutdown_connections 2023-01-25T05:54:33.873 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 --2- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7ff594036820 0x7ff594038cd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:33.873 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 --2- 172.21.15.88:0/1373993422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac077230 0x7ff5ac199e00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:33.874 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 >> 172.21.15.88:0/1373993422 conn(0x7ff5ac0ff480 msgr2=0x7ff5ac1001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:33.874 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 shutdown_connections 2023-01-25T05:54:33.874 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:33.392+0000 7ff5b3bef700 1 -- 172.21.15.88:0/1373993422 wait complete. 2023-01-25T05:54:34.468 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:34 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:34.469 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:34 smithi088 ceph-mon[102165]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-01-25T05:54:34.469 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:34 smithi088 ceph-mon[102165]: Saving service mgr spec with placement count:2 2023-01-25T05:54:34.469 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:34 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:34.469 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:34 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:34.899 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.231+0000 7f1e3459f700 1 Processor -- start 2023-01-25T05:54:34.900 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.231+0000 7f1e3459f700 1 -- start start 2023-01-25T05:54:34.900 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.231+0000 7f1e3459f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:34.900 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.231+0000 7f1e3459f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c1048c0 con 0x7f1e2c0736f0 2023-01-25T05:54:34.900 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.232+0000 7f1e3233b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:34.900 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.232+0000 7f1e3233b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44246/0 (socket says 172.21.15.88:44246) 2023-01-25T05:54:34.901 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.232+0000 7f1e3233b700 1 -- 172.21.15.88:0/720695885 learned_addr learned my addr 172.21.15.88:0/720695885 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:34.901 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.232+0000 7f1e3233b700 1 -- 172.21.15.88:0/720695885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c109410 con 0x7f1e2c0736f0 2023-01-25T05:54:34.901 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.232+0000 7f1e3233b700 1 --2- 172.21.15.88:0/720695885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c108ed0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e280098a0 tx=0x7f1e28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e9f7baa767c880 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:34.901 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.232+0000 7f1e31339700 1 -- 172.21.15.88:0/720695885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e28004160 con 0x7f1e2c0736f0 2023-01-25T05:54:34.902 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.232+0000 7f1e31339700 1 -- 172.21.15.88:0/720695885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1e280042c0 con 0x7f1e2c0736f0 2023-01-25T05:54:34.902 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.232+0000 7f1e31339700 1 -- 172.21.15.88:0/720695885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e28011830 con 0x7f1e2c0736f0 2023-01-25T05:54:34.902 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.233+0000 7f1e3459f700 1 -- 172.21.15.88:0/720695885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 msgr2=0x7f1e2c108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:34.902 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.233+0000 7f1e3459f700 1 --2- 172.21.15.88:0/720695885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c108ed0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e280098a0 tx=0x7f1e28009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:34.902 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.233+0000 7f1e3459f700 1 -- 172.21.15.88:0/720695885 shutdown_connections 2023-01-25T05:54:34.903 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.233+0000 7f1e3459f700 1 --2- 172.21.15.88:0/720695885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c108ed0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:34.903 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.233+0000 7f1e3459f700 1 -- 172.21.15.88:0/720695885 >> 172.21.15.88:0/720695885 conn(0x7f1e2c0fe400 msgr2=0x7f1e2c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:34.903 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.233+0000 7f1e3459f700 1 -- 172.21.15.88:0/720695885 shutdown_connections 2023-01-25T05:54:34.903 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.233+0000 7f1e3459f700 1 -- 172.21.15.88:0/720695885 wait complete. 2023-01-25T05:54:34.903 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.233+0000 7f1e3459f700 1 Processor -- start 2023-01-25T05:54:34.904 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.233+0000 7f1e3459f700 1 -- start start 2023-01-25T05:54:34.904 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e3459f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:34.904 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e3459f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c19a2b0 con 0x7f1e2c0736f0 2023-01-25T05:54:34.904 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e3233b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:34.904 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e3233b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44258/0 (socket says 172.21.15.88:44258) 2023-01-25T05:54:34.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e3233b700 1 -- 172.21.15.88:0/2412147380 learned_addr learned my addr 172.21.15.88:0/2412147380 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:34.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e3233b700 1 -- 172.21.15.88:0/2412147380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28009550 con 0x7f1e2c0736f0 2023-01-25T05:54:34.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e3233b700 1 --2- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c199d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1e28006ba0 tx=0x7f1e28011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:34.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e237fe700 1 -- 172.21.15.88:0/2412147380 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e28011e40 con 0x7f1e2c0736f0 2023-01-25T05:54:34.905 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e237fe700 1 -- 172.21.15.88:0/2412147380 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1e2801a430 con 0x7f1e2c0736f0 2023-01-25T05:54:34.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c10a320 con 0x7f1e2c0736f0 2023-01-25T05:54:34.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e237fe700 1 -- 172.21.15.88:0/2412147380 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e280193c0 con 0x7f1e2c0736f0 2023-01-25T05:54:34.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.234+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c10a190 con 0x7f1e2c0736f0 2023-01-25T05:54:34.906 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.235+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c10a4b0 con 0x7f1e2c0736f0 2023-01-25T05:54:34.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.236+0000 7f1e237fe700 1 -- 172.21.15.88:0/2412147380 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f1e2802a020 con 0x7f1e2c0736f0 2023-01-25T05:54:34.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.236+0000 7f1e237fe700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:34.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.236+0000 7f1e237fe700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:34.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.236+0000 7f1e237fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:34.907 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.236+0000 7f1e237fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:34.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.236+0000 7f1e237fe700 1 --2- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1e180367b0 0x7f1e18038c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:34.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.236+0000 7f1e237fe700 1 -- 172.21.15.88:0/2412147380 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1e28049e20 con 0x7f1e2c0736f0 2023-01-25T05:54:34.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.237+0000 7f1e31b3a700 1 --2- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1e180367b0 0x7f1e18038c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:34.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.237+0000 7f1e31b3a700 1 --2- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1e180367b0 0x7f1e18038c60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c006fd0 tx=0x7f1e1c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:34.908 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.240+0000 7f1e237fe700 1 -- 172.21.15.88:0/2412147380 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7f1e28018350 con 0x7f1e2c0736f0 2023-01-25T05:54:34.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.438+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f1e2c061b90 con 0x7f1e2c0736f0 2023-01-25T05:54:34.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.441+0000 7f1e237fe700 1 -- 172.21.15.88:0/2412147380 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1e28023b80 con 0x7f1e2c0736f0 2023-01-25T05:54:34.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 10 mgrc shutdown 2023-01-25T05:54:34.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1e180367b0 msgr2=0x7f1e18038c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:34.909 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 --2- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1e180367b0 0x7f1e18038c60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c006fd0 tx=0x7f1e1c006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:34.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 msgr2=0x7f1e2c199d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:34.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 --2- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c199d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1e28006ba0 tx=0x7f1e28011910 comp rx=0 tx=0).stop 2023-01-25T05:54:34.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 shutdown_connections 2023-01-25T05:54:34.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 --2- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1e180367b0 0x7f1e18038c60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:34.910 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 --2- 172.21.15.88:0/2412147380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e2c0736f0 0x7f1e2c199d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:34.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 >> 172.21.15.88:0/2412147380 conn(0x7f1e2c0fe400 msgr2=0x7f1e2c0ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:34.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 shutdown_connections 2023-01-25T05:54:34.911 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:34.443+0000 7f1e3459f700 1 -- 172.21.15.88:0/2412147380 wait complete. 2023-01-25T05:54:35.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:35 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/2412147380' entity='client.admin' 2023-01-25T05:54:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.529+0000 7f5858baa700 1 Processor -- start 2023-01-25T05:54:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.529+0000 7f5858baa700 1 -- start start 2023-01-25T05:54:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.529+0000 7f5858baa700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.529+0000 7f5858baa700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585410d680 con 0x7f585410acd0 2023-01-25T05:54:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.529+0000 7f585259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.529+0000 7f585259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44268/0 (socket says 172.21.15.88:44268) 2023-01-25T05:54:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.529+0000 7f585259c700 1 -- 172.21.15.88:0/3996189674 learned_addr learned my addr 172.21.15.88:0/3996189674 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.530+0000 7f585259c700 1 -- 172.21.15.88:0/3996189674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585410d7c0 con 0x7f585410acd0 2023-01-25T05:54:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.530+0000 7f585259c700 1 --2- 172.21.15.88:0/3996189674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585410d0b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58440098a0 tx=0x7f5844009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868134637f2a64c6 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.530+0000 7f5851d9b700 1 -- 172.21.15.88:0/3996189674 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5844004160 con 0x7f585410acd0 2023-01-25T05:54:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.530+0000 7f5851d9b700 1 -- 172.21.15.88:0/3996189674 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f58440042c0 con 0x7f585410acd0 2023-01-25T05:54:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.530+0000 7f5851d9b700 1 -- 172.21.15.88:0/3996189674 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5844011830 con 0x7f585410acd0 2023-01-25T05:54:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.531+0000 7f5858baa700 1 -- 172.21.15.88:0/3996189674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 msgr2=0x7f585410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.531+0000 7f5858baa700 1 --2- 172.21.15.88:0/3996189674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585410d0b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58440098a0 tx=0x7f5844009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.531+0000 7f5858baa700 1 -- 172.21.15.88:0/3996189674 shutdown_connections 2023-01-25T05:54:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.531+0000 7f5858baa700 1 --2- 172.21.15.88:0/3996189674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585410d0b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.531+0000 7f5858baa700 1 -- 172.21.15.88:0/3996189674 >> 172.21.15.88:0/3996189674 conn(0x7f58540795c0 msgr2=0x7f585407b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.531+0000 7f5858baa700 1 -- 172.21.15.88:0/3996189674 shutdown_connections 2023-01-25T05:54:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.531+0000 7f5858baa700 1 -- 172.21.15.88:0/3996189674 wait complete. 2023-01-25T05:54:36.244 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.531+0000 7f5858baa700 1 Processor -- start 2023-01-25T05:54:36.244 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.531+0000 7f5858baa700 1 -- start start 2023-01-25T05:54:36.244 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f5858baa700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585419e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:36.244 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f5858baa700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585419e670 con 0x7f585410acd0 2023-01-25T05:54:36.244 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f585259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585419e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:36.245 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f585259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585419e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44284/0 (socket says 172.21.15.88:44284) 2023-01-25T05:54:36.245 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f585259c700 1 -- 172.21.15.88:0/2379349464 learned_addr learned my addr 172.21.15.88:0/2379349464 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:36.245 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f585259c700 1 -- 172.21.15.88:0/2379349464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844009550 con 0x7f585410acd0 2023-01-25T05:54:36.245 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f585259c700 1 --2- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585419e130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5844011860 tx=0x7f5844011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:36.245 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f584b7fe700 1 -- 172.21.15.88:0/2379349464 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58440037d0 con 0x7f585410acd0 2023-01-25T05:54:36.246 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585410e730 con 0x7f585410acd0 2023-01-25T05:54:36.246 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f584b7fe700 1 -- 172.21.15.88:0/2379349464 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f5844003930 con 0x7f585410acd0 2023-01-25T05:54:36.246 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f584b7fe700 1 -- 172.21.15.88:0/2379349464 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5844024410 con 0x7f585410acd0 2023-01-25T05:54:36.246 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.532+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585410e5a0 con 0x7f585410acd0 2023-01-25T05:54:36.246 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.533+0000 7f584b7fe700 1 -- 172.21.15.88:0/2379349464 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7f5844017020 con 0x7f585410acd0 2023-01-25T05:54:36.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.533+0000 7f584b7fe700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:36.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.533+0000 7f584b7fe700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:36.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.533+0000 7f584b7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:36.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.533+0000 7f584b7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:36.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.533+0000 7f584b7fe700 1 --2- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f5840036820 0x7f5840038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:36.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.533+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585410e8c0 con 0x7f585410acd0 2023-01-25T05:54:36.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.533+0000 7f584b7fe700 1 -- 172.21.15.88:0/2379349464 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5844049d70 con 0x7f585410acd0 2023-01-25T05:54:36.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.534+0000 7f584bfff700 1 --2- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f5840036820 0x7f5840038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:36.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.534+0000 7f584bfff700 1 --2- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f5840036820 0x7f5840038cd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f583c006fd0 tx=0x7f583c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:36.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.538+0000 7f584b7fe700 1 -- 172.21.15.88:0/2379349464 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7f5844022900 con 0x7f585410acd0 2023-01-25T05:54:36.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.749+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f5854061b90 con 0x7f585410acd0 2023-01-25T05:54:36.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.752+0000 7f584b7fe700 1 -- 172.21.15.88:0/2379349464 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5844016260 con 0x7f585410acd0 2023-01-25T05:54:36.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 10 mgrc shutdown 2023-01-25T05:54:36.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f5840036820 msgr2=0x7f5840038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:36.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 --2- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f5840036820 0x7f5840038cd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f583c006fd0 tx=0x7f583c006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:36.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 msgr2=0x7f585419e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:36.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 --2- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585419e130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5844011860 tx=0x7f5844011940 comp rx=0 tx=0).stop 2023-01-25T05:54:36.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 shutdown_connections 2023-01-25T05:54:36.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 --2- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f5840036820 0x7f5840038cd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:36.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 --2- 172.21.15.88:0/2379349464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f585410acd0 0x7f585419e130 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:36.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 >> 172.21.15.88:0/2379349464 conn(0x7f58540795c0 msgr2=0x7f585407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:36.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 shutdown_connections 2023-01-25T05:54:36.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:35.754+0000 7f5858baa700 1 -- 172.21.15.88:0/2379349464 wait complete. 2023-01-25T05:54:36.251 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling the dashboard module... 2023-01-25T05:54:36.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:36 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:36.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:36 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/2379349464' entity='client.admin' 2023-01-25T05:54:37.978 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:37 smithi088 ceph-mon[102165]: from='mgr.14120 172.21.15.88:0/2842429951' entity='mgr.a' 2023-01-25T05:54:37.979 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:37 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/1582508752' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-01-25T05:54:37.979 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:37 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: ignoring --setuser ceph since I am not root 2023-01-25T05:54:37.979 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:37 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: ignoring --setgroup ceph since I am not root 2023-01-25T05:54:38.183 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.678+0000 7eff18869700 1 Processor -- start 2023-01-25T05:54:38.184 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.678+0000 7eff18869700 1 -- start start 2023-01-25T05:54:38.184 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.678+0000 7eff18869700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14106e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:38.184 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.678+0000 7eff18869700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff14077d50 con 0x7eff14104a70 2023-01-25T05:54:38.184 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.679+0000 7eff1259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:38.185 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.679+0000 7eff1259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14106e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33250/0 (socket says 172.21.15.88:33250) 2023-01-25T05:54:38.185 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.679+0000 7eff1259c700 1 -- 172.21.15.88:0/577519040 learned_addr learned my addr 172.21.15.88:0/577519040 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:38.185 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.679+0000 7eff1259c700 1 -- 172.21.15.88:0/577519040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14077e90 con 0x7eff14104a70 2023-01-25T05:54:38.185 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.679+0000 7eff1259c700 1 --2- 172.21.15.88:0/577519040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14106e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff040098a0 tx=0x7eff04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53ba3c6280f1472 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:38.186 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.679+0000 7eff1159a700 1 -- 172.21.15.88:0/577519040 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff04004160 con 0x7eff14104a70 2023-01-25T05:54:38.186 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.679+0000 7eff1159a700 1 -- 172.21.15.88:0/577519040 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7eff040042c0 con 0x7eff14104a70 2023-01-25T05:54:38.186 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.679+0000 7eff1159a700 1 -- 172.21.15.88:0/577519040 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff04011830 con 0x7eff14104a70 2023-01-25T05:54:38.186 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.680+0000 7eff18869700 1 -- 172.21.15.88:0/577519040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 msgr2=0x7eff14106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:38.186 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.680+0000 7eff18869700 1 --2- 172.21.15.88:0/577519040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14106e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff040098a0 tx=0x7eff04009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:38.187 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.680+0000 7eff18869700 1 -- 172.21.15.88:0/577519040 shutdown_connections 2023-01-25T05:54:38.187 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.680+0000 7eff18869700 1 --2- 172.21.15.88:0/577519040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14106e50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:38.187 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.680+0000 7eff18869700 1 -- 172.21.15.88:0/577519040 >> 172.21.15.88:0/577519040 conn(0x7eff140fe450 msgr2=0x7eff14100880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:38.187 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.680+0000 7eff18869700 1 -- 172.21.15.88:0/577519040 shutdown_connections 2023-01-25T05:54:38.187 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.680+0000 7eff18869700 1 -- 172.21.15.88:0/577519040 wait complete. 2023-01-25T05:54:38.188 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.681+0000 7eff18869700 1 Processor -- start 2023-01-25T05:54:38.188 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.681+0000 7eff18869700 1 -- start start 2023-01-25T05:54:38.188 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.681+0000 7eff18869700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:38.188 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.681+0000 7eff18869700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff14198080 con 0x7eff14104a70 2023-01-25T05:54:38.188 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.681+0000 7eff1259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:38.189 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.681+0000 7eff1259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33256/0 (socket says 172.21.15.88:33256) 2023-01-25T05:54:38.189 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.681+0000 7eff1259c700 1 -- 172.21.15.88:0/1582508752 learned_addr learned my addr 172.21.15.88:0/1582508752 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:38.189 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.682+0000 7eff1259c700 1 -- 172.21.15.88:0/1582508752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009550 con 0x7eff14104a70 2023-01-25T05:54:38.189 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.682+0000 7eff1259c700 1 --2- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14197b40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7eff04011860 tx=0x7eff04011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:38.189 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.682+0000 7eff037fe700 1 -- 172.21.15.88:0/1582508752 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff040037d0 con 0x7eff14104a70 2023-01-25T05:54:38.190 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.682+0000 7eff037fe700 1 -- 172.21.15.88:0/1582508752 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7eff04003930 con 0x7eff14104a70 2023-01-25T05:54:38.190 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.682+0000 7eff037fe700 1 -- 172.21.15.88:0/1582508752 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff04024410 con 0x7eff14104a70 2023-01-25T05:54:38.190 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.682+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff14108110 con 0x7eff14104a70 2023-01-25T05:54:38.190 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.683+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff14107f80 con 0x7eff14104a70 2023-01-25T05:54:38.190 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.683+0000 7eff037fe700 1 -- 172.21.15.88:0/1582508752 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 43509+0+0 (secure 0 0 0) 0x7eff04017020 con 0x7eff14104a70 2023-01-25T05:54:38.190 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.683+0000 7eff037fe700 20 mgrc handle_mgr_map mgrmap(e 8) v1 2023-01-25T05:54:38.191 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.683+0000 7eff037fe700 4 mgrc handle_mgr_map Got map version 8 2023-01-25T05:54:38.191 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.683+0000 7eff037fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:38.191 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.683+0000 7eff037fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:38.191 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.683+0000 7eff037fe700 1 --2- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7efefc036900 0x7efefc038db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:38.191 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.683+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff141082a0 con 0x7eff14104a70 2023-01-25T05:54:38.192 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.684+0000 7eff037fe700 1 -- 172.21.15.88:0/1582508752 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7eff04049bf0 con 0x7eff14104a70 2023-01-25T05:54:38.192 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.684+0000 7eff11d9b700 1 --2- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7efefc036900 0x7efefc038db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:38.192 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.684+0000 7eff11d9b700 1 --2- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7efefc036900 0x7efefc038db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7eff08006fd0 tx=0x7eff08006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:38.192 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.689+0000 7eff037fe700 1 -- 172.21.15.88:0/1582508752 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7eff04024570 con 0x7eff14104a70 2023-01-25T05:54:38.192 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:36.940+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7eff14061b90 con 0x7eff14104a70 2023-01-25T05:54:38.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.647+0000 7eff037fe700 1 -- 172.21.15.88:0/1582508752 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 9) v1 ==== 43522+0+0 (secure 0 0 0) 0x7eff0400f050 con 0x7eff14104a70 2023-01-25T05:54:38.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.647+0000 7eff037fe700 20 mgrc handle_mgr_map mgrmap(e 9) v1 2023-01-25T05:54:38.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.647+0000 7eff037fe700 4 mgrc handle_mgr_map Got map version 9 2023-01-25T05:54:38.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.647+0000 7eff037fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:38.193 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.648+0000 7eff037fe700 1 -- 172.21.15.88:0/1582508752 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7eff04003aa0 con 0x7eff14104a70 2023-01-25T05:54:38.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 10 mgrc shutdown 2023-01-25T05:54:38.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7efefc036900 msgr2=0x7efefc038db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:38.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 --2- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7efefc036900 0x7efefc038db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7eff08006fd0 tx=0x7eff08006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:38.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 msgr2=0x7eff14197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:38.194 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 --2- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14197b40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7eff04011860 tx=0x7eff04011940 comp rx=0 tx=0).stop 2023-01-25T05:54:38.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 shutdown_connections 2023-01-25T05:54:38.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 --2- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7efefc036900 0x7efefc038db0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:38.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 --2- 172.21.15.88:0/1582508752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff14104a70 0x7eff14197b40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:38.195 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 >> 172.21.15.88:0/1582508752 conn(0x7eff140fe450 msgr2=0x7eff140ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:38.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 shutdown_connections 2023-01-25T05:54:38.196 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:37.651+0000 7eff18869700 1 -- 172.21.15.88:0/1582508752 wait complete. 2023-01-25T05:54:38.681 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:38 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/1582508752' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-01-25T05:54:38.682 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:38 smithi088 ceph-mon[102165]: mgrmap e9: a(active, since 15s) 2023-01-25T05:54:38.682 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:38 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:38.567+0000 7f6b94328200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T05:54:39.418 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:39 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:39.143+0000 7f6b94328200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T05:54:39.418 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:39 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:39.236+0000 7f6b94328200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T05:54:39.602 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-01-25T05:54:39.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-01-25T05:54:39.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "available": true, 2023-01-25T05:54:39.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "active_name": "a", 2023-01-25T05:54:39.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-01-25T05:54:39.603 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-01-25T05:54:39.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.875+0000 7fb55ea2e700 1 Processor -- start 2023-01-25T05:54:39.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.875+0000 7fb55ea2e700 1 -- start start 2023-01-25T05:54:39.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.875+0000 7fb55ea2e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558104820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:39.604 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.875+0000 7fb55ea2e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558104df0 con 0x7fb558104410 2023-01-25T05:54:39.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.876+0000 7fb557fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558104820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:39.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.876+0000 7fb557fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558104820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33278/0 (socket says 172.21.15.88:33278) 2023-01-25T05:54:39.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.876+0000 7fb557fff700 1 -- 172.21.15.88:0/318610133 learned_addr learned my addr 172.21.15.88:0/318610133 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:39.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.876+0000 7fb557fff700 1 -- 172.21.15.88:0/318610133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558103010 con 0x7fb558104410 2023-01-25T05:54:39.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.876+0000 7fb557fff700 1 --2- 172.21.15.88:0/318610133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558104820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb5480098a0 tx=0x7fb548009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837729b1faca75d9 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:39.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.876+0000 7fb556ffd700 1 -- 172.21.15.88:0/318610133 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb548004160 con 0x7fb558104410 2023-01-25T05:54:39.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.876+0000 7fb556ffd700 1 -- 172.21.15.88:0/318610133 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb5480042c0 con 0x7fb558104410 2023-01-25T05:54:39.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.876+0000 7fb556ffd700 1 -- 172.21.15.88:0/318610133 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb548011830 con 0x7fb558104410 2023-01-25T05:54:39.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.877+0000 7fb55ea2e700 1 -- 172.21.15.88:0/318610133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 msgr2=0x7fb558104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:39.606 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.877+0000 7fb55ea2e700 1 --2- 172.21.15.88:0/318610133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558104820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb5480098a0 tx=0x7fb548009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:39.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.877+0000 7fb55ea2e700 1 -- 172.21.15.88:0/318610133 shutdown_connections 2023-01-25T05:54:39.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.877+0000 7fb55ea2e700 1 --2- 172.21.15.88:0/318610133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558104820 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:39.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.877+0000 7fb55ea2e700 1 -- 172.21.15.88:0/318610133 >> 172.21.15.88:0/318610133 conn(0x7fb5580fdb10 msgr2=0x7fb5580fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:39.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.877+0000 7fb55ea2e700 1 -- 172.21.15.88:0/318610133 shutdown_connections 2023-01-25T05:54:39.607 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.877+0000 7fb55ea2e700 1 -- 172.21.15.88:0/318610133 wait complete. 2023-01-25T05:54:39.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.878+0000 7fb55ea2e700 1 Processor -- start 2023-01-25T05:54:39.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.878+0000 7fb55ea2e700 1 -- start start 2023-01-25T05:54:39.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.878+0000 7fb55ea2e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558102a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:39.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.878+0000 7fb55ea2e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55819a880 con 0x7fb558104410 2023-01-25T05:54:39.608 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.878+0000 7fb557fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558102a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:39.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.878+0000 7fb557fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558102a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33294/0 (socket says 172.21.15.88:33294) 2023-01-25T05:54:39.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.878+0000 7fb557fff700 1 -- 172.21.15.88:0/3578642900 learned_addr learned my addr 172.21.15.88:0/3578642900 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:39.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.879+0000 7fb557fff700 1 -- 172.21.15.88:0/3578642900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb548009550 con 0x7fb558104410 2023-01-25T05:54:39.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.879+0000 7fb557fff700 1 --2- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558102a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb548006ba0 tx=0x7fb548011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:39.609 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.879+0000 7fb5557fa700 1 -- 172.21.15.88:0/3578642900 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb548011e40 con 0x7fb558104410 2023-01-25T05:54:39.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.879+0000 7fb5557fa700 1 -- 172.21.15.88:0/3578642900 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb54801a430 con 0x7fb558104410 2023-01-25T05:54:39.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.879+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb558107250 con 0x7fb558104410 2023-01-25T05:54:39.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.879+0000 7fb5557fa700 1 -- 172.21.15.88:0/3578642900 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5480193c0 con 0x7fb558104410 2023-01-25T05:54:39.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.879+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb558103e00 con 0x7fb558104410 2023-01-25T05:54:39.610 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.880+0000 7fb5557fa700 1 -- 172.21.15.88:0/3578642900 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 43522+0+0 (secure 0 0 0) 0x7fb54802a020 con 0x7fb558104410 2023-01-25T05:54:39.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.880+0000 7fb5557fa700 20 mgrc handle_mgr_map mgrmap(e 9) v1 2023-01-25T05:54:39.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.880+0000 7fb5557fa700 4 mgrc handle_mgr_map Got map version 9 2023-01-25T05:54:39.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.880+0000 7fb5557fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:39.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.880+0000 7fb5557fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:39.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.880+0000 7fb5557fa700 1 --2- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fb540036800 0x7fb540038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:39.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.880+0000 7fb5557fa700 1 -- 172.21.15.88:0/3578642900 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb54801a5a0 con 0x7fb558104410 2023-01-25T05:54:39.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.880+0000 7fb5577fe700 1 -- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fb540036800 msgr2=0x7fb540038cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2989680299 2023-01-25T05:54:39.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.880+0000 7fb5577fe700 1 --2- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fb540036800 0x7fb540038cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-25T05:54:39.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.881+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5581073e0 con 0x7fb558104410 2023-01-25T05:54:39.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:38.885+0000 7fb5557fa700 1 -- 172.21.15.88:0/3578642900 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7fb548019680 con 0x7fb558104410 2023-01-25T05:54:39.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.081+0000 7fb5577fe700 1 -- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fb540036800 msgr2=0x7fb540038cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2989680299 2023-01-25T05:54:39.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.081+0000 7fb5577fe700 1 --2- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fb540036800 0x7fb540038cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-25T05:54:39.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.168+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb55819b0e0 con 0x7fb558104410 2023-01-25T05:54:39.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.169+0000 7fb5557fa700 1 -- 172.21.15.88:0/3578642900 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fb548018350 con 0x7fb558104410 2023-01-25T05:54:39.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 10 mgrc shutdown 2023-01-25T05:54:39.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fb540036800 msgr2=0x7fb540038cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-25T05:54:39.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 --2- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fb540036800 0x7fb540038cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:39.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 msgr2=0x7fb558102a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:39.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 --2- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558102a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb548006ba0 tx=0x7fb548011910 comp rx=0 tx=0).stop 2023-01-25T05:54:39.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 shutdown_connections 2023-01-25T05:54:39.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 --2- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7fb540036800 0x7fb540038cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:39.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 --2- 172.21.15.88:0/3578642900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb558104410 0x7fb558102a90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:39.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 >> 172.21.15.88:0/3578642900 conn(0x7fb5580fdb10 msgr2=0x7fb5580fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:39.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 shutdown_connections 2023-01-25T05:54:39.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:39.171+0000 7fb55ea2e700 1 -- 172.21.15.88:0/3578642900 wait complete. 2023-01-25T05:54:39.616 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for the mgr to restart... 2023-01-25T05:54:39.616 INFO:teuthology.orchestra.run.smithi088.stdout:Waiting for mgr epoch 9... 2023-01-25T05:54:39.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:39 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/3578642900' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-01-25T05:54:39.739 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:39 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:39.418+0000 7f6b94328200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T05:54:40.684 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:40 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:40.243+0000 7f6b94328200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T05:54:40.685 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:40 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:40.426+0000 7f6b94328200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T05:54:40.941 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:40 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:40.683+0000 7f6b94328200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T05:54:40.941 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:40 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:40.770+0000 7f6b94328200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T05:54:41.226 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:40 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:40.940+0000 7f6b94328200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T05:54:41.488 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:41 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:41.226+0000 7f6b94328200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T05:54:41.489 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:41 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:41.315+0000 7f6b94328200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T05:54:41.923 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:41 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:41.620+0000 7f6b94328200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T05:54:41.923 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:41 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:41.751+0000 7f6b94328200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T05:54:42.238 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:41 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:41.923+0000 7f6b94328200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T05:54:42.239 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:42 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:42.016+0000 7f6b94328200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T05:54:42.239 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:42 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:42.110+0000 7f6b94328200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T05:54:42.738 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:42 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:42.364+0000 7f6b94328200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T05:54:43.340 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:43 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:43.056+0000 7f6b94328200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T05:54:43.340 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:43 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:43.153+0000 7f6b94328200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T05:54:43.341 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:43 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:43.243+0000 7f6b94328200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T05:54:44.021 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:43 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:43.340+0000 7f6b94328200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T05:54:44.021 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:43 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:43.753+0000 7f6b94328200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T05:54:44.021 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:43 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:43.839+0000 7f6b94328200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T05:54:44.488 INFO:journalctl@ceph.mgr.a.smithi088.stdout:Jan 25 05:54:44 smithi088 ceph-8e1fe42c-9c74-11ed-9e56-001a4aab830c-mgr-a[102390]: 2023-01-25T05:54:44.020+0000 7f6b94328200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T05:54:45.464 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: Active manager daemon a restarted 2023-01-25T05:54:45.465 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: Activating manager daemon a 2023-01-25T05:54:45.465 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: osdmap e3: 0 total, 0 up, 0 in 2023-01-25T05:54:45.465 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: mgrmap e10: a(active, starting, since 0.0526878s) 2023-01-25T05:54:45.466 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-01-25T05:54:45.466 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2023-01-25T05:54:45.466 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-25T05:54:45.466 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-25T05:54:45.467 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-25T05:54:45.467 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: Manager daemon a is now available 2023-01-25T05:54:45.467 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-25T05:54:45.467 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-25T05:54:45.468 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2023-01-25T05:54:45.468 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:45 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2023-01-25T05:54:45.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout { 2023-01-25T05:54:45.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-01-25T05:54:45.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout "initialized": true 2023-01-25T05:54:45.771 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout } 2023-01-25T05:54:45.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.058+0000 7f1746569700 1 Processor -- start 2023-01-25T05:54:45.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.058+0000 7f1746569700 1 -- start start 2023-01-25T05:54:45.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.058+0000 7f1746569700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f1740103270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:45.772 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.058+0000 7f1746569700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17401037b0 con 0x7f1740102e60 2023-01-25T05:54:45.773 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.058+0000 7f173ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f1740103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:45.773 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.058+0000 7f173ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f1740103270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33308/0 (socket says 172.21.15.88:33308) 2023-01-25T05:54:45.773 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.058+0000 7f173ffff700 1 -- 172.21.15.88:0/3755238535 learned_addr learned my addr 172.21.15.88:0/3755238535 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:45.773 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.059+0000 7f173ffff700 1 -- 172.21.15.88:0/3755238535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17401038f0 con 0x7f1740102e60 2023-01-25T05:54:45.773 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.059+0000 7f173ffff700 1 --2- 172.21.15.88:0/3755238535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f1740103270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17300098a0 tx=0x7f1730009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c915a8133547ad3e server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:45.774 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.059+0000 7f173effd700 1 -- 172.21.15.88:0/3755238535 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1730004160 con 0x7f1740102e60 2023-01-25T05:54:45.774 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.059+0000 7f173effd700 1 -- 172.21.15.88:0/3755238535 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f17300042c0 con 0x7f1740102e60 2023-01-25T05:54:45.774 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.059+0000 7f173effd700 1 -- 172.21.15.88:0/3755238535 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1730011830 con 0x7f1740102e60 2023-01-25T05:54:45.774 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.060+0000 7f1746569700 1 -- 172.21.15.88:0/3755238535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 msgr2=0x7f1740103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:45.775 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.060+0000 7f1746569700 1 --2- 172.21.15.88:0/3755238535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f1740103270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17300098a0 tx=0x7f1730009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:45.775 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.060+0000 7f1746569700 1 -- 172.21.15.88:0/3755238535 shutdown_connections 2023-01-25T05:54:45.775 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.060+0000 7f1746569700 1 --2- 172.21.15.88:0/3755238535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f1740103270 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:45.775 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.060+0000 7f1746569700 1 -- 172.21.15.88:0/3755238535 >> 172.21.15.88:0/3755238535 conn(0x7f17400fe400 msgr2=0x7f1740100810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:45.775 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.060+0000 7f1746569700 1 -- 172.21.15.88:0/3755238535 shutdown_connections 2023-01-25T05:54:45.776 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.060+0000 7f1746569700 1 -- 172.21.15.88:0/3755238535 wait complete. 2023-01-25T05:54:45.776 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.060+0000 7f1746569700 1 Processor -- start 2023-01-25T05:54:45.776 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.060+0000 7f1746569700 1 -- start start 2023-01-25T05:54:45.776 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f1746569700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f17400735a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:45.776 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f1746569700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174019a700 con 0x7f1740102e60 2023-01-25T05:54:45.777 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f173ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f17400735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:45.777 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f173ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f17400735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33312/0 (socket says 172.21.15.88:33312) 2023-01-25T05:54:45.777 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f173ffff700 1 -- 172.21.15.88:0/2977058470 learned_addr learned my addr 172.21.15.88:0/2977058470 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:45.777 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f173ffff700 1 -- 172.21.15.88:0/2977058470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1730009550 con 0x7f1740102e60 2023-01-25T05:54:45.777 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f173ffff700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f17400735a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1730009290 tx=0x7f1730011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:45.778 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1730011e40 con 0x7f1740102e60 2023-01-25T05:54:45.778 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1730024440 con 0x7f1740102e60 2023-01-25T05:54:45.778 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f173001a430 con 0x7f1740102e60 2023-01-25T05:54:45.778 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f1746569700 1 -- 172.21.15.88:0/2977058470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1740104d90 con 0x7f1740102e60 2023-01-25T05:54:45.778 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.061+0000 7f1746569700 1 -- 172.21.15.88:0/2977058470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1740104c00 con 0x7f1740102e60 2023-01-25T05:54:45.779 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.062+0000 7f1746569700 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2023-01-25T05:54:45.779 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.062+0000 7f1746569700 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2023-01-25T05:54:45.779 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.062+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 43522+0+0 (secure 0 0 0) 0x7f1730017020 con 0x7f1740102e60 2023-01-25T05:54:45.779 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.062+0000 7f173d7fa700 20 mgrc handle_mgr_map mgrmap(e 9) v1 2023-01-25T05:54:45.780 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.063+0000 7f173d7fa700 4 mgrc handle_mgr_map Got map version 9 2023-01-25T05:54:45.780 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.063+0000 7f173d7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:45.780 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.063+0000 7f173d7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] 2023-01-25T05:54:45.780 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.063+0000 7f173d7fa700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 0x7f1728038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:45.781 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.063+0000 7f173d7fa700 10 mgrc reconnect resending 0 (tell) 2023-01-25T05:54:45.781 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.063+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 --> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17280393e0 con 0x7f1728036820 2023-01-25T05:54:45.781 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.063+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1730049e40 con 0x7f1740102e60 2023-01-25T05:54:45.781 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.063+0000 7f173f7fe700 1 -- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 msgr2=0x7f1728038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2989680299 2023-01-25T05:54:45.782 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.063+0000 7f173f7fe700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 0x7f1728038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-25T05:54:45.782 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.264+0000 7f173f7fe700 1 -- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 msgr2=0x7f1728038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2989680299 2023-01-25T05:54:45.782 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.264+0000 7f173f7fe700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 0x7f1728038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-25T05:54:45.782 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.665+0000 7f173f7fe700 1 -- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 msgr2=0x7f1728038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2989680299 2023-01-25T05:54:45.782 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:40.665+0000 7f173f7fe700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 0x7f1728038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-25T05:54:45.783 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:41.466+0000 7f173f7fe700 1 -- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 msgr2=0x7f1728038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2989680299 2023-01-25T05:54:45.783 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:41.466+0000 7f173f7fe700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 0x7f1728038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-25T05:54:45.783 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:43.067+0000 7f173f7fe700 1 -- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 msgr2=0x7f1728038cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:6800/2989680299 2023-01-25T05:54:45.783 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:43.067+0000 7f173f7fe700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 0x7f1728038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-01-25T05:54:45.783 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:44.086+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mgrmap(e 10) v1 ==== 43332+0+0 (secure 0 0 0) 0x7f173000f050 con 0x7f1740102e60 2023-01-25T05:54:45.784 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:44.086+0000 7f173d7fa700 20 mgrc handle_mgr_map mgrmap(e 10) v1 2023-01-25T05:54:45.784 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:44.086+0000 7f173d7fa700 4 mgrc handle_mgr_map Got map version 10 2023-01-25T05:54:45.784 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:44.086+0000 7f173d7fa700 4 mgrc handle_mgr_map Active mgr is now 2023-01-25T05:54:45.784 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:44.086+0000 7f173d7fa700 4 mgrc reconnect Terminating session with v2:172.21.15.88:6800/2989680299 2023-01-25T05:54:45.784 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:44.086+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 msgr2=0x7f1728038cd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-25T05:54:45.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:44.086+0000 7f173d7fa700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 0x7f1728038cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:45.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:44.086+0000 7f173d7fa700 4 mgrc reconnect No active mgr available yet 2023-01-25T05:54:45.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.090+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 11) v1 ==== 43442+0+0 (secure 0 0 0) 0x7f1730024920 con 0x7f1740102e60 2023-01-25T05:54:45.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.090+0000 7f173d7fa700 20 mgrc handle_mgr_map mgrmap(e 11) v1 2023-01-25T05:54:45.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.090+0000 7f173d7fa700 4 mgrc handle_mgr_map Got map version 11 2023-01-25T05:54:45.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.090+0000 7f173d7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:45.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.090+0000 7f173d7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:45.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.090+0000 7f173d7fa700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f172803a240 0x7f172803c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:45.786 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.090+0000 7f173d7fa700 10 mgrc reconnect resending 0 (tell) 2023-01-25T05:54:45.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.090+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 --> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17280393e0 con 0x7f172803a240 2023-01-25T05:54:45.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.091+0000 7f173f7fe700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f172803a240 0x7f172803c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:45.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.092+0000 7f173f7fe700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f172803a240 0x7f172803c620 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1734003a10 tx=0x7f17340092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:45.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.095+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 <== mgr.14152 v2:172.21.15.88:6800/1117401986 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f17280393e0 con 0x7f172803a240 2023-01-25T05:54:45.787 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.095+0000 7f173d7fa700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:45.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.103+0000 7f1746569700 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2023-01-25T05:54:45.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.103+0000 7f1746569700 1 -- 172.21.15.88:0/2977058470 --> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f1740073130 con 0x7f172803a240 2023-01-25T05:54:45.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.103+0000 7f173d7fa700 1 -- 172.21.15.88:0/2977058470 <== mgr.14152 v2:172.21.15.88:6800/1117401986 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f1740073130 con 0x7f172803a240 2023-01-25T05:54:45.788 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.103+0000 7f173d7fa700 20 mgrc handle_command_reply tid 1 r 0 2023-01-25T05:54:45.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 10 mgrc shutdown 2023-01-25T05:54:45.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 -- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f172803a240 msgr2=0x7f172803c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:45.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f172803a240 0x7f172803c620 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1734003a10 tx=0x7f17340092b0 comp rx=0 tx=0).stop 2023-01-25T05:54:45.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 -- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 msgr2=0x7f17400735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:45.789 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f17400735a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1730009290 tx=0x7f1730011910 comp rx=0 tx=0).stop 2023-01-25T05:54:45.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 -- 172.21.15.88:0/2977058470 shutdown_connections 2023-01-25T05:54:45.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f172803a240 0x7f172803c620 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:45.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1740102e60 0x7f17400735a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:45.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 --2- 172.21.15.88:0/2977058470 >> [v2:172.21.15.88:6800/2989680299,v1:172.21.15.88:6801/2989680299] conn(0x7f1728036820 0x7f1728038cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:45.790 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 -- 172.21.15.88:0/2977058470 >> 172.21.15.88:0/2977058470 conn(0x7f17400fe400 msgr2=0x7f17400ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:45.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 -- 172.21.15.88:0/2977058470 shutdown_connections 2023-01-25T05:54:45.791 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:45.104+0000 7f1746569700 1 -- 172.21.15.88:0/2977058470 wait complete. 2023-01-25T05:54:45.791 INFO:teuthology.orchestra.run.smithi088.stdout:mgr epoch 9 is available 2023-01-25T05:54:45.791 INFO:teuthology.orchestra.run.smithi088.stdout:Generating a dashboard self-signed certificate... 2023-01-25T05:54:46.488 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:46 smithi088 ceph-mon[102165]: mgrmap e11: a(active, since 1.05803s) 2023-01-25T05:54:46.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:46 smithi088 ceph-mon[102165]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-01-25T05:54:46.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:46 smithi088 ceph-mon[102165]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-01-25T05:54:46.489 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:46 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' 2023-01-25T05:54:47.605 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-01-25T05:54:47.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.255+0000 7fb8c2704700 1 Processor -- start 2023-01-25T05:54:47.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.255+0000 7fb8c2704700 1 -- start start 2023-01-25T05:54:47.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.255+0000 7fb8c2704700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:47.611 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.255+0000 7fb8c2704700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc077e80 con 0x7fb8bc1049e0 2023-01-25T05:54:47.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.255+0000 7fb8bbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:47.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.255+0000 7fb8bbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45384/0 (socket says 172.21.15.88:45384) 2023-01-25T05:54:47.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.255+0000 7fb8bbfff700 1 -- 172.21.15.88:0/3403629929 learned_addr learned my addr 172.21.15.88:0/3403629929 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:47.612 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.256+0000 7fb8bbfff700 1 -- 172.21.15.88:0/3403629929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc107300 con 0x7fb8bc1049e0 2023-01-25T05:54:47.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.256+0000 7fb8bbfff700 1 --2- 172.21.15.88:0/3403629929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc106dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0098a0 tx=0x7fb8ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432f4e3ca0b7a38 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:47.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.256+0000 7fb8bb7fe700 1 -- 172.21.15.88:0/3403629929 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8ac004160 con 0x7fb8bc1049e0 2023-01-25T05:54:47.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.256+0000 7fb8bb7fe700 1 -- 172.21.15.88:0/3403629929 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb8ac0042c0 con 0x7fb8bc1049e0 2023-01-25T05:54:47.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.256+0000 7fb8bb7fe700 1 -- 172.21.15.88:0/3403629929 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8ac011830 con 0x7fb8bc1049e0 2023-01-25T05:54:47.613 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.256+0000 7fb8c2704700 1 -- 172.21.15.88:0/3403629929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 msgr2=0x7fb8bc106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:47.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.256+0000 7fb8c2704700 1 --2- 172.21.15.88:0/3403629929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc106dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0098a0 tx=0x7fb8ac009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:47.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.257+0000 7fb8c2704700 1 -- 172.21.15.88:0/3403629929 shutdown_connections 2023-01-25T05:54:47.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.257+0000 7fb8c2704700 1 --2- 172.21.15.88:0/3403629929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc106dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:47.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.257+0000 7fb8c2704700 1 -- 172.21.15.88:0/3403629929 >> 172.21.15.88:0/3403629929 conn(0x7fb8bc0fe3c0 msgr2=0x7fb8bc1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:47.614 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.257+0000 7fb8c2704700 1 -- 172.21.15.88:0/3403629929 shutdown_connections 2023-01-25T05:54:47.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.257+0000 7fb8c2704700 1 -- 172.21.15.88:0/3403629929 wait complete. 2023-01-25T05:54:47.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.257+0000 7fb8c2704700 1 Processor -- start 2023-01-25T05:54:47.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.257+0000 7fb8c2704700 1 -- start start 2023-01-25T05:54:47.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.257+0000 7fb8c2704700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc104350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:47.615 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.257+0000 7fb8c2704700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc104890 con 0x7fb8bc1049e0 2023-01-25T05:54:47.616 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8bbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc104350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:47.616 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8bbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc104350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45392/0 (socket says 172.21.15.88:45392) 2023-01-25T05:54:47.616 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8bbfff700 1 -- 172.21.15.88:0/1290790442 learned_addr learned my addr 172.21.15.88:0/1290790442 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:47.616 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8bbfff700 1 -- 172.21.15.88:0/1290790442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac009550 con 0x7fb8bc1049e0 2023-01-25T05:54:47.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8bbfff700 1 --2- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc104350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac011860 tx=0x7fb8ac011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:47.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8b9ffb700 1 -- 172.21.15.88:0/1290790442 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8ac011e10 con 0x7fb8bc1049e0 2023-01-25T05:54:47.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8b9ffb700 1 -- 172.21.15.88:0/1290790442 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb8ac0038b0 con 0x7fb8bc1049e0 2023-01-25T05:54:47.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc1081b0 con 0x7fb8bc1049e0 2023-01-25T05:54:47.617 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8b9ffb700 1 -- 172.21.15.88:0/1290790442 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8ac01ae70 con 0x7fb8bc1049e0 2023-01-25T05:54:47.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.258+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc108020 con 0x7fb8bc1049e0 2023-01-25T05:54:47.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.259+0000 7fb8b9ffb700 1 -- 172.21.15.88:0/1290790442 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 11) v1 ==== 43442+0+0 (secure 0 0 0) 0x7fb8ac02a020 con 0x7fb8bc1049e0 2023-01-25T05:54:47.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.259+0000 7fb8b9ffb700 20 mgrc handle_mgr_map mgrmap(e 11) v1 2023-01-25T05:54:47.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.259+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc108340 con 0x7fb8bc1049e0 2023-01-25T05:54:47.618 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.259+0000 7fb8b9ffb700 4 mgrc handle_mgr_map Got map version 11 2023-01-25T05:54:47.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.259+0000 7fb8b9ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:47.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.259+0000 7fb8b9ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:47.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.259+0000 7fb8b9ffb700 1 --2- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fb8a80367e0 0x7fb8a8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:47.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.259+0000 7fb8b9ffb700 1 -- 172.21.15.88:0/1290790442 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb8ac049bf0 con 0x7fb8bc1049e0 2023-01-25T05:54:47.619 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.259+0000 7fb8b3fff700 1 --2- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fb8a80367e0 0x7fb8a8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:47.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.260+0000 7fb8b3fff700 1 --2- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fb8a80367e0 0x7fb8a8038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4006fd0 tx=0x7fb8a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:47.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.264+0000 7fb8b9ffb700 1 -- 172.21.15.88:0/1290790442 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7fb8ac018710 con 0x7fb8bc1049e0 2023-01-25T05:54:47.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.480+0000 7fb8c2704700 20 mgrc start_command cmd: [{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}] 2023-01-25T05:54:47.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.480+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 --> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8bc061b90 con 0x7fb8a80367e0 2023-01-25T05:54:47.620 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.603+0000 7fb8b9ffb700 1 -- 172.21.15.88:0/1290790442 <== mgr.14152 v2:172.21.15.88:6800/1117401986 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb8bc061b90 con 0x7fb8a80367e0 2023-01-25T05:54:47.621 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.603+0000 7fb8b9ffb700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:47.621 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 10 mgrc shutdown 2023-01-25T05:54:47.621 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fb8a80367e0 msgr2=0x7fb8a8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:47.621 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 --2- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fb8a80367e0 0x7fb8a8038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4006fd0 tx=0x7fb8a4006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:47.621 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 msgr2=0x7fb8bc104350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:47.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 --2- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc104350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac011860 tx=0x7fb8ac011940 comp rx=0 tx=0).stop 2023-01-25T05:54:47.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 shutdown_connections 2023-01-25T05:54:47.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 --2- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fb8a80367e0 0x7fb8a8038c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:47.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 --2- 172.21.15.88:0/1290790442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8bc1049e0 0x7fb8bc104350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:47.622 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 >> 172.21.15.88:0/1290790442 conn(0x7fb8bc0fe3c0 msgr2=0x7fb8bc0ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:47.623 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 shutdown_connections 2023-01-25T05:54:47.623 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:46.605+0000 7fb8c2704700 1 -- 172.21.15.88:0/1290790442 wait complete. 2023-01-25T05:54:47.623 INFO:teuthology.orchestra.run.smithi088.stdout:Creating initial admin user... 2023-01-25T05:54:47.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:47 smithi088 ceph-mon[102165]: [25/Jan/2023:05:54:46] ENGINE Bus STARTING 2023-01-25T05:54:47.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:47 smithi088 ceph-mon[102165]: [25/Jan/2023:05:54:46] ENGINE Serving on https://172.21.15.88:7150 2023-01-25T05:54:47.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:47 smithi088 ceph-mon[102165]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-01-25T05:54:47.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:47 smithi088 ceph-mon[102165]: [25/Jan/2023:05:54:46] ENGINE Serving on https://172.21.15.88:8765 2023-01-25T05:54:47.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:47 smithi088 ceph-mon[102165]: [25/Jan/2023:05:54:46] ENGINE Bus STARTED 2023-01-25T05:54:47.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:47 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' 2023-01-25T05:54:47.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:47 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' 2023-01-25T05:54:47.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:47 smithi088 ceph-mon[102165]: mgrmap e12: a(active, since 2s) 2023-01-25T05:54:47.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:47 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' 2023-01-25T05:54:49.051 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$wjmUTuWxYFSYCWly1Wjahu1QWchOUo2jEzXlHKoZnfXVdnTTbGlKC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1674626088, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-01-25T05:54:49.051 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.094+0000 7effac14e700 1 Processor -- start 2023-01-25T05:54:49.052 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.094+0000 7effac14e700 1 -- start start 2023-01-25T05:54:49.052 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.094+0000 7effac14e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa4103260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:49.052 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.094+0000 7effac14e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa41037a0 con 0x7effa4102e50 2023-01-25T05:54:49.052 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.094+0000 7effa9eea700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa4103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:49.053 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.094+0000 7effa9eea700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa4103260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45398/0 (socket says 172.21.15.88:45398) 2023-01-25T05:54:49.053 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.094+0000 7effa9eea700 1 -- 172.21.15.88:0/2076181234 learned_addr learned my addr 172.21.15.88:0/2076181234 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:49.053 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effa9eea700 1 -- 172.21.15.88:0/2076181234 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa41038e0 con 0x7effa4102e50 2023-01-25T05:54:49.054 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effa9eea700 1 --2- 172.21.15.88:0/2076181234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa4103260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effa00098a0 tx=0x7effa0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8100d54ab79c7b0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:49.054 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effa8ee8700 1 -- 172.21.15.88:0/2076181234 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effa0004160 con 0x7effa4102e50 2023-01-25T05:54:49.054 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effa8ee8700 1 -- 172.21.15.88:0/2076181234 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7effa00042c0 con 0x7effa4102e50 2023-01-25T05:54:49.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effa8ee8700 1 -- 172.21.15.88:0/2076181234 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effa0011830 con 0x7effa4102e50 2023-01-25T05:54:49.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effac14e700 1 -- 172.21.15.88:0/2076181234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 msgr2=0x7effa4103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:49.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effac14e700 1 --2- 172.21.15.88:0/2076181234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa4103260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effa00098a0 tx=0x7effa0009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:49.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effac14e700 1 -- 172.21.15.88:0/2076181234 shutdown_connections 2023-01-25T05:54:49.055 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effac14e700 1 --2- 172.21.15.88:0/2076181234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa4103260 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:49.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.095+0000 7effac14e700 1 -- 172.21.15.88:0/2076181234 >> 172.21.15.88:0/2076181234 conn(0x7effa40fe3b0 msgr2=0x7effa4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:49.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.096+0000 7effac14e700 1 -- 172.21.15.88:0/2076181234 shutdown_connections 2023-01-25T05:54:49.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.096+0000 7effac14e700 1 -- 172.21.15.88:0/2076181234 wait complete. 2023-01-25T05:54:49.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.096+0000 7effac14e700 1 Processor -- start 2023-01-25T05:54:49.056 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.096+0000 7effac14e700 1 -- start start 2023-01-25T05:54:49.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.096+0000 7effac14e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa418df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:49.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.096+0000 7effac14e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa418e4d0 con 0x7effa4102e50 2023-01-25T05:54:49.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.096+0000 7effa9eea700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa418df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:49.057 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.096+0000 7effa9eea700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa418df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45410/0 (socket says 172.21.15.88:45410) 2023-01-25T05:54:49.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.096+0000 7effa9eea700 1 -- 172.21.15.88:0/2115348080 learned_addr learned my addr 172.21.15.88:0/2115348080 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:49.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.097+0000 7effa9eea700 1 -- 172.21.15.88:0/2115348080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009550 con 0x7effa4102e50 2023-01-25T05:54:49.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.097+0000 7effa9eea700 1 --2- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa418df90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effa0009290 tx=0x7effa0011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:49.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.097+0000 7eff9affd700 1 -- 172.21.15.88:0/2115348080 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effa0011e40 con 0x7effa4102e50 2023-01-25T05:54:49.058 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.097+0000 7eff9affd700 1 -- 172.21.15.88:0/2115348080 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7effa0024440 con 0x7effa4102e50 2023-01-25T05:54:49.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.097+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa4104d80 con 0x7effa4102e50 2023-01-25T05:54:49.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.097+0000 7eff9affd700 1 -- 172.21.15.88:0/2115348080 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effa001a430 con 0x7effa4102e50 2023-01-25T05:54:49.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.097+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa4104bf0 con 0x7effa4102e50 2023-01-25T05:54:49.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7eff9affd700 1 -- 172.21.15.88:0/2115348080 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 12) v1 ==== 43522+0+0 (secure 0 0 0) 0x7effa0017020 con 0x7effa4102e50 2023-01-25T05:54:49.059 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7eff9affd700 20 mgrc handle_mgr_map mgrmap(e 12) v1 2023-01-25T05:54:49.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7eff9affd700 4 mgrc handle_mgr_map Got map version 12 2023-01-25T05:54:49.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7eff9affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:49.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7eff9affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:49.060 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7eff9affd700 1 --2- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7eff90036820 0x7eff90038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:49.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa4107260 con 0x7effa4102e50 2023-01-25T05:54:49.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7eff9affd700 1 -- 172.21.15.88:0/2115348080 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7effa0049ec0 con 0x7effa4102e50 2023-01-25T05:54:49.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7effa96e9700 1 --2- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7eff90036820 0x7eff90038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:49.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.098+0000 7effa96e9700 1 --2- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7eff90036820 0x7eff90038cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff94006fd0 tx=0x7eff94006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:49.061 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.103+0000 7eff9affd700 1 -- 172.21.15.88:0/2115348080 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7effa002d490 con 0x7effa4102e50 2023-01-25T05:54:49.062 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.321+0000 7effac14e700 20 mgrc start_command cmd: [{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}] 2023-01-25T05:54:49.062 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.321+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 --> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7effa40619b0 con 0x7eff90036820 2023-01-25T05:54:49.062 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.544+0000 7eff9affd700 1 -- 172.21.15.88:0/2115348080 <== mgr.14152 v2:172.21.15.88:6800/1117401986 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7effa40619b0 con 0x7eff90036820 2023-01-25T05:54:49.062 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.544+0000 7eff9affd700 20 mgrc handle_command_reply tid 0 r 0 2023-01-25T05:54:49.062 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.546+0000 7effac14e700 10 mgrc shutdown 2023-01-25T05:54:49.063 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.546+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7eff90036820 msgr2=0x7eff90038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:49.063 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.546+0000 7effac14e700 1 --2- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7eff90036820 0x7eff90038cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff94006fd0 tx=0x7eff94006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:49.063 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.546+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 msgr2=0x7effa418df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:49.063 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.546+0000 7effac14e700 1 --2- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa418df90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effa0009290 tx=0x7effa0011910 comp rx=0 tx=0).stop 2023-01-25T05:54:49.063 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.546+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 shutdown_connections 2023-01-25T05:54:49.064 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.546+0000 7effac14e700 1 --2- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7eff90036820 0x7eff90038cd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:49.064 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.546+0000 7effac14e700 1 --2- 172.21.15.88:0/2115348080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effa4102e50 0x7effa418df90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:49.064 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.546+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 >> 172.21.15.88:0/2115348080 conn(0x7effa40fe3b0 msgr2=0x7effa40778c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:49.064 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.547+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 shutdown_connections 2023-01-25T05:54:49.064 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:48.547+0000 7effac14e700 1 -- 172.21.15.88:0/2115348080 wait complete. 2023-01-25T05:54:49.065 INFO:teuthology.orchestra.run.smithi088.stdout:Fetching dashboard port number... 2023-01-25T05:54:49.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:49 smithi088 ceph-mon[102165]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-01-25T05:54:49.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:49 smithi088 ceph-mon[102165]: from='mgr.14152 172.21.15.88:0/2582955863' entity='mgr.a' 2023-01-25T05:54:50.087 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stdout 8443 2023-01-25T05:54:50.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.408+0000 7f20bfa43700 1 Processor -- start 2023-01-25T05:54:50.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.408+0000 7f20bfa43700 1 -- start start 2023-01-25T05:54:50.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.408+0000 7f20bfa43700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8106e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:50.088 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.408+0000 7f20bfa43700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b8073790 con 0x7f20b8104a20 2023-01-25T05:54:50.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.409+0000 7f20bd7df700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:50.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.409+0000 7f20bd7df700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45412/0 (socket says 172.21.15.88:45412) 2023-01-25T05:54:50.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.409+0000 7f20bd7df700 1 -- 172.21.15.88:0/1003067960 learned_addr learned my addr 172.21.15.88:0/1003067960 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:50.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.409+0000 7f20bd7df700 1 -- 172.21.15.88:0/1003067960 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80738d0 con 0x7f20b8104a20 2023-01-25T05:54:50.089 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.409+0000 7f20bd7df700 1 --2- 172.21.15.88:0/1003067960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8106e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20b40098a0 tx=0x7f20b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4b5092ac03a5f1 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:50.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.409+0000 7f20affff700 1 -- 172.21.15.88:0/1003067960 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20b4004160 con 0x7f20b8104a20 2023-01-25T05:54:50.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.409+0000 7f20affff700 1 -- 172.21.15.88:0/1003067960 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f20b40042c0 con 0x7f20b8104a20 2023-01-25T05:54:50.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.409+0000 7f20affff700 1 -- 172.21.15.88:0/1003067960 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20b4011830 con 0x7f20b8104a20 2023-01-25T05:54:50.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.410+0000 7f20bfa43700 1 -- 172.21.15.88:0/1003067960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 msgr2=0x7f20b8106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:50.090 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.410+0000 7f20bfa43700 1 --2- 172.21.15.88:0/1003067960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8106e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20b40098a0 tx=0x7f20b4009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:50.091 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.410+0000 7f20bfa43700 1 -- 172.21.15.88:0/1003067960 shutdown_connections 2023-01-25T05:54:50.091 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.410+0000 7f20bfa43700 1 --2- 172.21.15.88:0/1003067960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8106e00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:50.091 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.410+0000 7f20bfa43700 1 -- 172.21.15.88:0/1003067960 >> 172.21.15.88:0/1003067960 conn(0x7f20b80fe400 msgr2=0x7f20b8100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:50.091 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.410+0000 7f20bfa43700 1 -- 172.21.15.88:0/1003067960 shutdown_connections 2023-01-25T05:54:50.091 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.410+0000 7f20bfa43700 1 -- 172.21.15.88:0/1003067960 wait complete. 2023-01-25T05:54:50.092 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.410+0000 7f20bfa43700 1 Processor -- start 2023-01-25T05:54:50.092 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.410+0000 7f20bfa43700 1 -- start start 2023-01-25T05:54:50.092 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20bfa43700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8104390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:50.092 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20bfa43700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b81048d0 con 0x7f20b8104a20 2023-01-25T05:54:50.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20bd7df700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8104390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:50.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20bd7df700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8104390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45416/0 (socket says 172.21.15.88:45416) 2023-01-25T05:54:50.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20bd7df700 1 -- 172.21.15.88:0/3887111722 learned_addr learned my addr 172.21.15.88:0/3887111722 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:50.093 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20bd7df700 1 -- 172.21.15.88:0/3887111722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4009550 con 0x7f20b8104a20 2023-01-25T05:54:50.094 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20bd7df700 1 --2- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8104390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20b4006ba0 tx=0x7f20b4011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:50.094 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20ae7fc700 1 -- 172.21.15.88:0/3887111722 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20b4011e40 con 0x7f20b8104a20 2023-01-25T05:54:50.094 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20ae7fc700 1 -- 172.21.15.88:0/3887111722 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f20b401a430 con 0x7f20b8104a20 2023-01-25T05:54:50.094 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b8108120 con 0x7f20b8104a20 2023-01-25T05:54:50.095 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20ae7fc700 1 -- 172.21.15.88:0/3887111722 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20b40193c0 con 0x7f20b8104a20 2023-01-25T05:54:50.095 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.411+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b8107f90 con 0x7f20b8104a20 2023-01-25T05:54:50.095 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.412+0000 7f20ae7fc700 1 -- 172.21.15.88:0/3887111722 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 12) v1 ==== 43522+0+0 (secure 0 0 0) 0x7f20b402a020 con 0x7f20b8104a20 2023-01-25T05:54:50.095 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.412+0000 7f20ae7fc700 20 mgrc handle_mgr_map mgrmap(e 12) v1 2023-01-25T05:54:50.095 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.412+0000 7f20ae7fc700 4 mgrc handle_mgr_map Got map version 12 2023-01-25T05:54:50.095 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.412+0000 7f20ae7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:50.096 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.412+0000 7f20ae7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:50.096 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.412+0000 7f20ae7fc700 1 --2- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f20a4036800 0x7f20a4038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:50.096 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.412+0000 7f20ae7fc700 1 -- 172.21.15.88:0/3887111722 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f20b4049b80 con 0x7f20b8104a20 2023-01-25T05:54:50.096 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.412+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b81082b0 con 0x7f20b8104a20 2023-01-25T05:54:50.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.412+0000 7f20bcfde700 1 --2- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f20a4036800 0x7f20a4038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:50.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.413+0000 7f20bcfde700 1 --2- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f20a4036800 0x7f20a4038cb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006fd0 tx=0x7f20a8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:50.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.417+0000 7f20ae7fc700 1 -- 172.21.15.88:0/3887111722 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7f20b401a8d0 con 0x7f20b8104a20 2023-01-25T05:54:50.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.605+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f20b8061b90 con 0x7f20b8104a20 2023-01-25T05:54:50.097 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.605+0000 7f20ae7fc700 1 -- 172.21.15.88:0/3887111722 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f20b4023b80 con 0x7f20b8104a20 2023-01-25T05:54:50.098 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.607+0000 7f20bfa43700 10 mgrc shutdown 2023-01-25T05:54:50.098 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.607+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f20a4036800 msgr2=0x7f20a4038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:50.098 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.607+0000 7f20bfa43700 1 --2- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f20a4036800 0x7f20a4038cb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006fd0 tx=0x7f20a8006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:50.098 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.607+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 msgr2=0x7f20b8104390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:50.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.607+0000 7f20bfa43700 1 --2- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8104390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20b4006ba0 tx=0x7f20b4011910 comp rx=0 tx=0).stop 2023-01-25T05:54:50.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.608+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 shutdown_connections 2023-01-25T05:54:50.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.608+0000 7f20bfa43700 1 --2- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7f20a4036800 0x7f20a4038cb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:50.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.608+0000 7f20bfa43700 1 --2- 172.21.15.88:0/3887111722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b8104a20 0x7f20b8104390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:50.099 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.608+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 >> 172.21.15.88:0/3887111722 conn(0x7f20b80fe400 msgr2=0x7f20b80ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:50.100 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.608+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 shutdown_connections 2023-01-25T05:54:50.100 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:49.608+0000 7f20bfa43700 1 -- 172.21.15.88:0/3887111722 wait complete. 2023-01-25T05:54:50.101 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-01-25T05:54:50.101 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout disabled 2023-01-25T05:54:50.102 INFO:teuthology.orchestra.run.smithi088.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-01-25T05:54:50.102 INFO:teuthology.orchestra.run.smithi088.stdout:systemctl: stdout inactive 2023-01-25T05:54:50.102 INFO:teuthology.orchestra.run.smithi088.stdout:firewalld.service is not enabled 2023-01-25T05:54:50.102 INFO:teuthology.orchestra.run.smithi088.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-01-25T05:54:50.104 INFO:teuthology.orchestra.run.smithi088.stdout:Ceph Dashboard is now available at: 2023-01-25T05:54:50.104 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:54:50.104 INFO:teuthology.orchestra.run.smithi088.stdout: URL: https://smithi088.front.sepia.ceph.com:8443/ 2023-01-25T05:54:50.104 INFO:teuthology.orchestra.run.smithi088.stdout: User: admin 2023-01-25T05:54:50.105 INFO:teuthology.orchestra.run.smithi088.stdout: Password: br2mp7f31a 2023-01-25T05:54:50.105 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-01-25T05:54:50.105 INFO:teuthology.orchestra.run.smithi088.stdout:Saving cluster configuration to /var/lib/ceph/8e1fe42c-9c74-11ed-9e56-001a4aab830c/config directory 2023-01-25T05:54:50.105 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling autotune for osd_memory_target 2023-01-25T05:54:50.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:50 smithi088 ceph-mon[102165]: from='client.? 172.21.15.88:0/3887111722' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-01-25T05:54:51.245 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.559+0000 7fd5983e7700 1 Processor -- start 2023-01-25T05:54:51.245 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.559+0000 7fd5983e7700 1 -- start start 2023-01-25T05:54:51.245 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.559+0000 7fd5983e7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590106e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:51.246 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.559+0000 7fd5983e7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590073790 con 0x7fd590104a20 2023-01-25T05:54:51.246 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.560+0000 7fd596183700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:51.246 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.560+0000 7fd596183700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45420/0 (socket says 172.21.15.88:45420) 2023-01-25T05:54:51.246 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.560+0000 7fd596183700 1 -- 172.21.15.88:0/465951917 learned_addr learned my addr 172.21.15.88:0/465951917 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:51.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.560+0000 7fd596183700 1 -- 172.21.15.88:0/465951917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900738d0 con 0x7fd590104a20 2023-01-25T05:54:51.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.560+0000 7fd596183700 1 --2- 172.21.15.88:0/465951917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590106e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0098a0 tx=0x7fd58c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3d6d434eae9163 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:51.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.560+0000 7fd595181700 1 -- 172.21.15.88:0/465951917 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd58c004160 con 0x7fd590104a20 2023-01-25T05:54:51.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.560+0000 7fd595181700 1 -- 172.21.15.88:0/465951917 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd58c0042c0 con 0x7fd590104a20 2023-01-25T05:54:51.247 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.560+0000 7fd595181700 1 -- 172.21.15.88:0/465951917 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd58c011830 con 0x7fd590104a20 2023-01-25T05:54:51.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.561+0000 7fd5983e7700 1 -- 172.21.15.88:0/465951917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 msgr2=0x7fd590106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:51.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.561+0000 7fd5983e7700 1 --2- 172.21.15.88:0/465951917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590106e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0098a0 tx=0x7fd58c009bb0 comp rx=0 tx=0).stop 2023-01-25T05:54:51.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.561+0000 7fd5983e7700 1 -- 172.21.15.88:0/465951917 shutdown_connections 2023-01-25T05:54:51.248 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.561+0000 7fd5983e7700 1 --2- 172.21.15.88:0/465951917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590106e00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:51.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.561+0000 7fd5983e7700 1 -- 172.21.15.88:0/465951917 >> 172.21.15.88:0/465951917 conn(0x7fd5900fe400 msgr2=0x7fd590100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:51.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.561+0000 7fd5983e7700 1 -- 172.21.15.88:0/465951917 shutdown_connections 2023-01-25T05:54:51.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.561+0000 7fd5983e7700 1 -- 172.21.15.88:0/465951917 wait complete. 2023-01-25T05:54:51.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.561+0000 7fd5983e7700 1 Processor -- start 2023-01-25T05:54:51.249 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.561+0000 7fd5983e7700 1 -- start start 2023-01-25T05:54:51.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd5983e7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:51.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd5983e7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590198070 con 0x7fd590104a20 2023-01-25T05:54:51.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd596183700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:51.250 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd596183700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45424/0 (socket says 172.21.15.88:45424) 2023-01-25T05:54:51.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd596183700 1 -- 172.21.15.88:0/3327116164 learned_addr learned my addr 172.21.15.88:0/3327116164 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:51.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd596183700 1 -- 172.21.15.88:0/3327116164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c009550 con 0x7fd590104a20 2023-01-25T05:54:51.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd596183700 1 --2- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590197b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd58c011860 tx=0x7fd58c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:51.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd5877fe700 1 -- 172.21.15.88:0/3327116164 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd58c0037d0 con 0x7fd590104a20 2023-01-25T05:54:51.251 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd5877fe700 1 -- 172.21.15.88:0/3327116164 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(24 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd58c003930 con 0x7fd590104a20 2023-01-25T05:54:51.252 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd590108120 con 0x7fd590104a20 2023-01-25T05:54:51.252 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd5877fe700 1 -- 172.21.15.88:0/3327116164 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd58c024410 con 0x7fd590104a20 2023-01-25T05:54:51.252 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.562+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd590107f90 con 0x7fd590104a20 2023-01-25T05:54:51.252 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.563+0000 7fd5877fe700 1 -- 172.21.15.88:0/3327116164 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) v1 ==== 43565+0+0 (secure 0 0 0) 0x7fd58c017020 con 0x7fd590104a20 2023-01-25T05:54:51.252 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.563+0000 7fd5877fe700 20 mgrc handle_mgr_map mgrmap(e 13) v1 2023-01-25T05:54:51.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.563+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5901082b0 con 0x7fd590104a20 2023-01-25T05:54:51.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.563+0000 7fd5877fe700 4 mgrc handle_mgr_map Got map version 13 2023-01-25T05:54:51.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.563+0000 7fd5877fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:51.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.563+0000 7fd5877fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] 2023-01-25T05:54:51.253 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.563+0000 7fd5877fe700 1 --2- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fd57c036910 0x7fd57c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:51.254 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.563+0000 7fd5877fe700 1 -- 172.21.15.88:0/3327116164 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd58c049ce0 con 0x7fd590104a20 2023-01-25T05:54:51.254 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.563+0000 7fd595982700 1 --2- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fd57c036910 0x7fd57c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:51.254 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.564+0000 7fd595982700 1 --2- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fd57c036910 0x7fd57c038dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd580006fd0 tx=0x7fd580006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:51.254 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.568+0000 7fd5877fe700 1 -- 172.21.15.88:0/3327116164 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173756 (secure 0 0 0) 0x7fd58c003aa0 con 0x7fd590104a20 2023-01-25T05:54:51.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.757+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fd590061b90 con 0x7fd590104a20 2023-01-25T05:54:51.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.757+0000 7fd5877fe700 1 -- 172.21.15.88:0/3327116164 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fd58c018350 con 0x7fd590104a20 2023-01-25T05:54:51.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.759+0000 7fd5983e7700 10 mgrc shutdown 2023-01-25T05:54:51.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.759+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fd57c036910 msgr2=0x7fd57c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:51.255 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.759+0000 7fd5983e7700 1 --2- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fd57c036910 0x7fd57c038dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd580006fd0 tx=0x7fd580006e40 comp rx=0 tx=0).stop 2023-01-25T05:54:51.256 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.759+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 msgr2=0x7fd590197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-25T05:54:51.256 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.759+0000 7fd5983e7700 1 --2- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590197b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd58c011860 tx=0x7fd58c011940 comp rx=0 tx=0).stop 2023-01-25T05:54:51.256 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.760+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 shutdown_connections 2023-01-25T05:54:51.256 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.760+0000 7fd5983e7700 1 --2- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:6800/1117401986,v1:172.21.15.88:6801/1117401986] conn(0x7fd57c036910 0x7fd57c038dc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:51.257 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.760+0000 7fd5983e7700 1 --2- 172.21.15.88:0/3327116164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd590104a20 0x7fd590197b30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-25T05:54:51.257 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.760+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 >> 172.21.15.88:0/3327116164 conn(0x7fd5900fe400 msgr2=0x7fd5900ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-25T05:54:51.257 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.760+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 shutdown_connections 2023-01-25T05:54:51.257 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:50.760+0000 7fd5983e7700 1 -- 172.21.15.88:0/3327116164 wait complete. 2023-01-25T05:54:51.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:Jan 25 05:54:51 smithi088 ceph-mon[102165]: mgrmap e13: a(active, since 6s) 2023-01-25T05:54:52.384 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.637+0000 7f8d2b789700 1 Processor -- start 2023-01-25T05:54:52.384 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.637+0000 7f8d2b789700 1 -- start start 2023-01-25T05:54:52.384 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.637+0000 7f8d2b789700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d24104440 0x7f8d24104850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-25T05:54:52.385 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.637+0000 7f8d2b789700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24104e20 con 0x7f8d24104440 2023-01-25T05:54:52.385 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.638+0000 7f8d29525700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d24104440 0x7f8d24104850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-25T05:54:52.385 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.638+0000 7f8d29525700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d24104440 0x7f8d24104850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45434/0 (socket says 172.21.15.88:45434) 2023-01-25T05:54:52.385 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.638+0000 7f8d29525700 1 -- 172.21.15.88:0/661694892 learned_addr learned my addr 172.21.15.88:0/661694892 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-01-25T05:54:52.386 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.638+0000 7f8d29525700 1 -- 172.21.15.88:0/661694892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d24104f60 con 0x7f8d24104440 2023-01-25T05:54:52.386 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.638+0000 7f8d29525700 1 --2- 172.21.15.88:0/661694892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d24104440 0x7f8d24104850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009e80 tx=0x7f8d2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7951dc6bf5aee8f server_cookie=0 in_seq=0 out_seq=0 2023-01-25T05:54:52.386 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/ceph: stderr 2023-01-25T05:54:51.638+0000 7f8d1bfff700 1 -- 172.21.1