2020-11-20T13:45:51.065 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-20T13:45:51.067 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --block --lock --name teuthology-2020-11-16_04:10:02-fs-octopus-distro-basic-smithi --archive /home/teuthworker/archive/teuthology-2020-11-16_04:10:02-fs-octopus-distro-basic-smithi/5628499 --owner scheduled_teuthology@teuthology --description fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_latest} tasks/cfuse_workunit_norstats} -- /tmp/teuthology-worker.ucp9zmkl.tmp 2020-11-20T13:45:51.103 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T13:45:51.165 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2020-11-16_04:10:02-fs-octopus-distro-basic-smithi/5628499 branch: octopus description: fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_latest} tasks/cfuse_workunit_norstats} email: ceph-qa@ceph.io first_in_suite: false job_id: '5628499' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2020-11-16_04:10:02-fs-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: octopus ceph: cephfs: session_timeout: 300 conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd objectstore: filestore osd op complaint time: 180 osd sloppy crc: true osd_max_omap_entries_per_request: 10 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a7b62340ad27b26642bb54ec916a97c7e1f07a34 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: a7b62340ad27b26642bb54ec916a97c7e1f07a34 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: octopus sha1: a7b62340ad27b26642bb54ec916a97c7e1f07a34 owner: scheduled_teuthology@teuthology priority: 1000 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: a7b62340ad27b26642bb54ec916a97c7e1f07a34 sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph_octopus/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: a7b62340ad27b26642bb54ec916a97c7e1f07a34 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - check-counter: counters: mds: - mds.dir_split - workunit: clients: all: - fs/norstats teuthology_branch: master timestamp: 2020-11-16_04:10:02 tube: smithi user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.3628 2020-11-20T13:45:51.166 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_octopus/qa; will attempt to use it 2020-11-20T13:45:51.166 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks 2020-11-20T13:45:51.167 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-20T13:45:51.168 INFO:teuthology.task.internal:Checking packages... 2020-11-20T13:45:51.188 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'a7b62340ad27b26642bb54ec916a97c7e1f07a34' 2020-11-20T13:45:51.188 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-20T13:45:51.188 INFO:teuthology.packaging:ref: None 2020-11-20T13:45:51.189 INFO:teuthology.packaging:tag: None 2020-11-20T13:45:51.189 INFO:teuthology.packaging:branch: octopus 2020-11-20T13:45:51.189 INFO:teuthology.packaging:sha1: a7b62340ad27b26642bb54ec916a97c7e1f07a34 2020-11-20T13:45:51.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2020-11-20T13:45:51.442 INFO:teuthology.task.internal:Found packages for ceph version 15.2.6-589.g08106742 2020-11-20T13:45:51.442 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-20T13:45:51.456 INFO:teuthology.task.internal:no buildpackages task found 2020-11-20T13:45:51.457 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-20T13:45:51.474 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-20T13:45:51.474 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T13:45:51.539 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T13:46:01.558 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T13:46:11.575 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_teuthology@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/teuthology-2020-11-16_04:10:02-fs-octopus-distro-basic-smithi/5628499'} 2020-11-20T13:46:11.603 DEBUG:teuthology.lock.ops:locked ubuntu@smithi039.front.sepia.ceph.com, ubuntu@smithi031.front.sepia.ceph.com 2020-11-20T13:46:11.658 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe4267a77b8>, signals=[15]) 2020-11-20T13:46:11.899 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 8.1 2020-11-20T13:46:11.902 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 8.1 2020-11-20T13:46:13.344 INFO:teuthology.orchestra.console:Power off smithi031 2020-11-20T13:46:13.345 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T13:46:13.356 INFO:teuthology.orchestra.console:Power off smithi039 2020-11-20T13:46:13.357 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T13:46:13.365 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T13:46:13.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T13:46:13.485 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2020-11-20T13:46:13.495 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2020-11-20T13:46:13.587 INFO:teuthology.orchestra.console:Power on smithi031 2020-11-20T13:46:13.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T13:46:13.595 INFO:teuthology.orchestra.console:Power on smithi039 2020-11-20T13:46:13.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T13:46:13.607 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T13:46:13.615 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T13:46:17.630 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T13:46:17.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T13:46:17.841 INFO:teuthology.orchestra.console:Power on for smithi031 completed 2020-11-20T13:46:17.847 INFO:teuthology.orchestra.console:Power on for smithi039 completed 2020-11-20T13:46:17.942 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2020-11-20T13:46:17.948 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2020-11-20T13:49:23.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:49:24.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:49:33.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:49:33.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:49:42.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:49:42.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:49:51.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:49:51.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:50:00.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:50:00.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:50:09.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:50:18.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:50:27.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:50:36.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:50:52.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:51:01.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:51:06.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:51:06.555 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T13:51:06.557 INFO:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T13:51:06.887 INFO:teuthology.provision.fog.smithi031:Node is ready 2020-11-20T13:51:06.887 INFO:teuthology.orchestra.run.smithi031:> hostname 2020-11-20T13:51:06.902 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2020-11-20T13:51:06.902 INFO:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2020-11-20T13:51:06.957 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2020-11-20T13:51:06.957 INFO:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2020-11-20T13:51:07.057 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2020-11-20T13:51:07.089 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2020-11-20T13:51:07.160 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2020-11-20T13:51:07.231 INFO:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2020-11-20T13:51:07.301 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2020-11-20T13:51:07.302 DEBUG:teuthology.parallel:result is None 2020-11-20T13:51:10.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:51:11.111 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T13:51:11.112 INFO:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T13:51:21.475 INFO:teuthology.provision.fog.smithi039:Node is ready 2020-11-20T13:51:21.476 INFO:teuthology.orchestra.run.smithi039:> hostname 2020-11-20T13:51:21.535 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2020-11-20T13:51:21.535 INFO:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2020-11-20T13:51:21.591 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2020-11-20T13:51:21.592 INFO:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2020-11-20T13:51:21.741 INFO:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2020-11-20T13:51:21.776 INFO:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2020-11-20T13:51:21.848 INFO:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2020-11-20T13:51:21.922 INFO:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2020-11-20T13:51:21.993 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2020-11-20T13:51:21.994 DEBUG:teuthology.parallel:result is None 2020-11-20T13:51:22.124 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2020-11-20T13:51:22.125 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T13:51:22.141 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2020-11-20T13:51:22.141 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T13:51:22.157 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2020-11-20T13:51:22.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T13:51:22.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:51:22.229 INFO:teuthology.orchestra.run.smithi039:> true 2020-11-20T13:51:22.313 INFO:teuthology.orchestra.run.smithi039:> uname -m 2020-11-20T13:51:22.369 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2020-11-20T13:51:22.369 INFO:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2020-11-20T13:51:22.423 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Linux" 2020-11-20T13:51:22.423 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8 (Core)" 2020-11-20T13:51:22.424 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2020-11-20T13:51:22.424 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2020-11-20T13:51:22.424 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8" 2020-11-20T13:51:22.424 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2020-11-20T13:51:22.425 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T13:51:22.425 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2020-11-20T13:51:22.425 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T13:51:22.425 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T13:51:22.425 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T13:51:22.426 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:51:22.426 INFO:teuthology.orchestra.run.smithi039.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T13:51:22.426 INFO:teuthology.orchestra.run.smithi039.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T13:51:22.426 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T13:51:22.426 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T13:51:22.427 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:51:22.428 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2020-11-20T13:51:22.442 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2020-11-20T13:51:22.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T13:51:22.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:51:22.513 INFO:teuthology.orchestra.run.smithi031:> true 2020-11-20T13:51:22.695 INFO:teuthology.orchestra.run.smithi031:> uname -m 2020-11-20T13:51:22.749 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2020-11-20T13:51:22.750 INFO:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2020-11-20T13:51:22.804 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Linux" 2020-11-20T13:51:22.804 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8 (Core)" 2020-11-20T13:51:22.804 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2020-11-20T13:51:22.804 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2020-11-20T13:51:22.805 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2020-11-20T13:51:22.805 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2020-11-20T13:51:22.805 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T13:51:22.805 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2020-11-20T13:51:22.805 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T13:51:22.806 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T13:51:22.806 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T13:51:22.806 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:51:22.806 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T13:51:22.806 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T13:51:22.807 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T13:51:22.807 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T13:51:22.807 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:51:22.808 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2020-11-20T13:51:22.824 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-11-20T13:51:22.860 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCZIraucxohIm3ZlT1bl7mJS49K9g1stkOSKl7Q+EGd7IkRFLrDRG/7G0NFGmnyOAUJsKVmlYGbMRiyfj98IUiA9vpFYacWp5lvIImhrtnjR6a6UkjUge2LaDP0HUmO7UKcI/BgJgW4LvBAP6E6nDd4evJKMeX1UruNdQLh4fxYZewBXwpljIL0DEZpBZokokGE3/KAlQ540yxjlRs7SU6Tq9Cw+BdatLxuRTHCa4IPFYAzyp7q03u37H8UHvm7IBanyEyua7qcRNxCsldRf8q1q0DxCo92VYIxNdQWZ1BKeOpeeQfV0HjUxVHjLSbXDIfRhO/9btmXTeoVvaHt9jcuALGRG9zDaTRgIEJPQsW4rdFFliF+ZZm23oF/DLZUZseC5YCDY0AJzHTBGxRDxU0AUpFKUyY0/5STBG8SeMKEPOspP096E7/2/KPpdoFxUe9v2p02ViP0WX5MWlJrzAkYTM1PKOB+I5yRgvTNoSNAQBR3apwsQhNG0jsulf6djc= smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDQAGWpxbo7DDT1AmqSJmG87Qjh6bgyUOibwWsvtKPDXf0ZQjZ5/Tm5zl8lx4dILf7lVTvaoyULrvFZbMnxe5wWq+O06OABqf6ipUxTDqg1Cd1X+xjCM1IyNDBmReTpQHtgnmGFx1ZWyNuikkZI7md/+iK45uP8XThMtT2WECsWUVILSEfXIOtLxkE+ipmbx8W5aUw1oVvTTkM2kPC40q6VujqSeURGFe4/tUaMljELkO9A3XpzZTZ9x/EkKEk0r5YHPx8f+6BHXxs4GCbS+80ovh/K9hE3j6PY5nKbYB3SdYhvTU93LdJU6aLvOjh8k90A6yYGUeKrSaBOEJvZM4ejI/SWG96z5LQH5F0nP/fkG1symo/gFE5UW+2UI+qIMyGR1r1LIoPONT6/bZRBFNRO6nY80xIffwlFZWbyOFFRy4fwASiWOIKPvEWlH+FsG/3t6+Hp2l8rPsUTxmQEsyELQsV1T0HNd5YtzPsCe8Z2s7dk+OgR7s6fl6kBbC6+fc= 2020-11-20T13:51:22.861 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T13:51:22.915 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-20T13:51:22.923 INFO:teuthology.task.internal:Saving configuration 2020-11-20T13:51:22.938 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-20T13:51:22.948 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-20T13:51:22.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 13:46:11.590534', 'description': '/home/teuthworker/archive/teuthology-2020-11-16_04:10:02-fs-octopus-distro-basic-smithi/5628499', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCC4Nf47qpRsrIaCtlQgWtKpSYxOvioqM3Q/HziVIvHA5Ei6m9sF7DGej0jmacElmloIl7xTVu05g6EIV3ZFqF4=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi039.front.sepia.ceph.com'} 2020-11-20T13:51:22.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 13:46:11.590556', 'description': '/home/teuthworker/archive/teuthology-2020-11-16_04:10:02-fs-octopus-distro-basic-smithi/5628499', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB3uiGL3xxxHe6V45cZDokdJdZrGrYSt3oFzkafozSxFtSsXjecvEjx4rFBTB6tubMkaPQtA8AuRNwFidUqcnIA=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi031.front.sepia.ceph.com'} 2020-11-20T13:51:22.981 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-20T13:51:22.991 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-11-20T13:51:22.991 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-11-20T13:51:22.992 INFO:teuthology.run_tasks:Running task console_log... 2020-11-20T13:51:23.051 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe42674e7b8>, signals=[15]) 2020-11-20T13:51:23.052 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-20T13:51:23.062 INFO:teuthology.task.internal:Opening connections... 2020-11-20T13:51:23.063 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2020-11-20T13:51:23.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:51:23.138 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2020-11-20T13:51:23.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:51:23.211 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-20T13:51:23.218 INFO:teuthology.orchestra.run.smithi039:> uname -m 2020-11-20T13:51:23.236 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2020-11-20T13:51:23.237 INFO:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2020-11-20T13:51:23.292 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Linux" 2020-11-20T13:51:23.293 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8 (Core)" 2020-11-20T13:51:23.293 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2020-11-20T13:51:23.293 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2020-11-20T13:51:23.294 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8" 2020-11-20T13:51:23.294 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2020-11-20T13:51:23.294 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T13:51:23.295 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2020-11-20T13:51:23.295 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T13:51:23.295 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T13:51:23.296 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T13:51:23.296 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:51:23.296 INFO:teuthology.orchestra.run.smithi039.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T13:51:23.297 INFO:teuthology.orchestra.run.smithi039.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T13:51:23.297 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T13:51:23.297 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T13:51:23.298 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:51:23.298 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2020-11-20T13:51:23.313 INFO:teuthology.orchestra.run.smithi031:> uname -m 2020-11-20T13:51:23.342 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2020-11-20T13:51:23.342 INFO:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2020-11-20T13:51:23.395 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Linux" 2020-11-20T13:51:23.395 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8 (Core)" 2020-11-20T13:51:23.396 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2020-11-20T13:51:23.396 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2020-11-20T13:51:23.396 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2020-11-20T13:51:23.396 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2020-11-20T13:51:23.396 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T13:51:23.396 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2020-11-20T13:51:23.397 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T13:51:23.397 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T13:51:23.397 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T13:51:23.397 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:51:23.397 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T13:51:23.398 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T13:51:23.398 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T13:51:23.398 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T13:51:23.398 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:51:23.399 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2020-11-20T13:51:23.415 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-20T13:51:23.424 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-20T13:51:23.432 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-20T13:51:23.432 INFO:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2020-11-20T13:51:23.437 INFO:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2020-11-20T13:51:23.454 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-20T13:51:23.460 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-20T13:51:23.461 INFO:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2020-11-20T13:51:23.491 INFO:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2020-11-20T13:51:23.520 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-20T13:51:23.560 INFO:teuthology.run_tasks:Running task kernel... 2020-11-20T13:51:23.574 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}} 2020-11-20T13:51:23.575 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-11-20T13:51:23.575 INFO:teuthology.orchestra.run.smithi039:> uname -r 2020-11-20T13:51:23.593 INFO:teuthology.orchestra.run.smithi039.stdout:4.18.0-193.28.1.el8_2.x86_64 2020-11-20T13:51:23.593 INFO:teuthology.task.kernel:Running kernel on smithi039: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T13:51:23.593 INFO:teuthology.orchestra.run.smithi039:> sudo yum install -y kernel 2020-11-20T13:51:25.950 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - AppStream 45 MB/s | 7.0 MB 00:00 2020-11-20T13:51:27.256 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - Base 28 MB/s | 2.2 MB 00:00 2020-11-20T13:51:27.710 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - Extras 90 kB/s | 5.5 kB 00:00 2020-11-20T13:51:28.128 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 25 MB/s | 8.3 MB 00:00 2020-11-20T13:51:29.932 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 4.4 MB/s | 23 kB 00:00 2020-11-20T13:51:30.900 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-11-20T13:51:30.901 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2020-11-20T13:51:31.073 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2020-11-20T13:51:31.074 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2020-11-20T13:51:31.075 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2020-11-20T13:51:31.174 INFO:teuthology.orchestra.run.smithi039:> echo no | sudo yum reinstall kernel || true 2020-11-20T13:51:31.613 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Nov 2020 01:51:30 PM UTC. 2020-11-20T13:51:31.867 INFO:teuthology.orchestra.run.smithi039.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T13:51:31.868 INFO:teuthology.orchestra.run.smithi039.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T13:51:31.912 INFO:teuthology.orchestra.run.smithi039.stderr:Error: No packages marked for reinstall. 2020-11-20T13:51:31.960 INFO:teuthology.orchestra.run.smithi039:> sudo yum reinstall -y kernel || true 2020-11-20T13:51:32.393 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 01:51:30 PM UTC. 2020-11-20T13:51:32.658 INFO:teuthology.orchestra.run.smithi039.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T13:51:32.658 INFO:teuthology.orchestra.run.smithi039.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T13:51:32.693 INFO:teuthology.orchestra.run.smithi039.stderr:Error: No packages marked for reinstall. 2020-11-20T13:51:32.732 INFO:teuthology.orchestra.run.smithi039:> rpm -q kernel --last | head -n 1 2020-11-20T13:51:32.804 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-4.18.0-193.28.1.el8_2.x86_64 Sun 15 Nov 2020 12:12:26 PM UTC 2020-11-20T13:51:32.806 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T13:51:32.806 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T13:51:32.807 INFO:teuthology.orchestra.run.smithi031:> uname -r 2020-11-20T13:51:32.824 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-193.28.1.el8_2.x86_64 2020-11-20T13:51:32.824 INFO:teuthology.task.kernel:Running kernel on smithi031: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T13:51:32.824 INFO:teuthology.orchestra.run.smithi031:> sudo yum install -y kernel 2020-11-20T13:51:35.322 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - AppStream 39 MB/s | 7.0 MB 00:00 2020-11-20T13:51:36.589 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Base 23 MB/s | 2.2 MB 00:00 2020-11-20T13:51:37.036 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Extras 80 kB/s | 5.5 kB 00:00 2020-11-20T13:51:37.446 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 23 MB/s | 8.3 MB 00:00 2020-11-20T13:51:39.241 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 4.3 MB/s | 23 kB 00:00 2020-11-20T13:51:40.229 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-11-20T13:51:40.229 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2020-11-20T13:51:40.400 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-11-20T13:51:40.401 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2020-11-20T13:51:40.401 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-11-20T13:51:40.488 INFO:teuthology.orchestra.run.smithi031:> echo no | sudo yum reinstall kernel || true 2020-11-20T13:51:40.922 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Nov 2020 01:51:39 PM UTC. 2020-11-20T13:51:41.186 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T13:51:41.186 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T13:51:41.227 INFO:teuthology.orchestra.run.smithi031.stderr:Error: No packages marked for reinstall. 2020-11-20T13:51:41.271 INFO:teuthology.orchestra.run.smithi031:> sudo yum reinstall -y kernel || true 2020-11-20T13:51:41.702 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 01:51:39 PM UTC. 2020-11-20T13:51:41.986 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-20T13:51:41.986 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-193.28.1.el8_2.x86_64 (from BaseOS) not available. 2020-11-20T13:51:42.012 INFO:teuthology.orchestra.run.smithi031.stderr:Error: No packages marked for reinstall. 2020-11-20T13:51:42.059 INFO:teuthology.orchestra.run.smithi031:> rpm -q kernel --last | head -n 1 2020-11-20T13:51:42.135 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-4.18.0-193.28.1.el8_2.x86_64 Sun 15 Nov 2020 12:12:26 PM UTC 2020-11-20T13:51:42.136 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.28.1.el8_2.x86_64 2020-11-20T13:51:42.137 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T13:51:42.137 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-11-20T13:51:42.137 INFO:teuthology.orchestra.run.smithi039:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T13:51:42.179 INFO:teuthology.orchestra.run.smithi039.stdout:ttyS1 2020-11-20T13:51:42.192 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-11-20T13:51:42.192 INFO:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T13:51:42.229 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2020-11-20T13:51:42.244 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-20T13:51:42.252 INFO:teuthology.task.internal:Creating test directory... 2020-11-20T13:51:42.252 INFO:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T13:51:42.286 INFO:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T13:51:42.303 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-20T13:51:42.310 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-20T13:51:42.320 INFO:teuthology.task.internal:Creating archive directory... 2020-11-20T13:51:42.320 INFO:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T13:51:42.340 INFO:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T13:51:42.368 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-20T13:51:42.376 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-20T13:51:42.376 INFO:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T13:51:42.404 INFO:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T13:51:42.453 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T13:51:42.471 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T13:51:42.472 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T13:51:42.489 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T13:51:42.490 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-20T13:51:42.498 INFO:teuthology.task.internal:Configuring sudo... 2020-11-20T13:51:42.498 INFO:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T13:51:42.501 INFO:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T13:51:42.534 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-20T13:51:42.543 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-20T13:51:42.543 INFO:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T13:51:42.572 INFO:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T13:51:42.589 INFO:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T13:51:42.664 INFO:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T13:51:42.731 INFO:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T13:51:42.767 INFO:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T13:51:42.820 INFO:teuthology.orchestra.run.smithi039:> set -ex 2020-11-20T13:51:42.820 INFO:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T13:51:42.874 INFO:teuthology.orchestra.run.smithi039.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T13:51:42.890 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2020-11-20T13:51:42.891 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2020-11-20T13:51:42.891 INFO:teuthology.orchestra.run.smithi039.stderr:152 bytes copied, 3.2813e-05 s, 4.6 MB/s 2020-11-20T13:51:42.892 INFO:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T13:51:42.926 INFO:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T13:51:42.992 INFO:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T13:51:43.027 INFO:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T13:51:43.080 INFO:teuthology.orchestra.run.smithi031:> set -ex 2020-11-20T13:51:43.080 INFO:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T13:51:43.133 INFO:teuthology.orchestra.run.smithi031.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T13:51:43.150 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2020-11-20T13:51:43.150 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2020-11-20T13:51:43.150 INFO:teuthology.orchestra.run.smithi031.stderr:152 bytes copied, 3.0186e-05 s, 5.0 MB/s 2020-11-20T13:51:43.151 INFO:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2020-11-20T13:51:43.194 INFO:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2020-11-20T13:51:43.264 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T13:51:43.272 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T13:51:43.504 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-20T13:51:43.513 INFO:teuthology.task.internal:Starting timer... 2020-11-20T13:51:43.513 INFO:teuthology.run_tasks:Running task pcp... 2020-11-20T13:51:43.543 INFO:teuthology.run_tasks:Running task selinux... 2020-11-20T13:51:43.557 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-11-20T13:51:43.557 INFO:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2020-11-20T13:51:43.610 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: [ OK ] 2020-11-20T13:51:43.612 INFO:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2020-11-20T13:51:43.673 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: [ OK ] 2020-11-20T13:51:43.674 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-20T13:51:43.675 INFO:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2020-11-20T13:51:43.695 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2020-11-20T13:51:43.696 INFO:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2020-11-20T13:51:43.720 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2020-11-20T13:51:43.721 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi039.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi031.front.sepia.ceph.com': 'permissive'} 2020-11-20T13:51:43.721 INFO:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T13:51:43.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T13:51:43.770 INFO:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T13:51:43.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T13:51:43.802 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-20T13:51:43.803 INFO:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2020-11-20T13:51:43.842 INFO:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2020-11-20T13:51:43.873 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-20T13:51:43.883 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-11-20T13:51:43.884 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-20T13:51:43.895 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-20T13:51:43.896 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi031.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-20T13:51:44.186 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-20T13:51:45.009 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-20T13:51:47.389 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-20T13:51:47.410 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:47 +0000 (0:00:00.066) 0:00:00.066 ******* 2020-11-20T13:51:47.423 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:47 +0000 (0:00:00.012) 0:00:00.078 ******* 2020-11-20T13:51:48.851 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi031.front.sepia.ceph.com] 2020-11-20T13:51:48.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:48 +0000 (0:00:01.493) 0:00:01.572 ******* 2020-11-20T13:51:48.925 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] 2020-11-20T13:51:48.993 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:48 +0000 (0:00:00.075) 0:00:01.648 ******* 2020-11-20T13:51:49.235 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-11-20T13:51:49.236 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T13:51:49.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:49 +0000 (0:00:00.274) 0:00:01.922 ******* 2020-11-20T13:51:49.297 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:49 +0000 (0:00:00.029) 0:00:01.952 ******* 2020-11-20T13:51:49.674 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-11-20T13:51:49.676 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T13:51:49.707 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:49 +0000 (0:00:00.410) 0:00:02.362 ******* 2020-11-20T13:51:49.715 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T13:51:49.748 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:49 +0000 (0:00:00.040) 0:00:02.403 ******* 2020-11-20T13:51:49.753 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-11-20T13:51:49.755 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:49.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:49 +0000 (0:00:00.037) 0:00:02.441 ******* 2020-11-20T13:51:49.790 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:49.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:49 +0000 (0:00:00.039) 0:00:02.480 ******* 2020-11-20T13:51:50.088 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-11-20T13:51:50.090 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi039.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T13:51:50.122 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:50 +0000 (0:00:00.297) 0:00:02.778 ******* 2020-11-20T13:51:50.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:50 +0000 (0:00:00.029) 0:00:02.807 ******* 2020-11-20T13:51:51.055 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-11-20T13:51:51.056 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605880310.1638756-255786800459028/source", "state": "file", "uid": 0} changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605880310.1335726-161453155532117/source", "state": "file", "uid": 0} 2020-11-20T13:51:51.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:51 +0000 (0:00:00.935) 0:00:03.742 ******* 2020-11-20T13:51:51.115 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:51 +0000 (0:00:00.028) 0:00:03.771 ******* 2020-11-20T13:51:51.471 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-11-20T13:51:51.473 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T13:51:51.475 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-11-20T13:51:51.476 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-11-20T13:51:51.478 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T13:51:51.603 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-20T13:51:51.610 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-20T13:51:51.755 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:51 +0000 (0:00:00.640) 0:00:04.411 ******* 2020-11-20T13:51:51.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:51 +0000 (0:00:00.029) 0:00:04.440 ******* 2020-11-20T13:51:52.406 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi031.front.sepia.ceph.com] 2020-11-20T13:51:52.479 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-20T13:51:52.481 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:52 +0000 (0:00:00.694) 0:00:05.135 ******* 2020-11-20T13:51:52.489 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] 2020-11-20T13:51:52.561 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:52 +0000 (0:00:00.082) 0:00:05.217 ******* 2020-11-20T13:51:52.918 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-20T13:51:52.920 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.151348", "end": "2020-11-20 13:51:52.894052", "rc": 0, "start": "2020-11-20 13:51:52.742704", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} changed: [smithi039.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.158576", "end": "2020-11-20 13:51:52.897790", "rc": 0, "start": "2020-11-20 13:51:52.739214", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T13:51:52.952 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:52 +0000 (0:00:00.390) 0:00:05.608 ******* 2020-11-20T13:51:52.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:52 +0000 (0:00:00.028) 0:00:05.636 ******* 2020-11-20T13:51:53.172 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T13:51:53.174 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012570", "end": "2020-11-20 13:51:53.149628", "failed_when_result": false, "rc": 0, "start": "2020-11-20 13:51:53.137058", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T13:51:53.207 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.226) 0:00:05.863 ******* 2020-11-20T13:51:53.213 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013571", "end": "2020-11-20 13:51:53.175851", "failed_when_result": false, "rc": 0, "start": "2020-11-20 13:51:53.162280", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T13:51:53.245 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.037) 0:00:05.900 ******* 2020-11-20T13:51:53.250 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T13:51:53.251 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T13:51:53.284 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.039) 0:00:05.940 ******* 2020-11-20T13:51:53.290 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T13:51:53.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.036) 0:00:05.976 ******* 2020-11-20T13:51:53.325 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-20T13:51:53.327 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.359 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.037) 0:00:06.014 ******* 2020-11-20T13:51:53.364 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.396 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.037) 0:00:06.052 ******* 2020-11-20T13:51:53.401 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-20T13:51:53.403 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.434 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.037) 0:00:06.090 ******* 2020-11-20T13:51:53.440 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.473 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.038) 0:00:06.128 ******* 2020-11-20T13:51:53.478 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-20T13:51:53.480 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.037) 0:00:06.165 ******* 2020-11-20T13:51:53.516 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.547 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.037) 0:00:06.203 ******* 2020-11-20T13:51:53.552 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-11-20T13:51:53.554 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.585 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.038) 0:00:06.241 ******* 2020-11-20T13:51:53.590 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.035) 0:00:06.276 ******* 2020-11-20T13:51:53.624 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-11-20T13:51:53.626 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.655 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.034) 0:00:06.311 ******* 2020-11-20T13:51:53.660 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:53 +0000 (0:00:00.038) 0:00:06.349 ******* 2020-11-20T13:51:53.700 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T13:51:53.701 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.712 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.713 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2020-11-20T13:51:53.715 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.723 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.725 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.734 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.736 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.746 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.748 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBH 2020-11-20T13:51:53.749 INFO:teuthology.task.ansible.out:WOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.758 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.760 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22 2020-11-20T13:51:53.762 INFO:teuthology.task.ansible.out:c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.771 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.772 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef 2020-11-20T13:51:53.774 INFO:teuthology.task.ansible.out:8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.783 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.785 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 2 2020-11-20T13:51:53.787 INFO:teuthology.task.ansible.out:0058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.796 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.797 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n' 2020-11-20T13:51:53.799 INFO:teuthology.task.ansible.out:}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result wa 2020-11-20T13:51:53.800 INFO:teuthology.task.ansible.out:s False"} 2020-11-20T13:51:53.808 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.810 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXY 2020-11-20T13:51:53.812 INFO:teuthology.task.ansible.out:UFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.821 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.822 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b42 2020-11-20T13:51:53.824 INFO:teuthology.task.ansible.out:67efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.833 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.835 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.845 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.847 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeec 2020-11-20T13:51:53.849 INFO:teuthology.task.ansible.out:ee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.858 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.860 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.870 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.872 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.872 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": 2020-11-20T13:51:53.874 INFO:teuthology.task.ansible.out: "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.883 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.884 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.895 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.896 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.907 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.908 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 6 2020-11-20T13:51:53.910 INFO:teuthology.task.ansible.out:8915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.919 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.921 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.922 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.932 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.934 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.945 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.946 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.957 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.958 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.969 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.971 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.971 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed 2020-11-20T13:51:53.973 INFO:teuthology.task.ansible.out:01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.982 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.983 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.994 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.995 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:53.996 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a9 2020-11-20T13:51:53.997 INFO:teuthology.task.ansible.out:87\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.007 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.008 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.009 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.020 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.021 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.031 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.033 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.033 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "i 2020-11-20T13:51:54.035 INFO:teuthology.task.ansible.out:tem": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.044 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.045 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.046 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.056 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.058 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.058 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.069 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.071 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.081 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.083 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.083 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2020-11-20T13:51:54.085 INFO:teuthology.task.ansible.out: "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.094 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.095 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.096 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.106 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.108 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.108 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.119 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.121 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.131 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.133 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex 2020-11-20T13:51:54.134 INFO:teuthology.task.ansible.out:004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.143 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.144 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.144 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.145 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.145 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.156 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.157 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.169 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.170 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.171 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.181 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.183 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.194 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.195 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.196 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'ideepik 2020-11-20T13:51:54.197 INFO:teuthology.task.ansible.out:a', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.206 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.208 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.208 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.208 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6 2020-11-20T13:51:54.210 INFO:teuthology.task.ansible.out:okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.219 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.221 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.231 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.233 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.233 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.234 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'ofriedma', 2020-11-20T13:51:54.235 INFO:teuthology.task.ansible.out: 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.244 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.246 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.248 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.256 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.258 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.259 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.259 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": 2020-11-20T13:51:54.261 INFO:teuthology.task.ansible.out: {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.269 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.271 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.273 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.284 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.285 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.286 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.286 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.297 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.298 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.309 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.310 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.311 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.311 INFO:teuthology.task.ansible.out:skipping: [smithi031.fro 2020-11-20T13:51:54.313 INFO:teuthology.task.ansible.out:nt.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.322 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.324 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.324 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.335 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.336 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.347 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.349 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.359 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.361 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.362 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sep 2020-11-20T13:51:54.364 INFO:teuthology.task.ansible.out:ia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.372 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.374 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.375 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@ce 2020-11-20T13:51:54.377 INFO:teuthology.task.ansible.out:phdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.402 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.405 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) 2020-11-20T13:51:54.407 INFO:teuthology.task.ansible.out: => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.439 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.745) 0:00:07.095 ******* 2020-11-20T13:51:54.445 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.447 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.447 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.464 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-20T13:51:54.497 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.057) 0:00:07.152 ******* 2020-11-20T13:51:54.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.033) 0:00:07.186 ******* 2020-11-20T13:51:54.535 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-20T13:51:54.537 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.043) 0:00:07.229 ******* 2020-11-20T13:51:54.579 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-20T13:51:54.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.038) 0:00:07.267 ******* 2020-11-20T13:51:54.617 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T13:51:54.618 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.651 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.039) 0:00:07.307 ******* 2020-11-20T13:51:54.656 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-20T13:51:54.658 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.693 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.041) 0:00:07.349 ******* 2020-11-20T13:51:54.698 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-20T13:51:54.700 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.733 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.039) 0:00:07.389 ******* 2020-11-20T13:51:54.739 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T13:51:54.741 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.773 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.040) 0:00:07.429 ******* 2020-11-20T13:51:54.779 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T13:51:54.781 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.814 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.040) 0:00:07.469 ******* 2020-11-20T13:51:54.820 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-20T13:51:54.821 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.855 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.040) 0:00:07.510 ******* 2020-11-20T13:51:54.860 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T13:51:54.862 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.893 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.038) 0:00:07.549 ******* 2020-11-20T13:51:54.899 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T13:51:54.901 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.935 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.041) 0:00:07.591 ******* 2020-11-20T13:51:54.941 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T13:51:54.943 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.944 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.954 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.956 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-11-20T13:51:54.956 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.989 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:54 +0000 (0:00:00.054) 0:00:07.645 ******* 2020-11-20T13:51:54.994 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.996 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.996 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.997 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.997 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.997 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:54.998 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.009 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.011 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.020 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.022 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.033 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.034 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.045 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.047 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.057 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.059 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.069 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.071 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.081 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.083 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.083 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.094 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.096 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.097 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.107 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.109 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.119 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.121 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.131 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.132 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.136 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.172 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:55 +0000 (0:00:00.182) 0:00:07.827 ******* 2020-11-20T13:51:55.177 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.179 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.179 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.180 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.180 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.181 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.191 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.193 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.203 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.205 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.214 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.216 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.225 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.227 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.237 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.238 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.248 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.249 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.260 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T13:51:55.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:55 +0000 (0:00:00.123) 0:00:07.951 ******* 2020-11-20T13:51:55.883 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T13:51:55.885 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T13:51:55.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:55 +0000 (0:00:00.621) 0:00:08.572 ******* 2020-11-20T13:51:55.947 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:55 +0000 (0:00:00.030) 0:00:08.602 ******* 2020-11-20T13:51:55.952 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T13:51:55.953 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => { "msg": "Host smithi031.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-11-20T13:51:55.987 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:55 +0000 (0:00:00.040) 0:00:08.643 ******* 2020-11-20T13:51:55.994 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => { "msg": "Host smithi039.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-11-20T13:51:56.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.038) 0:00:08.682 ******* 2020-11-20T13:51:56.033 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T13:51:56.035 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-11-20T13:51:56.067 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.040) 0:00:08.723 ******* 2020-11-20T13:51:56.072 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-11-20T13:51:56.106 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.038) 0:00:08.761 ******* 2020-11-20T13:51:56.110 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T13:51:56.112 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:56.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.037) 0:00:08.799 ******* 2020-11-20T13:51:56.149 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:56.182 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.038) 0:00:08.837 ******* 2020-11-20T13:51:56.673 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T13:51:56.675 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.330805", "end": "2020-11-20 13:51:56.651977", "rc": 0, "start": "2020-11-20 13:51:56.321172", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T13:51:56.705 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.523) 0:00:09.361 ******* 2020-11-20T13:51:56.732 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.341046", "end": "2020-11-20 13:51:56.706054", "rc": 0, "start": "2020-11-20 13:51:56.365008", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T13:51:56.734 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:56.765 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.059) 0:00:09.420 ******* 2020-11-20T13:51:56.792 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.027) 0:00:09.448 ******* 2020-11-20T13:51:56.796 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T13:51:56.798 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:56.828 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.036) 0:00:09.484 ******* 2020-11-20T13:51:56.833 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T13:51:56.835 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:56.866 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.038) 0:00:09.522 ******* 2020-11-20T13:51:56.871 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T13:51:56.872 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:56.906 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.040) 0:00:09.562 ******* 2020-11-20T13:51:56.912 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T13:51:56.913 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:56.945 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.038) 0:00:09.600 ******* 2020-11-20T13:51:56.949 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T13:51:56.951 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:56.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:56 +0000 (0:00:00.036) 0:00:09.637 ******* 2020-11-20T13:51:56.986 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T13:51:56.987 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.017 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.035) 0:00:09.672 ******* 2020-11-20T13:51:57.021 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T13:51:57.023 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.053 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.036) 0:00:09.709 ******* 2020-11-20T13:51:57.058 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T13:51:57.059 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.089 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.036) 0:00:09.745 ******* 2020-11-20T13:51:57.095 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T13:51:57.096 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.126 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.037) 0:00:09.782 ******* 2020-11-20T13:51:57.131 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T13:51:57.132 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.037) 0:00:09.820 ******* 2020-11-20T13:51:57.168 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T13:51:57.170 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:57.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.035) 0:00:09.856 ******* 2020-11-20T13:51:57.204 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T13:51:57.206 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.237 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.036) 0:00:09.892 ******* 2020-11-20T13:51:57.242 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T13:51:57.243 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.039) 0:00:09.932 ******* 2020-11-20T13:51:57.281 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T13:51:57.282 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi039.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:57.313 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.036) 0:00:09.969 ******* 2020-11-20T13:51:57.318 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T13:51:57.319 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.351 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.038) 0:00:10.007 ******* 2020-11-20T13:51:57.356 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T13:51:57.358 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.390 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.038) 0:00:10.046 ******* 2020-11-20T13:51:57.395 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T13:51:57.397 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:57.431 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.040) 0:00:10.086 ******* 2020-11-20T13:51:57.436 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T13:51:57.438 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.470 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.038) 0:00:10.125 ******* 2020-11-20T13:51:57.475 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T13:51:57.477 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.507 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.037) 0:00:10.163 ******* 2020-11-20T13:51:57.512 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T13:51:57.513 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:57.544 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.036) 0:00:10.199 ******* 2020-11-20T13:51:57.548 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T13:51:57.550 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:57.580 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.036) 0:00:10.236 ******* 2020-11-20T13:51:57.584 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T13:51:57.586 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.035) 0:00:10.272 ******* 2020-11-20T13:51:57.621 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T13:51:57.622 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.657 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.041) 0:00:10.313 ******* 2020-11-20T13:51:57.663 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T13:51:57.665 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:57.695 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.037) 0:00:10.351 ******* 2020-11-20T13:51:57.700 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T13:51:57.701 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.733 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.038) 0:00:10.389 ******* 2020-11-20T13:51:57.739 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T13:51:57.740 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.772 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.039) 0:00:10.428 ******* 2020-11-20T13:51:57.778 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T13:51:57.780 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.812 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.039) 0:00:10.467 ******* 2020-11-20T13:51:57.817 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T13:51:57.819 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.851 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.039) 0:00:10.507 ******* 2020-11-20T13:51:57.857 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T13:51:57.858 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.890 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.038) 0:00:10.546 ******* 2020-11-20T13:51:57.896 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T13:51:57.897 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:57.928 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.037) 0:00:10.584 ******* 2020-11-20T13:51:57.933 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T13:51:57.935 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:57.966 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.038) 0:00:10.622 ******* 2020-11-20T13:51:57.973 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T13:51:57.974 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:57 +0000 (0:00:00.038) 0:00:10.660 ******* 2020-11-20T13:51:58.010 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T13:51:58.011 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.043 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.038) 0:00:10.699 ******* 2020-11-20T13:51:58.049 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T13:51:58.050 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:58.083 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.039) 0:00:10.738 ******* 2020-11-20T13:51:58.088 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T13:51:58.090 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.122 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.039) 0:00:10.778 ******* 2020-11-20T13:51:58.128 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T13:51:58.130 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.162 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.039) 0:00:10.817 ******* 2020-11-20T13:51:58.167 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T13:51:58.169 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.201 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.039) 0:00:10.857 ******* 2020-11-20T13:51:58.207 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T13:51:58.209 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.240 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.038) 0:00:10.895 ******* 2020-11-20T13:51:58.245 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.278 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.038) 0:00:10.933 ******* 2020-11-20T13:51:58.283 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T13:51:58.285 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.316 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.038) 0:00:10.972 ******* 2020-11-20T13:51:58.322 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T13:51:58.323 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.037) 0:00:11.009 ******* 2020-11-20T13:51:58.358 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T13:51:58.360 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.392 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.038) 0:00:11.048 ******* 2020-11-20T13:51:58.397 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T13:51:58.399 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.432 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.040) 0:00:11.088 ******* 2020-11-20T13:51:58.437 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T13:51:58.439 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.469 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.036) 0:00:11.125 ******* 2020-11-20T13:51:58.474 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-20T13:51:58.475 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:58.506 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.036) 0:00:11.161 ******* 2020-11-20T13:51:58.511 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T13:51:58.512 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.542 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.035) 0:00:11.197 ******* 2020-11-20T13:51:58.546 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T13:51:58.547 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.578 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.036) 0:00:11.234 ******* 2020-11-20T13:51:58.583 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-20T13:51:58.585 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:51:58.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.038) 0:00:11.272 ******* 2020-11-20T13:51:58.622 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T13:51:58.623 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.037) 0:00:11.310 ******* 2020-11-20T13:51:58.659 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T13:51:58.660 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.692 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.038) 0:00:11.348 ******* 2020-11-20T13:51:58.717 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:51:58.748 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.056) 0:00:11.404 ******* 2020-11-20T13:51:58.867 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T13:51:58.869 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T13:51:58.898 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.150) 0:00:11.554 ******* 2020-11-20T13:51:58.965 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T13:51:58.997 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:58 +0000 (0:00:00.098) 0:00:11.652 ******* 2020-11-20T13:51:59.374 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T13:51:59.376 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T13:51:59.480 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T13:51:59.822 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T13:51:59.856 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:59 +0000 (0:00:00.858) 0:00:12.511 ******* 2020-11-20T13:51:59.923 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T13:51:59.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:51:59 +0000 (0:00:00.102) 0:00:12.614 ******* 2020-11-20T13:52:00.329 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T13:52:00.331 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T13:52:00.434 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T13:52:00.778 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T13:52:00.811 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:00 +0000 (0:00:00.852) 0:00:13.467 ******* 2020-11-20T13:52:00.837 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T13:52:00.839 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:00.869 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:00 +0000 (0:00:00.058) 0:00:13.525 ******* 2020-11-20T13:52:00.885 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T13:52:00.886 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T13:52:00.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:00 +0000 (0:00:00.047) 0:00:13.573 ******* 2020-11-20T13:52:00.923 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T13:52:00.925 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:00.957 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:00 +0000 (0:00:00.039) 0:00:13.612 ******* 2020-11-20T13:52:00.961 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T13:52:00.963 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:00.994 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:00 +0000 (0:00:00.037) 0:00:13.649 ******* 2020-11-20T13:52:00.998 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T13:52:01.000 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.031 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.037) 0:00:13.686 ******* 2020-11-20T13:52:01.036 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T13:52:01.038 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.069 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.037) 0:00:13.724 ******* 2020-11-20T13:52:01.073 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T13:52:01.075 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.038) 0:00:13.762 ******* 2020-11-20T13:52:01.112 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T13:52:01.113 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.145 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.037) 0:00:13.800 ******* 2020-11-20T13:52:01.149 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T13:52:01.151 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.182 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.037) 0:00:13.837 ******* 2020-11-20T13:52:01.187 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.218 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.036) 0:00:13.874 ******* 2020-11-20T13:52:01.223 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T13:52:01.224 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.255 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.037) 0:00:13.911 ******* 2020-11-20T13:52:01.260 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T13:52:01.262 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.293 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.037) 0:00:13.948 ******* 2020-11-20T13:52:01.297 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T13:52:01.299 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.330 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.037) 0:00:13.986 ******* 2020-11-20T13:52:01.335 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T13:52:01.337 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.037) 0:00:14.024 ******* 2020-11-20T13:52:01.373 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T13:52:01.374 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.036) 0:00:14.060 ******* 2020-11-20T13:52:01.409 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T13:52:01.415 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.447 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.042) 0:00:14.103 ******* 2020-11-20T13:52:01.452 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T13:52:01.453 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.037) 0:00:14.140 ******* 2020-11-20T13:52:01.489 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T13:52:01.491 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.039) 0:00:14.179 ******* 2020-11-20T13:52:01.548 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T13:52:01.550 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:01.582 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:01 +0000 (0:00:00.057) 0:00:14.237 ******* 2020-11-20T13:52:02.517 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T13:52:02.519 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.736708", "end": "2020-11-20 13:52:02.500345", "rc": 0, "start": "2020-11-20 13:52:01.763637", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.835892", "end": "2020-11-20 13:52:02.500359", "rc": 0, "start": "2020-11-20 13:52:01.664467", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:52:02.551 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:02 +0000 (0:00:00.969) 0:00:15.207 ******* 2020-11-20T13:52:02.580 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:02 +0000 (0:00:00.028) 0:00:15.235 ******* 2020-11-20T13:52:03.753 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T13:52:03.755 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T13:52:03.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:03 +0000 (0:00:01.205) 0:00:16.441 ******* 2020-11-20T13:52:03.791 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T13:52:03.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:03 +0000 (0:00:00.039) 0:00:16.481 ******* 2020-11-20T13:52:03.830 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T13:52:03.832 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:03.862 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:03 +0000 (0:00:00.036) 0:00:16.517 ******* 2020-11-20T13:52:03.866 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:03.900 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:03 +0000 (0:00:00.038) 0:00:16.555 ******* 2020-11-20T13:52:03.905 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T13:52:03.907 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:03.939 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:03 +0000 (0:00:00.038) 0:00:16.594 ******* 2020-11-20T13:52:03.944 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:03.976 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:03 +0000 (0:00:00.037) 0:00:16.632 ******* 2020-11-20T13:52:03.981 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T13:52:03.983 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:04.015 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:04 +0000 (0:00:00.038) 0:00:16.671 ******* 2020-11-20T13:52:04.021 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:04.053 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:04 +0000 (0:00:00.037) 0:00:16.708 ******* 2020-11-20T13:52:04.057 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T13:52:04.059 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:04.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:04 +0000 (0:00:00.037) 0:00:16.746 ******* 2020-11-20T13:52:04.095 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:04.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:04 +0000 (0:00:00.040) 0:00:16.787 ******* 2020-11-20T13:52:04.551 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T13:52:04.553 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T13:52:04.586 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:04 +0000 (0:00:00.455) 0:00:17.242 ******* 2020-11-20T13:52:04.602 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T13:52:04.636 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:04 +0000 (0:00:00.049) 0:00:17.291 ******* 2020-11-20T13:52:07.776 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T13:52:07.778 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-20T13:52:07.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:07 +0000 (0:00:03.173) 0:00:20.465 ******* 2020-11-20T13:52:07.960 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-20T13:52:07.994 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:07 +0000 (0:00:00.184) 0:00:20.650 ******* 2020-11-20T13:52:08.322 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T13:52:08.324 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T13:52:08.541 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T13:52:08.811 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T13:52:09.029 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T13:52:09.475 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T13:52:09.509 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:09 +0000 (0:00:01.514) 0:00:22.165 ******* 2020-11-20T13:52:09.618 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T13:52:09.655 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:09 +0000 (0:00:00.146) 0:00:22.311 ******* 2020-11-20T13:52:09.712 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T13:52:09.714 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T13:52:09.748 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:09 +0000 (0:00:00.092) 0:00:22.403 ******* 2020-11-20T13:52:09.857 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T13:52:09.892 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:09 +0000 (0:00:00.144) 0:00:22.547 ******* 2020-11-20T13:52:10.219 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T13:52:10.220 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T13:52:10.365 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T13:52:10.657 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T13:52:10.802 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T13:52:11.093 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T13:52:11.129 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:01.236) 0:00:23.784 ******* 2020-11-20T13:52:11.155 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T13:52:11.157 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:11.190 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:00.060) 0:00:23.845 ******* 2020-11-20T13:52:11.216 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T13:52:11.218 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T13:52:11.250 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:00.060) 0:00:23.905 ******* 2020-11-20T13:52:11.254 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T13:52:11.256 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T13:52:11.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:00.041) 0:00:23.947 ******* 2020-11-20T13:52:11.318 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T13:52:11.320 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:11.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:00.062) 0:00:24.009 ******* 2020-11-20T13:52:11.380 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T13:52:11.382 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T13:52:11.414 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:00.060) 0:00:24.070 ******* 2020-11-20T13:52:11.451 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T13:52:11.453 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T13:52:11.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:00.071) 0:00:24.141 ******* 2020-11-20T13:52:11.523 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T13:52:11.525 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:11.534 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:11.545 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:11.556 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:11.590 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:00.105) 0:00:24.246 ******* 2020-11-20T13:52:11.617 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T13:52:11.618 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T13:52:11.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:00.059) 0:00:24.306 ******* 2020-11-20T13:52:11.700 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T13:52:11.702 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:11.712 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:11.723 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:11.760 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:11 +0000 (0:00:00.109) 0:00:24.416 ******* 2020-11-20T13:52:12.575 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T13:52:12.577 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T13:52:12.608 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:12 +0000 (0:00:00.848) 0:00:25.264 ******* 2020-11-20T13:52:12.634 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T13:52:12.635 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:12.667 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:12 +0000 (0:00:00.058) 0:00:25.322 ******* 2020-11-20T13:52:12.734 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T13:52:12.736 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T13:52:12.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:12 +0000 (0:00:00.100) 0:00:25.423 ******* 2020-11-20T13:52:12.793 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T13:52:12.795 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:12.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:12 +0000 (0:00:00.057) 0:00:25.481 ******* 2020-11-20T13:52:13.140 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T13:52:13.142 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T13:52:13.173 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:13 +0000 (0:00:00.347) 0:00:25.828 ******* 2020-11-20T13:52:13.293 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T13:52:13.327 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:13 +0000 (0:00:00.153) 0:00:25.982 ******* 2020-11-20T13:52:13.644 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T13:52:13.645 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T13:52:13.678 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:13 +0000 (0:00:00.350) 0:00:26.333 ******* 2020-11-20T13:52:13.704 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi039.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:13.715 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:13.748 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:13 +0000 (0:00:00.069) 0:00:26.403 ******* 2020-11-20T13:52:13.794 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T13:52:13.796 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T13:52:13.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:13 +0000 (0:00:00.081) 0:00:26.484 ******* 2020-11-20T13:52:13.854 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T13:52:13.856 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:13.865 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T13:52:13.898 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:13 +0000 (0:00:00.069) 0:00:26.553 ******* 2020-11-20T13:52:13.956 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T13:52:13.958 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T13:52:13.989 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:13 +0000 (0:00:00.091) 0:00:26.645 ******* 2020-11-20T13:52:14.100 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T13:52:14.133 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:14 +0000 (0:00:00.143) 0:00:26.789 ******* 2020-11-20T13:52:14.233 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T13:52:14.235 INFO:teuthology.task.ansible.out:fatal: [smithi039.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T13:52:14.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:14 +0000 (0:00:00.133) 0:00:26.923 ******* 2020-11-20T13:52:14.294 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T13:52:14.296 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:14.329 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:14 +0000 (0:00:00.061) 0:00:26.984 ******* 2020-11-20T13:52:14.365 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T13:52:14.366 INFO:teuthology.task.ansible.out:fatal: [smithi031.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T13:52:14.399 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:14 +0000 (0:00:00.070) 0:00:27.055 ******* 2020-11-20T13:52:14.425 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T13:52:14.427 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:14.458 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:14 +0000 (0:00:00.058) 0:00:27.114 ******* 2020-11-20T13:52:14.796 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T13:52:14.798 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T13:52:14.833 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:14 +0000 (0:00:00.374) 0:00:27.489 ******* 2020-11-20T13:52:14.924 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T13:52:14.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:14 +0000 (0:00:00.125) 0:00:27.614 ******* 2020-11-20T13:52:15.545 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T13:52:15.546 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 13:50:34 UTC", "ActiveEnterTimestampMonotonic": "16021738", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount nss-lookup.target sysinit.target network.target basic.target systemd-tmpfiles-setup.service local-fs.target systemd-journald.socket tmp.mount system.slice -.mount time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 13:50:34 UTC", "AssertTimestampMonotonic": "16020562", "Before": "getty@tty1.service plymouth-quit.service shutdown.target xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 13:50:34 UTC", "ConditionTimestampMonotonic": "16020562", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-11-20T13:52:15.547 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2485", "ExecMainStartTimestamp": "Fri 2020-11-20 13:50:34 UTC", "ExecMainStartTimestampMonotonic": "16021705", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 13:50:34 UTC", "InactiveExitTimestampMonotonic": "16021738", "InvocationID": "39ec51d4eb984f7ea7ca0638f1d90a24", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitD 2020-11-20T13:52:15.549 INFO:teuthology.task.ansible.out:ATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2485", "MemoryAccounting": "yes", "MemoryCurrent": "1204224", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode 2020-11-20T13:52:15.550 INFO:teuthology.task.ansible.out:": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 13:50:34 UTC", "StateChangeTimestampMonotonic": "16021738", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 13:50:34 UTC", "WatchdogTimestampMonotonic": "16021736", "WatchdogUSec": "0"}} ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 13:51:05 UTC", "ActiveEnterTimestampMonotonic": "15901190", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target sysinit.target basic.target time-sync.target systemd-tmpfiles-setup.service local-fs.target systemd-journald.socket -.mount system.slice tmp.mount network.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 13:51:05 2020-11-20T13:52:15.552 INFO:teuthology.task.ansible.out:UTC", "AssertTimestampMonotonic": "15900389", "Before": "xdm.service multi-user.target getty@tty1.service plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 13:51:05 UTC", "ConditionTimestampMonotonic": "15900388", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2484", "ExecMainStartTimestamp": "Fri 2020-11-20 13:51:05 UTC", "ExecMainStartTimestampMonotonic": "15901160", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv 2020-11-20T13:52:15.554 INFO:teuthology.task.ansible.out:[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 13:51:05 UTC", "InactiveExitTimestampMonotonic": "15901190", "InvocationID": "a5672a68ff12460996720e25e60c259d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426 2020-11-20T13:52:15.555 INFO:teuthology.task.ansible.out:", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2484", "MemoryAccounting": "yes", "MemoryCurrent": "1208320", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 13:51:05 UTC", "StateChangeTimestampMonotonic": "1590 2020-11-20T13:52:15.557 INFO:teuthology.task.ansible.out:1190", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 13:51:05 UTC", "WatchdogTimestampMonotonic": "15901189", "WatchdogUSec": "0"}} 2020-11-20T13:52:15.586 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:15 +0000 (0:00:00.627) 0:00:28.242 ******* 2020-11-20T13:52:15.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:15 +0000 (0:00:00.034) 0:00:28.276 ******* 2020-11-20T13:52:15.793 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T13:52:15.794 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001686", "end": "2020-11-20 13:52:15.767090", "rc": 0, "start": "2020-11-20 13:52:15.765404", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T13:52:15.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:15 +0000 (0:00:00.208) 0:00:28.485 ******* 2020-11-20T13:52:15.836 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001696", "end": "2020-11-20 13:52:15.800021", "rc": 0, "start": "2020-11-20 13:52:15.798325", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T13:52:15.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:15 +0000 (0:00:00.059) 0:00:28.544 ******* 2020-11-20T13:52:16.804 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T13:52:16.806 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T13:52:16.839 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:16 +0000 (0:00:00.949) 0:00:29.494 ******* 2020-11-20T13:52:16.846 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T13:52:16.880 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:16 +0000 (0:00:00.041) 0:00:29.535 ******* 2020-11-20T13:52:17.817 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T13:52:17.819 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T13:52:17.853 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:17 +0000 (0:00:00.973) 0:00:30.508 ******* 2020-11-20T13:52:17.859 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T13:52:17.898 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:17 +0000 (0:00:00.044) 0:00:30.553 ******* 2020-11-20T13:52:19.140 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T13:52:19.141 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T13:52:19.173 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:19 +0000 (0:00:01.275) 0:00:31.829 ******* 2020-11-20T13:52:19.179 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T13:52:19.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:19 +0000 (0:00:00.040) 0:00:31.869 ******* 2020-11-20T13:52:36.375 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T13:52:36.377 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.961099", "end": "2020-11-20 13:52:36.353351", "failed_when_result": false, "rc": 0, "start": "2020-11-20 13:52:19.392252", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T13:52:36.408 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:36 +0000 (0:00:17.194) 0:00:49.063 ******* 2020-11-20T13:52:36.424 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:17.041578", "end": "2020-11-20 13:52:36.401260", "failed_when_result": false, "rc": 0, "start": "2020-11-20 13:52:19.359682", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T13:52:36.458 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:36 +0000 (0:00:00.050) 0:00:49.114 ******* 2020-11-20T13:52:36.869 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T13:52:36.871 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T13:52:36.903 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:36 +0000 (0:00:00.444) 0:00:49.558 ******* 2020-11-20T13:52:36.929 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T13:52:36.963 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:36 +0000 (0:00:00.060) 0:00:49.619 ******* 2020-11-20T13:52:37.105 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T13:52:37.106 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010793", "end": "2020-11-20 13:52:37.087358", "rc": 0, "start": "2020-11-20 13:52:37.076565", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:52:37.138 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:37 +0000 (0:00:00.174) 0:00:49.794 ******* 2020-11-20T13:52:37.187 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.022907", "end": "2020-11-20 13:52:37.166363", "rc": 0, "start": "2020-11-20 13:52:37.143456", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:52:37.222 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:37 +0000 (0:00:00.083) 0:00:49.877 ******* 2020-11-20T13:52:37.354 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T13:52:37.355 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.009437", "end": "2020-11-20 13:52:37.330895", "rc": 0, "start": "2020-11-20 13:52:37.321458", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:52:37.387 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:37 +0000 (0:00:00.165) 0:00:50.043 ******* 2020-11-20T13:52:37.435 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.011644", "end": "2020-11-20 13:52:37.412316", "rc": 0, "start": "2020-11-20 13:52:37.400672", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:52:37.469 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:37 +0000 (0:00:00.081) 0:00:50.125 ******* 2020-11-20T13:52:54.520 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T13:52:54.522 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.848772", "end": "2020-11-20 13:52:54.499679", "rc": 0, "start": "2020-11-20 13:52:37.650907", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:52:54.553 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:54 +0000 (0:00:17.083) 0:01:07.208 ******* 2020-11-20T13:52:54.558 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.944902", "end": "2020-11-20 13:52:54.514874", "rc": 0, "start": "2020-11-20 13:52:37.569972", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:52:54.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:54 +0000 (0:00:00.039) 0:01:07.247 ******* 2020-11-20T13:52:54.753 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T13:52:54.755 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T13:52:54.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:54 +0000 (0:00:00.195) 0:01:07.442 ******* 2020-11-20T13:52:54.804 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T13:52:54.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:54 +0000 (0:00:00.050) 0:01:07.493 ******* 2020-11-20T13:52:54.843 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T13:52:54.845 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:54.879 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:54 +0000 (0:00:00.041) 0:01:07.534 ******* 2020-11-20T13:52:54.885 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:54.918 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:54 +0000 (0:00:00.039) 0:01:07.573 ******* 2020-11-20T13:52:54.923 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T13:52:54.924 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T13:52:54.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:54 +0000 (0:00:00.039) 0:01:07.613 ******* 2020-11-20T13:52:54.963 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T13:52:54.996 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:54 +0000 (0:00:00.038) 0:01:07.651 ******* 2020-11-20T13:52:55.001 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T13:52:55.003 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:55.034 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:55 +0000 (0:00:00.037) 0:01:07.689 ******* 2020-11-20T13:52:55.039 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:55.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:55 +0000 (0:00:00.038) 0:01:07.728 ******* 2020-11-20T13:52:55.077 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T13:52:55.079 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:55.110 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:55 +0000 (0:00:00.038) 0:01:07.766 ******* 2020-11-20T13:52:55.117 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:55.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:55 +0000 (0:00:00.040) 0:01:07.807 ******* 2020-11-20T13:52:55.157 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T13:52:55.159 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi031.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:52:55.195 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:55 +0000 (0:00:00.043) 0:01:07.850 ******* 2020-11-20T13:52:55.201 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:52:55.202 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T13:52:55.235 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:55 +0000 (0:00:00.040) 0:01:07.890 ******* 2020-11-20T13:52:55.417 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T13:52:55.419 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T13:52:55.453 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:55 +0000 (0:00:00.218) 0:01:08.109 ******* 2020-11-20T13:52:55.470 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T13:52:55.506 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:55 +0000 (0:00:00.052) 0:01:08.162 ******* 2020-11-20T13:52:55.970 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T13:52:55.975 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605880375.4837446-56692250812287/source", "state": "file", "uid": 0} 2020-11-20T13:52:56.004 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.498) 0:01:08.660 ******* 2020-11-20T13:52:56.021 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605880375.5333946-153041799005731/source", "state": "file", "uid": 0} 2020-11-20T13:52:56.053 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.048) 0:01:08.709 ******* 2020-11-20T13:52:56.058 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T13:52:56.060 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T13:52:56.093 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.039) 0:01:08.748 ******* 2020-11-20T13:52:56.099 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T13:52:56.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.041) 0:01:08.790 ******* 2020-11-20T13:52:56.139 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T13:52:56.141 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T13:52:56.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.041) 0:01:08.832 ******* 2020-11-20T13:52:56.182 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T13:52:56.218 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.041) 0:01:08.873 ******* 2020-11-20T13:52:56.224 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T13:52:56.226 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-11-20T13:52:56.261 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.043) 0:01:08.917 ******* 2020-11-20T13:52:56.268 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-11-20T13:52:56.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.042) 0:01:08.959 ******* 2020-11-20T13:52:56.309 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T13:52:56.310 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T13:52:56.345 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.041) 0:01:09.001 ******* 2020-11-20T13:52:56.351 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T13:52:56.385 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.040) 0:01:09.041 ******* 2020-11-20T13:52:56.546 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T13:52:56.548 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T13:52:56.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.197) 0:01:09.238 ******* 2020-11-20T13:52:56.589 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T13:52:56.623 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.040) 0:01:09.279 ******* 2020-11-20T13:52:56.774 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T13:52:56.776 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T13:52:56.809 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.186) 0:01:09.465 ******* 2020-11-20T13:52:56.826 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T13:52:56.862 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.053) 0:01:09.518 ******* 2020-11-20T13:52:56.868 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T13:52:56.870 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:56.902 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.039) 0:01:09.558 ******* 2020-11-20T13:52:56.908 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:56.943 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.040) 0:01:09.599 ******* 2020-11-20T13:52:56.949 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T13:52:56.951 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:56.983 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:56 +0000 (0:00:00.040) 0:01:09.639 ******* 2020-11-20T13:52:56.990 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:52:57.024 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:57 +0000 (0:00:00.040) 0:01:09.680 ******* 2020-11-20T13:52:57.207 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T13:52:57.209 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T13:52:57.242 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:57 +0000 (0:00:00.217) 0:01:09.898 ******* 2020-11-20T13:52:57.248 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T13:52:57.283 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:57 +0000 (0:00:00.040) 0:01:09.939 ******* 2020-11-20T13:52:57.775 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T13:52:57.777 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T13:52:57.809 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:57 +0000 (0:00:00.525) 0:01:10.464 ******* 2020-11-20T13:52:57.825 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T13:52:57.858 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:57 +0000 (0:00:00.049) 0:01:10.514 ******* 2020-11-20T13:52:57.864 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T13:52:57.866 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi031"}, "changed": false} 2020-11-20T13:52:57.899 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:57 +0000 (0:00:00.040) 0:01:10.554 ******* 2020-11-20T13:52:57.905 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi039"}, "changed": false} 2020-11-20T13:52:57.939 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:57 +0000 (0:00:00.040) 0:01:10.595 ******* 2020-11-20T13:52:58.870 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T13:52:58.872 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi031", "ansible_hostname": "smithi031", "ansible_nodename": "smithi031"}, "changed": false, "name": "smithi031"} 2020-11-20T13:52:58.907 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:58 +0000 (0:00:00.967) 0:01:11.562 ******* 2020-11-20T13:52:58.912 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi039", "ansible_hostname": "smithi039", "ansible_nodename": "smithi039"}, "changed": false, "name": "smithi039"} 2020-11-20T13:52:58.946 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:58 +0000 (0:00:00.039) 0:01:11.602 ******* 2020-11-20T13:52:59.368 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T13:52:59.370 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T13:52:59.404 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:59 +0000 (0:00:00.457) 0:01:12.059 ******* 2020-11-20T13:52:59.421 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T13:52:59.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:59 +0000 (0:00:00.058) 0:01:12.118 ******* 2020-11-20T13:52:59.874 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T13:52:59.876 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T13:52:59.924 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:59 +0000 (0:00:00.461) 0:01:12.580 ******* 2020-11-20T13:52:59.943 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T13:52:59.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:52:59 +0000 (0:00:00.052) 0:01:12.633 ******* 2020-11-20T13:53:00.571 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T13:53:00.573 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T13:53:00.609 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:00 +0000 (0:00:00.631) 0:01:13.265 ******* 2020-11-20T13:53:00.617 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T13:53:00.655 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:00 +0000 (0:00:00.045) 0:01:13.310 ******* 2020-11-20T13:53:01.101 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T13:53:01.103 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T13:53:01.138 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:01 +0000 (0:00:00.482) 0:01:13.793 ******* 2020-11-20T13:53:01.145 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T13:53:01.180 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:01 +0000 (0:00:00.042) 0:01:13.835 ******* 2020-11-20T13:53:01.342 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T13:53:01.344 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T13:53:01.385 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:01 +0000 (0:00:00.204) 0:01:14.040 ******* 2020-11-20T13:53:01.391 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T13:53:01.428 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:01 +0000 (0:00:00.042) 0:01:14.083 ******* 2020-11-20T13:53:01.591 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T13:53:01.593 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T13:53:01.626 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:01 +0000 (0:00:00.198) 0:01:14.281 ******* 2020-11-20T13:53:01.643 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T13:53:01.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:01 +0000 (0:00:00.070) 0:01:14.352 ******* 2020-11-20T13:53:01.852 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T13:53:01.853 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T13:53:01.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:01 +0000 (0:00:00.192) 0:01:14.544 ******* 2020-11-20T13:53:01.927 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T13:53:01.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:01 +0000 (0:00:00.074) 0:01:14.619 ******* 2020-11-20T13:53:02.364 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T13:53:02.366 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T13:53:02.397 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:02 +0000 (0:00:00.433) 0:01:15.053 ******* 2020-11-20T13:53:02.445 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T13:53:02.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:02 +0000 (0:00:00.083) 0:01:15.136 ******* 2020-11-20T13:53:02.881 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T13:53:02.882 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T13:53:02.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:02 +0000 (0:00:00.435) 0:01:15.571 ******* 2020-11-20T13:53:02.963 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T13:53:02.998 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:02 +0000 (0:00:00.082) 0:01:15.653 ******* 2020-11-20T13:53:04.817 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T13:53:04.818 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.700763", "end": "2020-11-20 13:53:04.793431", "rc": 0, "start": "2020-11-20 13:53:03.092668", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:04.850 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:04 +0000 (0:00:01.852) 0:01:17.506 ******* 2020-11-20T13:53:05.056 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.857656", "end": "2020-11-20 13:53:05.033605", "rc": 0, "start": "2020-11-20 13:53:03.175949", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:05.089 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:05 +0000 (0:00:00.238) 0:01:17.745 ******* 2020-11-20T13:53:05.356 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T13:53:05.357 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-11-20T13:53:05.596 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-11-20T13:53:05.805 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-11-20T13:53:06.046 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-11-20T13:53:06.256 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-11-20T13:53:06.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:06 +0000 (0:00:01.214) 0:01:18.959 ******* 2020-11-20T13:53:06.499 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-11-20T13:53:06.536 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:06 +0000 (0:00:00.231) 0:01:19.191 ******* 2020-11-20T13:53:06.791 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T13:53:06.793 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T13:53:06.828 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:06 +0000 (0:00:00.292) 0:01:19.484 ******* 2020-11-20T13:53:07.023 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T13:53:07.058 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:07 +0000 (0:00:00.230) 0:01:19.714 ******* 2020-11-20T13:53:07.323 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T13:53:07.325 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-11-20T13:53:07.544 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-11-20T13:53:07.775 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-11-20T13:53:08.005 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-11-20T13:53:08.228 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-11-20T13:53:08.265 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:01.206) 0:01:20.921 ******* 2020-11-20T13:53:08.292 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T13:53:08.325 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.060) 0:01:20.981 ******* 2020-11-20T13:53:08.352 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:08.386 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.060) 0:01:21.042 ******* 2020-11-20T13:53:08.423 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T13:53:08.425 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:08.434 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:08.470 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.084) 0:01:21.126 ******* 2020-11-20T13:53:08.477 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T13:53:08.477 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-11-20T13:53:08.516 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.045) 0:01:21.171 ******* 2020-11-20T13:53:08.524 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:08.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.043) 0:01:21.215 ******* 2020-11-20T13:53:08.567 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T13:53:08.608 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.048) 0:01:21.264 ******* 2020-11-20T13:53:08.616 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:08.618 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-11-20T13:53:08.653 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.045) 0:01:21.309 ******* 2020-11-20T13:53:08.659 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T13:53:08.661 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:08.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.040) 0:01:21.350 ******* 2020-11-20T13:53:08.699 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T13:53:08.701 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:08.736 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.041) 0:01:21.391 ******* 2020-11-20T13:53:08.741 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T13:53:08.743 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:08.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.042) 0:01:21.434 ******* 2020-11-20T13:53:08.784 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T13:53:08.786 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:08.819 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.040) 0:01:21.474 ******* 2020-11-20T13:53:08.824 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T13:53:08.826 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:08.865 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.046) 0:01:21.520 ******* 2020-11-20T13:53:08.893 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-11-20T13:53:08.929 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.063) 0:01:21.584 ******* 2020-11-20T13:53:08.968 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T13:53:08.970 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:09.000 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:08 +0000 (0:00:00.071) 0:01:21.655 ******* 2020-11-20T13:53:09.026 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T13:53:09.027 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:09.057 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:09 +0000 (0:00:00.057) 0:01:21.713 ******* 2020-11-20T13:53:09.063 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T13:53:09.063 INFO:teuthology.task.ansible.out:fatal: [smithi031.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007399", "end": "2020-11-20 13:53:09.018004", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 13:53:09.010605", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T13:53:09.097 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:09 +0000 (0:00:00.039) 0:01:21.753 ******* 2020-11-20T13:53:09.134 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T13:53:09.135 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:09.167 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:09 +0000 (0:00:00.069) 0:01:21.822 ******* 2020-11-20T13:53:09.287 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T13:53:09.289 INFO:teuthology.task.ansible.out:fatal: [smithi039.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007128", "end": "2020-11-20 13:53:09.264614", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 13:53:09.257486", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T13:53:09.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:09 +0000 (0:00:00.155) 0:01:21.977 ******* 2020-11-20T13:53:09.348 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T13:53:09.349 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:09.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:09 +0000 (0:00:00.057) 0:01:22.035 ******* 2020-11-20T13:53:11.440 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T13:53:11.442 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-20T13:53:11.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:11 +0000 (0:00:02.094) 0:01:24.130 ******* 2020-11-20T13:53:11.626 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-20T13:53:11.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:11 +0000 (0:00:00.185) 0:01:24.316 ******* 2020-11-20T13:53:13.384 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T13:53:13.385 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-11-20T13:53:13.421 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:13 +0000 (0:00:01.760) 0:01:26.077 ******* 2020-11-20T13:53:13.563 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-11-20T13:53:13.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:13 +0000 (0:00:00.177) 0:01:26.254 ******* 2020-11-20T13:53:16.373 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T13:53:16.375 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-11-20T13:53:16.419 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:16 +0000 (0:00:02.821) 0:01:29.075 ******* 2020-11-20T13:53:16.446 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T13:53:16.448 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:16.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:16 +0000 (0:00:00.061) 0:01:29.136 ******* 2020-11-20T13:53:16.706 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T13:53:16.707 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-11-20T13:53:16.743 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:16 +0000 (0:00:00.262) 0:01:29.399 ******* 2020-11-20T13:53:16.770 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T13:53:16.772 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:16.804 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:16 +0000 (0:00:00.060) 0:01:29.459 ******* 2020-11-20T13:53:17.465 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T13:53:17.467 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T13:53:17.503 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:17 +0000 (0:00:00.698) 0:01:30.158 ******* 2020-11-20T13:53:17.531 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:17.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:17 +0000 (0:00:00.064) 0:01:30.223 ******* 2020-11-20T13:53:17.848 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T13:53:17.850 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T13:53:17.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:17 +0000 (0:00:00.313) 0:01:30.537 ******* 2020-11-20T13:53:17.908 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T13:53:17.910 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:17.941 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:17 +0000 (0:00:00.059) 0:01:30.597 ******* 2020-11-20T13:53:18.000 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T13:53:18.001 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket basic.target system.slice dbus.service sysinit.target polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ipset.service iptables.service ip6tables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-11-20T13:53:18.003 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", 2020-11-20T13:53:18.004 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-11-20T13:53:18.006 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T13:53:18.036 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:18 +0000 (0:00:00.095) 0:01:30.692 ******* 2020-11-20T13:53:18.262 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target polkit.service basic.target dbus.socket system.slice dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service iptables.service ebtables.service ip6tables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-11-20T13:53:18.264 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", 2020-11-20T13:53:18.265 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-11-20T13:53:18.267 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T13:53:18.297 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:18 +0000 (0:00:00.260) 0:01:30.953 ******* 2020-11-20T13:53:18.334 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T13:53:18.336 INFO:teuthology.task.ansible.out:fatal: [smithi031.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T13:53:18.389 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:18 +0000 (0:00:00.091) 0:01:31.045 ******* 2020-11-20T13:53:18.603 INFO:teuthology.task.ansible.out:fatal: [smithi039.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} 2020-11-20T13:53:18.605 INFO:teuthology.task.ansible.out:...ignoring 2020-11-20T13:53:18.637 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:18 +0000 (0:00:00.247) 0:01:31.292 ******* 2020-11-20T13:53:18.955 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T13:53:18.957 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T13:53:18.988 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:18 +0000 (0:00:00.351) 0:01:31.644 ******* 2020-11-20T13:53:19.018 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.029) 0:01:31.674 ******* 2020-11-20T13:53:19.023 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T13:53:19.024 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.057 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.039) 0:01:31.713 ******* 2020-11-20T13:53:19.062 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.095 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.037) 0:01:31.751 ******* 2020-11-20T13:53:19.100 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T13:53:19.101 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.133 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.037) 0:01:31.789 ******* 2020-11-20T13:53:19.138 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.174 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.040) 0:01:31.829 ******* 2020-11-20T13:53:19.179 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T13:53:19.180 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.039) 0:01:31.868 ******* 2020-11-20T13:53:19.219 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.253 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.039) 0:01:31.908 ******* 2020-11-20T13:53:19.258 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T13:53:19.259 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.292 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.039) 0:01:31.948 ******* 2020-11-20T13:53:19.297 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.039) 0:01:31.988 ******* 2020-11-20T13:53:19.337 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T13:53:19.339 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.371 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.038) 0:01:32.026 ******* 2020-11-20T13:53:19.377 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.409 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.038) 0:01:32.065 ******* 2020-11-20T13:53:19.415 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T13:53:19.417 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.038) 0:01:32.103 ******* 2020-11-20T13:53:19.453 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.037) 0:01:32.140 ******* 2020-11-20T13:53:19.490 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T13:53:19.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.038) 0:01:32.179 ******* 2020-11-20T13:53:19.561 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.037) 0:01:32.216 ******* 2020-11-20T13:53:19.566 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T13:53:19.568 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.600 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.039) 0:01:32.256 ******* 2020-11-20T13:53:19.606 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.638 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.037) 0:01:32.294 ******* 2020-11-20T13:53:19.643 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T13:53:19.645 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.678 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.039) 0:01:32.333 ******* 2020-11-20T13:53:19.684 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.718 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.040) 0:01:32.374 ******* 2020-11-20T13:53:19.724 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T13:53:19.725 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.760 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.041) 0:01:32.415 ******* 2020-11-20T13:53:19.766 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.767 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.800 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.040) 0:01:32.456 ******* 2020-11-20T13:53:19.806 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T13:53:19.808 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.840 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.039) 0:01:32.495 ******* 2020-11-20T13:53:19.847 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:19.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.041) 0:01:32.537 ******* 2020-11-20T13:53:19.888 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T13:53:19.926 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.044) 0:01:32.581 ******* 2020-11-20T13:53:19.965 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:19 +0000 (0:00:00.038) 0:01:32.620 ******* 2020-11-20T13:53:19.970 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T13:53:19.971 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.006 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.041) 0:01:32.661 ******* 2020-11-20T13:53:20.012 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.044 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:32.699 ******* 2020-11-20T13:53:20.048 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T13:53:20.050 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.082 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:32.738 ******* 2020-11-20T13:53:20.088 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.121 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:32.777 ******* 2020-11-20T13:53:20.128 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T13:53:20.129 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.162 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.040) 0:01:32.817 ******* 2020-11-20T13:53:20.168 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.201 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.039) 0:01:32.856 ******* 2020-11-20T13:53:20.206 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T13:53:20.208 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.240 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:32.895 ******* 2020-11-20T13:53:20.245 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.278 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:32.934 ******* 2020-11-20T13:53:20.283 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T13:53:20.285 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.317 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:32.973 ******* 2020-11-20T13:53:20.323 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.039) 0:01:33.012 ******* 2020-11-20T13:53:20.361 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T13:53:20.363 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.396 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.039) 0:01:33.051 ******* 2020-11-20T13:53:20.401 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.433 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.037) 0:01:33.088 ******* 2020-11-20T13:53:20.437 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-20T13:53:20.439 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.471 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:33.127 ******* 2020-11-20T13:53:20.477 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.039) 0:01:33.166 ******* 2020-11-20T13:53:20.515 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T13:53:20.517 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.547 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.037) 0:01:33.203 ******* 2020-11-20T13:53:20.552 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.585 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.037) 0:01:33.240 ******* 2020-11-20T13:53:20.589 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T13:53:20.591 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.037) 0:01:33.278 ******* 2020-11-20T13:53:20.629 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:33.317 ******* 2020-11-20T13:53:20.666 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-20T13:53:20.668 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.703 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.041) 0:01:33.358 ******* 2020-11-20T13:53:20.708 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.740 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.037) 0:01:33.396 ******* 2020-11-20T13:53:20.745 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T13:53:20.747 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.779 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:33.435 ******* 2020-11-20T13:53:20.785 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.818 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.038) 0:01:33.473 ******* 2020-11-20T13:53:20.823 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T13:53:20.825 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.857 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.039) 0:01:33.513 ******* 2020-11-20T13:53:20.865 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.898 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.040) 0:01:33.554 ******* 2020-11-20T13:53:20.903 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T13:53:20.904 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.936 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.037) 0:01:33.591 ******* 2020-11-20T13:53:20.941 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:20.975 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:20 +0000 (0:00:00.039) 0:01:33.631 ******* 2020-11-20T13:53:20.981 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T13:53:20.983 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.014 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.038) 0:01:33.670 ******* 2020-11-20T13:53:21.020 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.053 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:33.709 ******* 2020-11-20T13:53:21.059 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T13:53:21.060 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.093 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:33.749 ******* 2020-11-20T13:53:21.099 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.132 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.038) 0:01:33.787 ******* 2020-11-20T13:53:21.137 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T13:53:21.139 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.171 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:33.827 ******* 2020-11-20T13:53:21.177 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.038) 0:01:33.866 ******* 2020-11-20T13:53:21.215 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T13:53:21.216 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.249 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:33.905 ******* 2020-11-20T13:53:21.255 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.289 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:33.944 ******* 2020-11-20T13:53:21.294 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T13:53:21.297 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.328 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:33.984 ******* 2020-11-20T13:53:21.333 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.367 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.038) 0:01:34.022 ******* 2020-11-20T13:53:21.372 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T13:53:21.373 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.404 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.037) 0:01:34.060 ******* 2020-11-20T13:53:21.409 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.442 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.037) 0:01:34.098 ******* 2020-11-20T13:53:21.447 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T13:53:21.449 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.043) 0:01:34.141 ******* 2020-11-20T13:53:21.491 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.038) 0:01:34.179 ******* 2020-11-20T13:53:21.529 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T13:53:21.530 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.562 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.038) 0:01:34.218 ******* 2020-11-20T13:53:21.568 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.600 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.037) 0:01:34.256 ******* 2020-11-20T13:53:21.605 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T13:53:21.607 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.640 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:34.295 ******* 2020-11-20T13:53:21.645 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.679 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:34.335 ******* 2020-11-20T13:53:21.684 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:21.686 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.718 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.038) 0:01:34.374 ******* 2020-11-20T13:53:21.724 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:34.413 ******* 2020-11-20T13:53:21.763 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T13:53:21.764 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.796 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.038) 0:01:34.452 ******* 2020-11-20T13:53:21.802 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.836 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.040) 0:01:34.492 ******* 2020-11-20T13:53:21.842 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T13:53:21.844 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.876 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.039) 0:01:34.532 ******* 2020-11-20T13:53:21.882 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.038) 0:01:34.570 ******* 2020-11-20T13:53:21.920 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T13:53:21.922 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:21.962 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:21 +0000 (0:00:00.046) 0:01:34.617 ******* 2020-11-20T13:53:21.968 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:22.003 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.041) 0:01:34.658 ******* 2020-11-20T13:53:22.008 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T13:53:22.010 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:22.054 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.051) 0:01:34.710 ******* 2020-11-20T13:53:22.061 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:22.099 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.044) 0:01:34.755 ******* 2020-11-20T13:53:22.272 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T13:53:22.274 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-11-20T13:53:22.306 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.206) 0:01:34.961 ******* 2020-11-20T13:53:22.322 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-11-20T13:53:22.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.050) 0:01:35.012 ******* 2020-11-20T13:53:22.536 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T13:53:22.578 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.221) 0:01:35.233 ******* 2020-11-20T13:53:22.584 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T13:53:22.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.041) 0:01:35.274 ******* 2020-11-20T13:53:22.795 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T13:53:22.797 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-11-20T13:53:22.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.211) 0:01:35.486 ******* 2020-11-20T13:53:22.837 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-11-20T13:53:22.870 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.039) 0:01:35.526 ******* 2020-11-20T13:53:22.876 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T13:53:22.879 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:22.911 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.040) 0:01:35.566 ******* 2020-11-20T13:53:22.916 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:22.950 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.038) 0:01:35.605 ******* 2020-11-20T13:53:22.955 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T13:53:22.957 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:22.990 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:22 +0000 (0:00:00.040) 0:01:35.645 ******* 2020-11-20T13:53:22.995 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.027 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.037) 0:01:35.683 ******* 2020-11-20T13:53:23.034 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T13:53:23.035 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.067 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:35.722 ******* 2020-11-20T13:53:23.073 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:35.762 ******* 2020-11-20T13:53:23.112 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T13:53:23.113 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.145 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:35.801 ******* 2020-11-20T13:53:23.151 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.186 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.040) 0:01:35.841 ******* 2020-11-20T13:53:23.191 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T13:53:23.193 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.225 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:35.880 ******* 2020-11-20T13:53:23.230 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.264 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:35.919 ******* 2020-11-20T13:53:23.269 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T13:53:23.270 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.303 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:35.958 ******* 2020-11-20T13:53:23.308 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.341 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:35.997 ******* 2020-11-20T13:53:23.346 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T13:53:23.347 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:36.037 ******* 2020-11-20T13:53:23.387 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.420 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:36.076 ******* 2020-11-20T13:53:23.425 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T13:53:23.427 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:36.114 ******* 2020-11-20T13:53:23.465 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.501 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.042) 0:01:36.157 ******* 2020-11-20T13:53:23.506 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T13:53:23.508 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:36.195 ******* 2020-11-20T13:53:23.545 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.580 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:36.235 ******* 2020-11-20T13:53:23.585 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T13:53:23.587 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:36.275 ******* 2020-11-20T13:53:23.625 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.658 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:36.314 ******* 2020-11-20T13:53:23.663 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T13:53:23.664 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:36.353 ******* 2020-11-20T13:53:23.702 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.736 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:36.391 ******* 2020-11-20T13:53:23.741 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T13:53:23.743 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.775 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:36.431 ******* 2020-11-20T13:53:23.781 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.814 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:36.470 ******* 2020-11-20T13:53:23.819 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T13:53:23.821 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.852 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:36.508 ******* 2020-11-20T13:53:23.858 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.891 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:36.547 ******* 2020-11-20T13:53:23.897 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T13:53:23.898 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.930 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.038) 0:01:36.586 ******* 2020-11-20T13:53:23.936 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:23.969 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:23 +0000 (0:00:00.039) 0:01:36.625 ******* 2020-11-20T13:53:23.975 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T13:53:23.977 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.009 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.039) 0:01:36.665 ******* 2020-11-20T13:53:24.014 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.047 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.038) 0:01:36.703 ******* 2020-11-20T13:53:24.053 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T13:53:24.054 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.039) 0:01:36.742 ******* 2020-11-20T13:53:24.092 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.126 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.038) 0:01:36.781 ******* 2020-11-20T13:53:24.131 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T13:53:24.132 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.166 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.039) 0:01:36.821 ******* 2020-11-20T13:53:24.171 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.039) 0:01:36.861 ******* 2020-11-20T13:53:24.210 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T13:53:24.212 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.244 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.039) 0:01:36.900 ******* 2020-11-20T13:53:24.250 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.287 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.042) 0:01:36.943 ******* 2020-11-20T13:53:24.293 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T13:53:24.295 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.327 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.039) 0:01:36.982 ******* 2020-11-20T13:53:24.332 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.039) 0:01:37.021 ******* 2020-11-20T13:53:24.371 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T13:53:24.373 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.406 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.039) 0:01:37.061 ******* 2020-11-20T13:53:24.411 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.444 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.037) 0:01:37.099 ******* 2020-11-20T13:53:24.449 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T13:53:24.450 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.482 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.038) 0:01:37.138 ******* 2020-11-20T13:53:24.488 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.038) 0:01:37.176 ******* 2020-11-20T13:53:24.525 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T13:53:24.527 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.559 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.038) 0:01:37.215 ******* 2020-11-20T13:53:24.565 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.598 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.039) 0:01:37.254 ******* 2020-11-20T13:53:24.605 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:24.607 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T13:53:24.639 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.040) 0:01:37.294 ******* 2020-11-20T13:53:24.644 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T13:53:24.679 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.040) 0:01:37.334 ******* 2020-11-20T13:53:24.685 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T13:53:24.686 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} ok: [smithi031.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T13:53:24.697 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.698 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.708 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.709 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.719 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.721 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.759 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.079) 0:01:37.414 ******* 2020-11-20T13:53:24.765 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T13:53:24.765 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.766 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.766 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.767 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.767 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:24.805 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.046) 0:01:37.461 ******* 2020-11-20T13:53:24.934 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T13:53:24.936 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002805", "end": "2020-11-20 13:53:24.913347", "rc": 0, "start": "2020-11-20 13:53:24.910542", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T13:53:24.972 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:24 +0000 (0:00:00.167) 0:01:37.628 ******* 2020-11-20T13:53:25.000 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003325", "end": "2020-11-20 13:53:24.978366", "rc": 0, "start": "2020-11-20 13:53:24.975041", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T13:53:25.001 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:25.036 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:25 +0000 (0:00:00.063) 0:01:37.691 ******* 2020-11-20T13:53:25.073 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:25 +0000 (0:00:00.036) 0:01:37.728 ******* 2020-11-20T13:53:25.078 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T13:53:25.080 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:25.113 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:25 +0000 (0:00:00.040) 0:01:37.769 ******* 2020-11-20T13:53:25.119 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-20T13:53:25.120 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:25.157 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:25 +0000 (0:00:00.043) 0:01:37.812 ******* 2020-11-20T13:53:25.162 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T13:53:25.164 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:25.197 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:25 +0000 (0:00:00.040) 0:01:37.853 ******* 2020-11-20T13:53:25.203 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T13:53:25.204 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:25.236 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:25 +0000 (0:00:00.038) 0:01:37.891 ******* 2020-11-20T13:53:25.241 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T13:53:25.243 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:25.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:25 +0000 (0:00:00.039) 0:01:37.931 ******* 2020-11-20T13:53:25.282 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T13:53:25.283 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:25.316 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:25 +0000 (0:00:00.040) 0:01:37.972 ******* 2020-11-20T13:53:25.344 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T13:53:25.345 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:25.376 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:25 +0000 (0:00:00.059) 0:01:38.032 ******* 2020-11-20T13:53:26.250 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T13:53:26.251 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T13:53:26.282 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:26 +0000 (0:00:00.905) 0:01:38.938 ******* 2020-11-20T13:53:26.319 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T13:53:26.321 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529198080, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179980, 'block_used': 12915128, 'inode_total': 61054976, 'inode_available': 60990120, 'inode_used': 64856, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179980, "block_size": 4096, "block_total": 240095108, "block_used": 12915128, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990120, "inode_total": 61054976, "inode_used": 64856, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529198080, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}} 2020-11-20T13:53:26.352 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:26 +0000 (0:00:00.069) 0:01:39.007 ******* 2020-11-20T13:53:26.357 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T13:53:26.359 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T13:53:26.391 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:26 +0000 (0:00:00.039) 0:01:39.046 ******* 2020-11-20T13:53:26.426 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T13:53:26.428 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529226752, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179987, 'block_used': 12915121, 'inode_total': 61054976, 'inode_available': 60990120, 'inode_used': 64856, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179987, "block_size": 4096, "block_total": 240095108, "block_used": 12915121, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990120, "inode_total": 61054976, "inode_used": 64856, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529226752, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}} 2020-11-20T13:53:26.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:26 +0000 (0:00:00.068) 0:01:39.115 ******* 2020-11-20T13:53:26.547 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T13:53:26.592 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005234", "end": "2020-11-20 13:53:26.530118", "rc": 0, "start": "2020-11-20 13:53:26.524884", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Friday 20 November 2020 13:53:26 +0000 (0:00:00.127) 0:01:39.242 ******* 2020-11-20T13:53:26.623 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T13:53:26.625 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529198080, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179980, 'block_used': 12915128, 'inode_total': 61054976, 'inode_available': 60990120, 'inode_used': 64856, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179980, "block_size": 4096, "block_total": 240095108, "block_used": 12915128, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990120, "inode_total": 61054976, "inode_used": 64856, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529198080, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:26.657 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:26 +0000 (0:00:00.070) 0:01:39.313 ******* 2020-11-20T13:53:26.664 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T13:53:26.666 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005347", "end": "2020-11-20 13:53:26.639830", "rc": 0, "start": "2020-11-20 13:53:26.634483", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:26.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:26 +0000 (0:00:00.039) 0:01:39.352 ******* 2020-11-20T13:53:26.702 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T13:53:26.736 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:26 +0000 (0:00:00.039) 0:01:39.392 ******* 2020-11-20T13:53:26.742 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T13:53:26.743 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529226752, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179987, 'block_used': 12915121, 'inode_total': 61054976, 'inode_available': 60990120, 'inode_used': 64856, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179987, "block_size": 4096, "block_total": 240095108, "block_used": 12915121, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990120, "inode_total": 61054976, "inode_used": 64856, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529226752, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:26.777 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:26 +0000 (0:00:00.040) 0:01:39.432 ******* 2020-11-20T13:53:26.802 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T13:53:26.835 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:26 +0000 (0:00:00.058) 0:01:39.490 ******* 2020-11-20T13:53:28.192 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T13:53:28.194 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXJdg2Qb5Zm1nzbU9wm0mVpngxrDj14sX4'], 'uuids': ['9098f196-ec24-4388-9125-acc42f807a4a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.231206", "end": "2020-11-20 13:53:28.160701", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXJdg2Qb5Zm1nzbU9wm0mVpngxrDj14sX4"], "labels": [], "masters": [], "uuids": ["9098f196-ec24-4388-9125-acc42f807a4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:26.929495", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:28.464 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqf6wqQXByRkZdel6daoAFppuUZebu53Q31'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.399988", "end": "2020-11-20 13:53:28.429384", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqf6wqQXByRkZdel6daoAFppuUZebu53Q31"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:27.029396", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:29.459 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-bzn7CA-UJ6l-OfiH-PSGH-xXBJ-2s0j-qVItJX', 'nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN', 'nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.062765", "end": "2020-11-20 13:53:29.428264", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-bzn7CA-UJ6l-OfiH-PSGH-xXBJ-2s0j-qVItJX", "nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN", "nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:28.365499", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T13:53:29.461 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:29.741 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-DubUMB-BCSc-tW8e-K5ty-EH7x-celv-OnPHmo', 'nvme-INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN', 'nvme-eui.0100000001000000e4d25c000034df14'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDKE040T7', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '7814037168', 'sectorsize': '512', 'size': '3.64 TB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.072803", "end": "2020-11-20 13:53:29.709280", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-DubUMB-BCSc-tW8e-K5ty-EH7x-celv-OnPHmo", "nvme-INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:28.636477", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_li 2020-11-20T13:53:29.743 INFO:teuthology.task.ansible.out:nes": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:30.715 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXf25kpnSQz2e33AA9BD4W2l5Fu9SPg1Kh'], 'uuids': ['efcd05ad-cb57-46f2-92e0-454d55d5056f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.043813", "end": "2020-11-20 13:53:30.677647", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXf25kpnSQz2e33AA9BD4W2l5Fu9SPg1Kh"], "labels": [], "masters": [], "uuids": ["efcd05ad-cb57-46f2-92e0-454d55d5056f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:29.633834", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:30.995 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfwJ9Ckrp8vXLhx9Cgb1S6f9bCOnUllkzW'], 'uuids': ['bce55cd2-15ad-44a3-a3b6-0017bb973d01'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.053553", "end": "2020-11-20 13:53:30.963800", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfwJ9Ckrp8vXLhx9Cgb1S6f9bCOnUllkzW"], "labels": [], "masters": [], "uuids": ["bce55cd2-15ad-44a3-a3b6-0017bb973d01"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:29.910247", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:31.949 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXQzGgy4YGOuP49oFSNNK7A2tAfbarvUPK'], 'uuids': ['a149a2b5-5676-45dc-80df-27442b75e7bb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.035586", "end": "2020-11-20 13:53:31.919431", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXQzGgy4YGOuP49oFSNNK7A2tAfbarvUPK"], "labels": [], "masters": [], "uuids": ["a149a2b5-5676-45dc-80df-27442b75e7bb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:30.883845", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:32.261 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqflqlKpQvFsahNQAmx2OloOEIY1892Sucy'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.062390", "end": "2020-11-20 13:53:32.230011", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqflqlKpQvFsahNQAmx2OloOEIY1892Sucy"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:31.167621", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:33.216 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXIzcFVu9URcoKXwYkscyDesyMBfq0PKuf'], 'uuids': ['f3d0497b-5094-497e-a88d-03338a80a6cb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.063380", "end": "2020-11-20 13:53:33.186965", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXIzcFVu9URcoKXwYkscyDesyMBfq0PKuf"], "labels": [], "masters": [], "uuids": ["f3d0497b-5094-497e-a88d-03338a80a6cb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:32.123585", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:33.228 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW', 'wwn-0x5000c500871a7b41'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HQEW', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a7b41', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1', 'wwn-0x5000c500871a7b41-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW", "wwn-0x5000c500871a7b41"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1", "wwn-0x5000c500871a7b41-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQEW", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a7b41"}}, 2020-11-20T13:53:33.229 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T13:53:33.508 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfMO05XJl9Ca4nep4uPX5je2Ybxd67Bmkl'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.046240", "end": "2020-11-20 13:53:33.481036", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfMO05XJl9Ca4nep4uPX5je2Ybxd67Bmkl"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:32.434796", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:33.520 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ5B', 'wwn-0x5000c500871a8bce'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HQ5B', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a8bce', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ5B-part1', 'wwn-0x5000c500871a8bce-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ5B", "wwn-0x5000c500871a8bce"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ5B-part1", "wwn-0x5000c500871a8bce-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQ5B", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a8bce"}}, 2020-11-20T13:53:33.522 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T13:53:34.462 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXpCOagw6D5U7hGQFjafu6U11D9yaLuvyh'], 'uuids': ['b173d3c7-b464-41c2-a802-29111ba3a2b8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.038296", "end": "2020-11-20 13:53:34.428161", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXpCOagw6D5U7hGQFjafu6U11D9yaLuvyh"], "labels": [], "masters": [], "uuids": ["b173d3c7-b464-41c2-a802-29111ba3a2b8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:33.389865", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:34.502 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:34 +0000 (0:00:07.667) 0:01:47.157 ******* 2020-11-20T13:53:34.768 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfGzEOSVEAuFnax7yWeegfPjsq51UKgLV2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.050753", "end": "2020-11-20 13:53:34.741011", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfGzEOSVEAuFnax7yWeegfPjsq51UKgLV2"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:33.690258", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T13:53:34.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:34 +0000 (0:00:00.308) 0:01:47.466 ******* 2020-11-20T13:53:34.878 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T13:53:34.880 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXJdg2Qb5Zm1nzbU9wm0mVpngxrDj14sX4'], 'uuids': ['9098f196-ec24-4388-9125-acc42f807a4a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.147529", "end": "2020-11-20 13:53:34.850140", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXJdg2Qb5Zm1nzbU9wm0mVpngxrDj14sX4"], "labels": [], "masters": [], "uuids": ["9098f196-ec24-4388-9125-acc42f807a4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:34.702611", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144814 s, 796 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144814 s, 796 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:35.098 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-bzn7CA-UJ6l-OfiH-PSGH-xXBJ-2s0j-qVItJX', 'nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN', 'nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036225", "end": "2020-11-20 13:53:35.075474", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-bzn7CA-UJ6l-OfiH-PSGH-xXBJ-2s0j-qVItJX", "nvme-INTEL_SSDPEDMD400G4_CVFT53310008400BGN", "nvme-nvme.8086-43564654353333313030303834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:35.039249", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0335319 s, 3.4 GB/s", "std 2020-11-20T13:53:35.100 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0335319 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:35.203 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqf6wqQXByRkZdel6daoAFppuUZebu53Q31'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.154140", "end": "2020-11-20 13:53:35.170652", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqf6wqQXByRkZdel6daoAFppuUZebu53Q31"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:35.016512", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151491 s, 761 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151491 s, 761 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:35.423 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-DubUMB-BCSc-tW8e-K5ty-EH7x-celv-OnPHmo', 'nvme-INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN', 'nvme-eui.0100000001000000e4d25c000034df14'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDKE040T7', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '7814037168', 'sectorsize': '512', 'size': '3.64 TB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036303", "end": "2020-11-20 13:53:35.396027", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-DubUMB-BCSc-tW8e-K5ty-EH7x-celv-OnPHmo", "nvme-INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:35.359724", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0335977 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 2020-11-20T13:53:35.425 INFO:teuthology.task.ansible.out:MB, 110 MiB) copied, 0.0335977 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:35.435 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXf25kpnSQz2e33AA9BD4W2l5Fu9SPg1Kh'], 'uuids': ['efcd05ad-cb57-46f2-92e0-454d55d5056f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139383", "end": "2020-11-20 13:53:35.413031", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXf25kpnSQz2e33AA9BD4W2l5Fu9SPg1Kh"], "labels": [], "masters": [], "uuids": ["efcd05ad-cb57-46f2-92e0-454d55d5056f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:35.273648", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136703 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136703 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:35.767 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXQzGgy4YGOuP49oFSNNK7A2tAfbarvUPK'], 'uuids': ['a149a2b5-5676-45dc-80df-27442b75e7bb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.139694", "end": "2020-11-20 13:53:35.738464", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXQzGgy4YGOuP49oFSNNK7A2tAfbarvUPK"], "labels": [], "masters": [], "uuids": ["a149a2b5-5676-45dc-80df-27442b75e7bb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:35.598770", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137054 s, 842 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137054 s, 842 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:35.768 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfwJ9Ckrp8vXLhx9Cgb1S6f9bCOnUllkzW'], 'uuids': ['bce55cd2-15ad-44a3-a3b6-0017bb973d01'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.157941", "end": "2020-11-20 13:53:35.744191", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfwJ9Ckrp8vXLhx9Cgb1S6f9bCOnUllkzW"], "labels": [], "masters": [], "uuids": ["bce55cd2-15ad-44a3-a3b6-0017bb973d01"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:35.586250", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155243 s, 743 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155243 s, 743 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:36.089 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXIzcFVu9URcoKXwYkscyDesyMBfq0PKuf'], 'uuids': ['f3d0497b-5094-497e-a88d-03338a80a6cb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.140761", "end": "2020-11-20 13:53:36.067618", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXIzcFVu9URcoKXwYkscyDesyMBfq0PKuf"], "labels": [], "masters": [], "uuids": ["f3d0497b-5094-497e-a88d-03338a80a6cb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:35.926857", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138194 s, 835 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138194 s, 835 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:36.101 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW', 'wwn-0x5000c500871a7b41'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HQEW', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a7b41', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1', 'wwn-0x5000c500871a7b41-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW", "wwn-0x5000c500871a7b41"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQEW-part1", "wwn-0x5000c500871a7b41-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQEW", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a7b41"}}, 2020-11-20T13:53:36.103 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T13:53:36.113 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqflqlKpQvFsahNQAmx2OloOEIY1892Sucy'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.153887", "end": "2020-11-20 13:53:36.083231", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqflqlKpQvFsahNQAmx2OloOEIY1892Sucy"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:35.929344", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.1513 s, 762 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.1513 s, 762 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:36.435 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXpCOagw6D5U7hGQFjafu6U11D9yaLuvyh'], 'uuids': ['b173d3c7-b464-41c2-a802-29111ba3a2b8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139373", "end": "2020-11-20 13:53:36.409623", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2ALYNfA71Gvv7umfdmDEzwVJbgm8B7MXpCOagw6D5U7hGQFjafu6U11D9yaLuvyh"], "labels": [], "masters": [], "uuids": ["b173d3c7-b464-41c2-a802-29111ba3a2b8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:36.270250", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136729 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136729 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:36.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:36 +0000 (0:00:01.664) 0:01:49.130 ******* 2020-11-20T13:53:36.481 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfMO05XJl9Ca4nep4uPX5je2Ybxd67Bmkl'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.146912", "end": "2020-11-20 13:53:36.417151", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfMO05XJl9Ca4nep4uPX5je2Ybxd67Bmkl"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:36.270239", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144255 s, 800 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144255 s, 800 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:36.483 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ5B', 'wwn-0x5000c500871a8bce'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HQ5B', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a8bce', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ5B-part1', 'wwn-0x5000c500871a8bce-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ5B", "wwn-0x5000c500871a8bce"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ5B-part1", "wwn-0x5000c500871a8bce-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQ5B", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a8bce"}}, 2020-11-20T13:53:36.485 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T13:53:36.743 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T13:53:36.745 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.066075", "end": "2020-11-20 13:53:36.713068", "rc": 0, "start": "2020-11-20 13:53:36.646993", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:36.776 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:36 +0000 (0:00:00.301) 0:01:49.432 ******* 2020-11-20T13:53:36.793 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T13:53:36.795 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfGzEOSVEAuFnax7yWeegfPjsq51UKgLV2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.148691", "end": "2020-11-20 13:53:36.760293", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-oEEyM37QLE6KrfI8a98bZKcMDvIW0rqfGzEOSVEAuFnax7yWeegfPjsq51UKgLV2"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 13:53:36.611602", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145921 s, 790 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145921 s, 790 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:36.832 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:36 +0000 (0:00:00.055) 0:01:49.488 ******* 2020-11-20T13:53:37.025 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T13:53:37.027 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.050274", "end": "2020-11-20 13:53:37.000032", "rc": 0, "start": "2020-11-20 13:53:36.949758", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:37.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.227) 0:01:49.715 ******* 2020-11-20T13:53:37.086 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T13:53:37.121 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.061) 0:01:49.777 ******* 2020-11-20T13:53:37.127 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T13:53:37.129 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.066918", "end": "2020-11-20 13:53:37.073582", "rc": 0, "start": "2020-11-20 13:53:37.006664", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:37.161 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.039) 0:01:49.816 ******* 2020-11-20T13:53:37.166 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T13:53:37.167 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.201 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.040) 0:01:49.857 ******* 2020-11-20T13:53:37.226 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T13:53:37.227 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.258 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.056) 0:01:49.913 ******* 2020-11-20T13:53:37.284 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T13:53:37.285 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.319 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.061) 0:01:49.975 ******* 2020-11-20T13:53:37.345 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T13:53:37.347 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.379 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.059) 0:01:50.034 ******* 2020-11-20T13:53:37.405 INFO:teuthology.task.ansible.out: 2020-11-20T13:53:37.407 INFO:teuthology.task.ansible.out:TASK [testnode : Check for physical volumes] *********************************** changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.047948", "end": "2020-11-20 13:53:37.380400", "rc": 0, "start": "2020-11-20 13:53:37.332452", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:37.444 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.065) 0:01:50.100 ******* 2020-11-20T13:53:37.474 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T13:53:37.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.063) 0:01:50.163 ******* 2020-11-20T13:53:37.534 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T13:53:37.535 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.569 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.061) 0:01:50.224 ******* 2020-11-20T13:53:37.585 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T13:53:37.587 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T13:53:37.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.050) 0:01:50.275 ******* 2020-11-20T13:53:37.625 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T13:53:37.627 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.041) 0:01:50.316 ******* 2020-11-20T13:53:37.666 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T13:53:37.667 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529198080, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179980, 'block_used': 12915128, 'inode_total': 61054976, 'inode_available': 60990120, 'inode_used': 64856, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179980, "block_size": 4096, "block_total": 240095108, "block_used": 12915128, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990120, "inode_total": 61054976, "inode_used": 64856, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529198080, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.700 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.039) 0:01:50.356 ******* 2020-11-20T13:53:37.706 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T13:53:37.708 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.746 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.045) 0:01:50.402 ******* 2020-11-20T13:53:37.752 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T13:53:37.753 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.786 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.040) 0:01:50.442 ******* 2020-11-20T13:53:37.793 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T13:53:37.795 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.042) 0:01:50.485 ******* 2020-11-20T13:53:37.835 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:37.836 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.041) 0:01:50.526 ******* 2020-11-20T13:53:37.897 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:37.899 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.930 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.058) 0:01:50.585 ******* 2020-11-20T13:53:37.956 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T13:53:37.958 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:37.990 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:37 +0000 (0:00:00.060) 0:01:50.646 ******* 2020-11-20T13:53:38.017 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:38.050 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.059) 0:01:50.706 ******* 2020-11-20T13:53:38.056 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T13:53:38.058 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T13:53:38.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.041) 0:01:50.747 ******* 2020-11-20T13:53:38.097 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T13:53:38.099 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:38.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.042) 0:01:50.789 ******* 2020-11-20T13:53:38.140 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T13:53:38.141 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930529226752, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227179987, 'block_used': 12915121, 'inode_total': 61054976, 'inode_available': 60990120, 'inode_used': 64856, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227179987, "block_size": 4096, "block_total": 240095108, "block_used": 12915121, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990120, "inode_total": 61054976, "inode_used": 64856, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930529226752, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:38.175 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.041) 0:01:50.831 ******* 2020-11-20T13:53:38.201 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T13:53:38.203 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:38.234 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.059) 0:01:50.890 ******* 2020-11-20T13:53:38.260 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:38.262 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:38.293 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.058) 0:01:50.948 ******* 2020-11-20T13:53:38.319 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:38.321 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:38.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.061) 0:01:51.010 ******* 2020-11-20T13:53:38.381 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T13:53:38.382 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:38.414 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.060) 0:01:51.070 ******* 2020-11-20T13:53:38.440 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T13:53:38.442 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:38.473 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.058) 0:01:51.128 ******* 2020-11-20T13:53:38.499 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T13:53:38.500 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:38.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.057) 0:01:51.186 ******* 2020-11-20T13:53:38.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T13:53:38.852 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T13:53:38.884 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:38 +0000 (0:00:00.354) 0:01:51.540 ******* 2020-11-20T13:53:38.984 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T13:53:39.022 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:39 +0000 (0:00:00.137) 0:01:51.677 ******* 2020-11-20T13:53:39.484 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T13:53:39.486 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:39.496 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:39.818 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:39.829 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:40.151 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:40.162 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:40.507 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:40.508 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:40.841 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:40.846 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T13:53:40.886 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:40 +0000 (0:00:01.864) 0:01:53.541 ******* 2020-11-20T13:53:40.919 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:40 +0000 (0:00:00.032) 0:01:53.574 ******* 2020-11-20T13:53:41.091 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T13:53:41.093 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T13:53:41.148 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:41 +0000 (0:00:00.228) 0:01:53.803 ******* 2020-11-20T13:53:41.157 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T13:53:41.193 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:41 +0000 (0:00:00.044) 0:01:53.848 ******* 2020-11-20T13:53:41.366 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T13:53:41.368 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T13:53:41.420 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T13:53:41.557 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T13:53:41.610 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T13:53:41.746 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T13:53:41.799 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T13:53:41.935 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T13:53:41.946 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:41.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:41 +0000 (0:00:00.789) 0:01:54.638 ******* 2020-11-20T13:53:41.990 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T13:53:42.001 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:42.039 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:42 +0000 (0:00:00.056) 0:01:54.695 ******* 2020-11-20T13:53:42.191 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T13:53:42.193 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T13:53:42.226 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:42 +0000 (0:00:00.186) 0:01:54.881 ******* 2020-11-20T13:53:42.243 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T13:53:42.278 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:42 +0000 (0:00:00.052) 0:01:54.934 ******* 2020-11-20T13:53:42.284 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T13:53:42.286 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T13:53:42.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:42 +0000 (0:00:00.043) 0:01:54.978 ******* 2020-11-20T13:53:42.329 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T13:53:42.363 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:42 +0000 (0:00:00.041) 0:01:55.019 ******* 2020-11-20T13:53:42.859 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T13:53:42.861 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true} 2020-11-20T13:53:42.896 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:42 +0000 (0:00:00.533) 0:01:55.552 ******* 2020-11-20T13:53:43.027 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true} 2020-11-20T13:53:43.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.163) 0:01:55.716 ******* 2020-11-20T13:53:43.452 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T13:53:43.453 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T13:53:43.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.424) 0:01:56.140 ******* 2020-11-20T13:53:43.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.033) 0:01:56.174 ******* 2020-11-20T13:53:43.523 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T13:53:43.524 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.037) 0:01:56.212 ******* 2020-11-20T13:53:43.562 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.595 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.039) 0:01:56.251 ******* 2020-11-20T13:53:43.601 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T13:53:43.602 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.039) 0:01:56.290 ******* 2020-11-20T13:53:43.640 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.675 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.039) 0:01:56.330 ******* 2020-11-20T13:53:43.680 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T13:53:43.682 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.039) 0:01:56.370 ******* 2020-11-20T13:53:43.720 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.753 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.038) 0:01:56.409 ******* 2020-11-20T13:53:43.759 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T13:53:43.760 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.793 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.039) 0:01:56.449 ******* 2020-11-20T13:53:43.798 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.832 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.038) 0:01:56.487 ******* 2020-11-20T13:53:43.837 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-20T13:53:43.839 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.872 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.039) 0:01:56.527 ******* 2020-11-20T13:53:43.878 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.911 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.039) 0:01:56.566 ******* 2020-11-20T13:53:43.918 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T13:53:43.919 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.951 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.039) 0:01:56.606 ******* 2020-11-20T13:53:43.957 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:43.991 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:43 +0000 (0:00:00.039) 0:01:56.646 ******* 2020-11-20T13:53:43.996 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T13:53:43.998 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.031 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.040) 0:01:56.687 ******* 2020-11-20T13:53:44.037 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.070 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.039) 0:01:56.726 ******* 2020-11-20T13:53:44.076 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T13:53:44.077 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.109 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.039) 0:01:56.765 ******* 2020-11-20T13:53:44.115 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.147 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.037) 0:01:56.803 ******* 2020-11-20T13:53:44.152 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T13:53:44.154 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.187 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.039) 0:01:56.842 ******* 2020-11-20T13:53:44.193 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.226 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.039) 0:01:56.882 ******* 2020-11-20T13:53:44.233 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-20T13:53:44.234 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.265 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.039) 0:01:56.921 ******* 2020-11-20T13:53:44.271 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.310 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.044) 0:01:56.965 ******* 2020-11-20T13:53:44.315 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T13:53:44.317 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.349 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.038) 0:01:57.004 ******* 2020-11-20T13:53:44.353 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:44.387 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.038) 0:01:57.043 ******* 2020-11-20T13:53:44.828 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T13:53:44.830 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T13:53:44.863 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.475) 0:01:57.519 ******* 2020-11-20T13:53:44.869 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T13:53:44.903 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:44 +0000 (0:00:00.040) 0:01:57.559 ******* 2020-11-20T13:53:45.180 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T13:53:45.181 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 13:50:33 UTC", "ActiveEnterTimestampMonotonic": "15430257", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket systemd-tmpfiles-setup.service system.slice basic.target ntpd.service -.mount tmp.mount ntpdate.service sysinit.target sntp.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 13:50:32 UTC", "AssertTimestampMonotonic": "14434896", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 13:50:32 UTC", "ConditionTimestampMonotonic": "14434873", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-11-20T13:53:45.183 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1615", "ExecMainStartTimestamp": "Fri 2020-11-20 13:50:33 UTC", "ExecMainStartTimestampMonotonic": "15373134", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 13:50:32 UTC", "InactiveExitTimestampMonotonic": "14583188", "InvocationID": "927f75b5d396476c9c6597815ad4ddfa", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-11-20T13:53:45.184 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1615", "MemoryAccounting": "yes", "MemoryCurrent": "2768896", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-11-20T13:53:45.186 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 13:50:33 UTC", "StateChangeTimestampMonotonic": "15430257", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 13:50:33 UTC", "WatchdogTimestampMonotonic": "15373148", "WatchdogUSec": "0"}} 2020-11-20T13:53:45.216 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.312) 0:01:57.872 ******* 2020-11-20T13:53:45.225 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 13:51:05 UTC", "ActiveEnterTimestampMonotonic": "15827458", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sntp.service ntpdate.service basic.target -.mount system.slice tmp.mount ntpd.service systemd-tmpfiles-setup.service systemd-journald.socket sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 13:51:04 UTC", "AssertTimestampMonotonic": "14964470", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 13:51:04 UTC", "ConditionTimestampMonotonic": "14964443", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-11-20T13:53:45.227 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2430", "ExecMainStartTimestamp": "Fri 2020-11-20 13:51:04 UTC", "ExecMainStartTimestampMonotonic": "15140110", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 13:51:04 UTC", "InactiveExitTimestampMonotonic": "15064489", "InvocationID": "2a3618efd9024b948d6aad0217b885a1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-11-20T13:53:45.228 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2430", "MemoryAccounting": "yes", "MemoryCurrent": "2707456", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-11-20T13:53:45.230 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 13:51:05 UTC", "StateChangeTimestampMonotonic": "15827458", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 13:51:04 UTC", "WatchdogTimestampMonotonic": "15140119", "WatchdogUSec": "0"}} 2020-11-20T13:53:45.259 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.042) 0:01:57.915 ******* 2020-11-20T13:53:45.265 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:45.266 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T13:53:45.298 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.038) 0:01:57.953 ******* 2020-11-20T13:53:45.303 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T13:53:45.337 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.039) 0:01:57.993 ******* 2020-11-20T13:53:45.342 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:45.344 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T13:53:45.376 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.038) 0:01:58.031 ******* 2020-11-20T13:53:45.383 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T13:53:45.415 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.039) 0:01:58.071 ******* 2020-11-20T13:53:45.421 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T13:53:45.423 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:45.457 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.041) 0:01:58.112 ******* 2020-11-20T13:53:45.463 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:45.497 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.040) 0:01:58.153 ******* 2020-11-20T13:53:45.502 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T13:53:45.504 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:45.537 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.040) 0:01:58.193 ******* 2020-11-20T13:53:45.544 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:45.578 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.040) 0:01:58.234 ******* 2020-11-20T13:53:45.584 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T13:53:45.585 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:45.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.040) 0:01:58.274 ******* 2020-11-20T13:53:45.625 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:45.663 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.043) 0:01:58.318 ******* 2020-11-20T13:53:45.834 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T13:53:45.836 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T13:53:45.869 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.206) 0:01:58.524 ******* 2020-11-20T13:53:45.875 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T13:53:45.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:45 +0000 (0:00:00.040) 0:01:58.564 ******* 2020-11-20T13:53:46.361 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T13:53:46.362 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T13:53:46.395 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:46 +0000 (0:00:00.486) 0:01:59.051 ******* 2020-11-20T13:53:46.402 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T13:53:46.437 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:46 +0000 (0:00:00.042) 0:01:59.093 ******* 2020-11-20T13:53:47.709 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T13:53:47.711 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python 2020-11-20T13:53:47.713 INFO:teuthology.task.ansible.out:3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T13:53:47.747 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:47 +0000 (0:00:01.309) 0:02:00.403 ******* 2020-11-20T13:53:47.788 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:47 +0000 (0:00:00.040) 0:02:00.443 ******* 2020-11-20T13:53:47.796 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T13:53:47.798 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:47.841 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:47 +0000 (0:00:00.053) 0:02:00.497 ******* 2020-11-20T13:53:47.849 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:47.885 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:47 +0000 (0:00:00.043) 0:02:00.540 ******* 2020-11-20T13:53:47.891 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T13:53:47.893 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-11-20T13:53:47.929 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:47 +0000 (0:00:00.043) 0:02:00.584 ******* 2020-11-20T13:53:47.934 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-11-20T13:53:47.969 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:47 +0000 (0:00:00.040) 0:02:00.625 ******* 2020-11-20T13:53:48.121 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T13:53:48.122 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T13:53:48.172 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.203) 0:02:00.828 ******* 2020-11-20T13:53:48.179 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T13:53:48.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.040) 0:02:00.869 ******* 2020-11-20T13:53:48.220 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T13:53:48.222 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:48.254 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.040) 0:02:00.909 ******* 2020-11-20T13:53:48.260 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:48.293 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.038) 0:02:00.948 ******* 2020-11-20T13:53:48.298 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi031.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T13:53:48.344 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.051) 0:02:01.000 ******* 2020-11-20T13:53:48.351 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T13:53:48.389 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.045) 0:02:01.045 ******* 2020-11-20T13:53:48.397 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T13:53:48.398 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:48.431 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.041) 0:02:01.086 ******* 2020-11-20T13:53:48.437 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:48.483 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.051) 0:02:01.138 ******* 2020-11-20T13:53:48.635 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T13:53:48.637 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T13:53:48.670 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.186) 0:02:01.325 ******* 2020-11-20T13:53:48.686 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T13:53:48.721 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.051) 0:02:01.377 ******* 2020-11-20T13:53:48.872 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T13:53:48.874 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T13:53:48.907 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.185) 0:02:01.562 ******* 2020-11-20T13:53:48.923 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T13:53:48.956 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.049) 0:02:01.612 ******* 2020-11-20T13:53:48.962 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T13:53:48.964 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:48.996 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:48 +0000 (0:00:00.039) 0:02:01.651 ******* 2020-11-20T13:53:49.001 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.038 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.042) 0:02:01.694 ******* 2020-11-20T13:53:49.045 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T13:53:49.047 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.057 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.058 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.097 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.058) 0:02:01.753 ******* 2020-11-20T13:53:49.103 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.104 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.104 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.105 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.106 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.140 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.043) 0:02:01.796 ******* 2020-11-20T13:53:49.146 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T13:53:49.148 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.159 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.161 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi031.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.059) 0:02:01.855 ******* 2020-11-20T13:53:49.206 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.206 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.208 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi039.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.208 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.242 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.042) 0:02:01.898 ******* 2020-11-20T13:53:49.247 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T13:53:49.249 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.284 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.041) 0:02:01.939 ******* 2020-11-20T13:53:49.290 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.327 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.042) 0:02:01.982 ******* 2020-11-20T13:53:49.333 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.367 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.040) 0:02:02.022 ******* 2020-11-20T13:53:49.372 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.403 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.036) 0:02:02.059 ******* 2020-11-20T13:53:49.407 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T13:53:49.409 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.442 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.039) 0:02:02.098 ******* 2020-11-20T13:53:49.449 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.484 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.041) 0:02:02.140 ******* 2020-11-20T13:53:49.489 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T13:53:49.491 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.039) 0:02:02.180 ******* 2020-11-20T13:53:49.530 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.039) 0:02:02.219 ******* 2020-11-20T13:53:49.571 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.607 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.043) 0:02:02.263 ******* 2020-11-20T13:53:49.613 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.052) 0:02:02.315 ******* 2020-11-20T13:53:49.665 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T13:53:49.667 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.054) 0:02:02.369 ******* 2020-11-20T13:53:49.720 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.043) 0:02:02.412 ******* 2020-11-20T13:53:49.763 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-20T13:53:49.764 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.799 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.042) 0:02:02.455 ******* 2020-11-20T13:53:49.805 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.841 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.041) 0:02:02.496 ******* 2020-11-20T13:53:49.846 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T13:53:49.848 INFO:teuthology.task.ansible.out:skipping: [smithi031.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.039) 0:02:02.536 ******* 2020-11-20T13:53:49.887 INFO:teuthology.task.ansible.out:skipping: [smithi039.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T13:53:49.921 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:49 +0000 (0:00:00.040) 0:02:02.577 ******* 2020-11-20T13:53:51.114 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T13:53:51.116 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.006552", "end": "2020-11-20 13:53:51.077428", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 13:53:50.070876", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:51.157 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.006424", "end": "2020-11-20 13:53:51.119672", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 13:53:50.113248", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:51.312 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003171", "end": "2020-11-20 13:53:51.283079", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 13:53:51.279908", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:51.354 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003195", "end": "2020-11-20 13:53:51.323110", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 13:53:51.319915", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:51.510 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003003", "end": "2020-11-20 13:53:51.471301", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 13:53:51.468298", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:51.542 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003029", "end": "2020-11-20 13:53:51.508004", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 13:53:51.504975", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:51.728 INFO:teuthology.task.ansible.out:ok: [smithi031.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.032444", "end": "2020-11-20 13:53:51.697926", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 13:53:51.665482", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:51.763 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:51 +0000 (0:00:01.841) 0:02:04.418 ******* 2020-11-20T13:53:51.769 INFO:teuthology.task.ansible.out:ok: [smithi039.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024683", "end": "2020-11-20 13:53:51.714433", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 13:53:51.689750", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T13:53:51.805 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:51 +0000 (0:00:00.041) 0:02:04.460 ******* 2020-11-20T13:53:51.810 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T13:53:51.848 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:51 +0000 (0:00:00.042) 0:02:04.503 ******* 2020-11-20T13:53:51.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:51 +0000 (0:00:00.041) 0:02:04.545 ******* 2020-11-20T13:53:52.050 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T13:53:52.052 INFO:teuthology.task.ansible.out:changed: [smithi031.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T13:53:52.118 INFO:teuthology.task.ansible.out:changed: [smithi039.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T13:53:52.208 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-11-20T13:53:52.214 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-11-20T13:53:52.215 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-11-20T13:53:52.219 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi031.front.sepia.ceph.com : ok=115 changed=33 unreachable=0 failed=0 skipped=181 rescued=0 ignored=3 smithi039.front.sepia.ceph.com : ok=115 changed=33 unreachable=0 failed=0 skipped=181 rescued=0 ignored=3 2020-11-20T13:53:52.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 13:53:52 +0000 (0:00:00.330) 0:02:04.875 ******* =============================================================================== common : nrpe - Remove SELinux policy package -------------------------- 17.19s common : nrpe - Load SELinux policy package ---------------------------- 17.08s testnode : Zap all non-root disks --------------------------------------- 7.67s common : Make sure smartmontools is installed --------------------------- 3.17s testnode : Install packages --------------------------------------------- 2.82s testnode : Ensure ceph packages are not present. ------------------------ 2.09s testnode : Create logical volume(s) ------------------------------------- 1.86s testnode : Rebuild rpmdb ------------------------------------------------ 1.85s testnode : List any leftover Ceph artifacts from previous jobs ---------- 1.84s testnode : Ensure ceph dependency packages are not present. ------------- 1.76s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.66s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.51s Gathering Facts --------------------------------------------------------- 1.49s testnode : Install packages via pip ------------------------------------- 1.31s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.28s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.24s testnode : Configure local mirrorlists ---------------------------------- 1.21s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.21s common : Install Kerberos Packages (RedHat) ----------------------------- 1.21s 2020-11-20T13:53:52.222 INFO:teuthology.task.ansible.out:common : nrpe - Ensure SELinux policy is up to date --------------------- 0.97s 2020-11-20T13:53:52.539 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi031.front.sepia.ceph.com')] 2020-11-20T13:53:52.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T13:53:52.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:53:52.610 INFO:teuthology.orchestra.run.smithi039:> true 2020-11-20T13:53:52.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T13:53:52.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T13:53:52.764 INFO:teuthology.orchestra.run.smithi031:> true 2020-11-20T13:53:52.849 INFO:teuthology.run_tasks:Running task clock... 2020-11-20T13:53:52.861 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-20T13:53:52.861 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T13:53:52.862 INFO:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T13:53:52.902 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T13:53:52.925 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T13:53:52.971 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2020-11-20T13:53:52.988 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2020-11-20T13:53:53.009 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T13:53:53.030 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T13:53:53.096 INFO:teuthology.orchestra.run.smithi039.stderr:bash: ntpq: command not found 2020-11-20T13:53:53.098 INFO:teuthology.orchestra.run.smithi039.stdout:210 Number of sources = 4 2020-11-20T13:53:53.098 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T13:53:53.099 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2020-11-20T13:53:53.099 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T13:53:53.099 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T13:53:53.099 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T13:53:53.100 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T13:53:53.100 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T13:53:53.100 INFO:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T13:53:53.143 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T13:53:53.165 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T13:53:53.220 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2020-11-20T13:53:53.237 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2020-11-20T13:53:53.259 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T13:53:53.280 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T13:53:53.349 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2020-11-20T13:53:53.352 INFO:teuthology.orchestra.run.smithi031.stdout:210 Number of sources = 4 2020-11-20T13:53:53.352 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T13:53:53.352 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2020-11-20T13:53:53.352 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T13:53:53.352 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T13:53:53.353 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T13:53:53.353 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T13:53:53.353 INFO:teuthology.run_tasks:Running task install... 2020-11-20T13:53:53.362 DEBUG:teuthology.task.install:project ceph 2020-11-20T13:53:53.363 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34'}} 2020-11-20T13:53:53.363 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34'} 2020-11-20T13:53:53.364 INFO:teuthology.task.install:Using flavor: basic 2020-11-20T13:53:53.371 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-20T13:53:53.371 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-11-20T13:53:53.372 INFO:teuthology.orchestra.run.smithi039:> sudo lsb_release -is 2020-11-20T13:53:53.412 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS 2020-11-20T13:53:53.414 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T13:53:53.414 INFO:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2020-11-20T13:53:53.415 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34', 'tag': None, 'wait_for_package': False} 2020-11-20T13:53:53.415 INFO:teuthology.orchestra.run.smithi039:> sudo lsb_release -is 2020-11-20T13:53:53.456 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS 2020-11-20T13:53:53.457 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T13:53:53.458 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34', 'tag': None, 'wait_for_package': False} 2020-11-20T13:53:53.458 INFO:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2020-11-20T13:53:53.493 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS 2020-11-20T13:53:53.494 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T13:53:53.495 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7b62340ad27b26642bb54ec916a97c7e1f07a34 2020-11-20T13:53:53.537 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS 2020-11-20T13:53:53.538 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T13:53:53.538 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7b62340ad27b26642bb54ec916a97c7e1f07a34 2020-11-20T13:53:53.660 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/a7b62340ad27b26642bb54ec916a97c7e1f07a34/centos/8/flavors/default/ 2020-11-20T13:53:53.661 INFO:teuthology.task.install.rpm:Package version is 15.2.5-588.ga7b62340 2020-11-20T13:53:53.701 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/a7b62340ad27b26642bb54ec916a97c7e1f07a34/centos/8/flavors/default/ 2020-11-20T13:53:53.701 INFO:teuthology.task.install.rpm:Package version is 15.2.5-588.ga7b62340 2020-11-20T13:53:53.786 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/octopus/a7b62340ad27b26642bb54ec916a97c7e1f07a34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/octopus/a7b62340ad27b26642bb54ec916a97c7e1f07a34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/octopus/a7b62340ad27b26642bb54ec916a97c7e1f07a34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T13:53:53.787 INFO:teuthology.orchestra.run.smithi039:> set -ex 2020-11-20T13:53:53.787 INFO:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T13:53:53.801 INFO:teuthology.orchestra.run.smithi039.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T13:53:53.817 INFO:teuthology.orchestra.run.smithi039.stderr:1+1 records in 2020-11-20T13:53:53.817 INFO:teuthology.orchestra.run.smithi039.stderr:1+1 records out 2020-11-20T13:53:53.817 INFO:teuthology.orchestra.run.smithi039.stderr:589 bytes copied, 4.3288e-05 s, 13.6 MB/s 2020-11-20T13:53:53.818 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T13:53:53.819 INFO:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a7b62340ad27b26642bb54ec916a97c7e1f07a34/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T13:53:53.891 INFO:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T13:53:53.905 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/octopus/a7b62340ad27b26642bb54ec916a97c7e1f07a34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/octopus/a7b62340ad27b26642bb54ec916a97c7e1f07a34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/octopus/a7b62340ad27b26642bb54ec916a97c7e1f07a34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T13:53:53.905 INFO:teuthology.orchestra.run.smithi031:> set -ex 2020-11-20T13:53:53.906 INFO:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T13:53:53.920 INFO:teuthology.orchestra.run.smithi031.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T13:53:53.937 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records in 2020-11-20T13:53:53.937 INFO:teuthology.orchestra.run.smithi031.stderr:1+1 records out 2020-11-20T13:53:53.937 INFO:teuthology.orchestra.run.smithi031.stderr:589 bytes copied, 4.3316e-05 s, 13.6 MB/s 2020-11-20T13:53:53.938 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T13:53:53.939 INFO:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a7b62340ad27b26642bb54ec916a97c7e1f07a34/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T13:53:53.978 INFO:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T13:53:54.009 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2020-11-20T13:53:54.010 INFO:teuthology.orchestra.run.smithi039:> sudo yum clean all 2020-11-20T13:53:54.012 INFO:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T13:53:54.101 INFO:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T13:53:54.131 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2020-11-20T13:53:54.132 INFO:teuthology.orchestra.run.smithi031:> sudo yum clean all 2020-11-20T13:53:54.305 INFO:teuthology.orchestra.run.smithi039.stdout:42 files removed 2020-11-20T13:53:54.334 INFO:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T13:53:54.428 INFO:teuthology.orchestra.run.smithi031.stdout:42 files removed 2020-11-20T13:53:54.458 INFO:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T13:53:55.188 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 143 kB/s | 69 kB 00:00 2020-11-20T13:53:55.409 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 119 kB/s | 69 kB 00:00 2020-11-20T13:53:55.837 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 24 kB/s | 15 kB 00:00 2020-11-20T13:53:56.040 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 24 kB/s | 15 kB 00:00 2020-11-20T13:53:56.433 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 2.5 kB/s | 1.4 kB 00:00 2020-11-20T13:53:56.599 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - AppStream 49 MB/s | 7.0 MB 00:00 2020-11-20T13:53:56.659 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 2.4 kB/s | 1.4 kB 00:00 2020-11-20T13:53:56.831 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - AppStream 47 MB/s | 7.0 MB 00:00 2020-11-20T13:53:57.873 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-11-20T13:53:58.086 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-11-20T13:53:58.316 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - Extras 85 kB/s | 5.5 kB 00:00 2020-11-20T13:53:58.533 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-8 - Extras 85 kB/s | 5.5 kB 00:00 2020-11-20T13:53:58.725 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 23 MB/s | 8.3 MB 00:00 2020-11-20T13:53:58.937 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 24 MB/s | 8.3 MB 00:00 2020-11-20T13:54:00.537 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 4.3 MB/s | 23 kB 00:00 2020-11-20T13:54:00.749 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 4.1 MB/s | 23 kB 00:00 2020-11-20T13:54:01.510 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T13:54:01.511 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T13:54:01.514 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T13:54:01.515 INFO:teuthology.orchestra.run.smithi039.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T13:54:01.516 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T13:54:01.516 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T13:54:01.654 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2020-11-20T13:54:01.679 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2020-11-20T13:54:01.679 INFO:teuthology.orchestra.run.smithi039.stdout: Package ArchVersion Repository Size 2020-11-20T13:54:01.679 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2020-11-20T13:54:01.679 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2020-11-20T13:54:01.680 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_642:15.2.5-588.ga7b62340.el8 ceph 6.4 k 2020-11-20T13:54:01.680 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_642:15.2.5-588.ga7b62340.el8 ceph 5.6 M 2020-11-20T13:54:01.680 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_642:15.2.5-588.ga7b62340.el8 ceph 577 k 2020-11-20T13:54:01.680 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_642:15.2.5-588.ga7b62340.el8 ceph 205 k 2020-11-20T13:54:01.681 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_642:15.2.5-588.ga7b62340.el8 ceph 1.4 M 2020-11-20T13:54:01.681 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_642:15.2.5-588.ga7b62340.el8 ceph 10 M 2020-11-20T13:54:01.681 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_642:15.2.5-588.ga7b62340.el8 ceph 42 M 2020-11-20T13:54:01.681 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm x86_642:15.2.5-588.ga7b62340.el8 ceph 57 k 2020-11-20T13:54:01.682 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_642:15.2.5-588.ga7b62340.el8 ceph 22 k 2020-11-20T13:54:01.682 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_642:15.2.5-588.ga7b62340.el8 ceph 511 k 2020-11-20T13:54:01.682 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_642:15.2.5-588.ga7b62340.el8 ceph 141 k 2020-11-20T13:54:01.682 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_642:15.2.5-588.ga7b62340.el8 ceph 163 k 2020-11-20T13:54:01.682 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_642:15.2.5-588.ga7b62340.el8 ceph 351 k 2020-11-20T13:54:01.683 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_642:15.2.5-588.ga7b62340.el8 ceph 334 k 2020-11-20T13:54:01.683 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_642:15.2.5-588.ga7b62340.el8 ceph 113 k 2020-11-20T13:54:01.683 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_642:15.2.5-588.ga7b62340.el8 ceph 72 k 2020-11-20T13:54:01.683 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_642:15.2.5-588.ga7b62340.el8 ceph 2.7 M 2020-11-20T13:54:01.683 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_642:15.2.5-588.ga7b62340.el8 ceph 141 k 2020-11-20T13:54:01.684 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 65 k 2020-11-20T13:54:01.684 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 3.5 M 2020-11-20T13:54:01.684 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 8.6 M 2020-11-20T13:54:01.684 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 27 k 2020-11-20T13:54:01.685 INFO:teuthology.orchestra.run.smithi039.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T13:54:01.685 INFO:teuthology.orchestra.run.smithi039.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T13:54:01.685 INFO:teuthology.orchestra.run.smithi039.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T13:54:01.685 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T13:54:01.686 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T13:54:01.686 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T13:54:01.686 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T13:54:01.686 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T13:54:01.686 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2020-11-20T13:54:01.687 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_642:15.2.5-588.ga7b62340.el8 ceph 3.6 M 2020-11-20T13:54:01.687 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_642:15.2.5-588.ga7b62340.el8 ceph 1.9 M 2020-11-20T13:54:01.687 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2020-11-20T13:54:01.687 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_642:15.2.5-588.ga7b62340.el8 ceph 21 M 2020-11-20T13:54:01.688 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_642:15.2.5-588.ga7b62340.el8 ceph 2.0 M 2020-11-20T13:54:01.688 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_642:15.2.5-588.ga7b62340.el8 ceph 4.4 M 2020-11-20T13:54:01.688 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_642:15.2.5-588.ga7b62340.el8 ceph 17 M 2020-11-20T13:54:01.688 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_642:15.2.5-588.ga7b62340.el8 ceph 25 k 2020-11-20T13:54:01.688 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_642:15.2.5-588.ga7b62340.el8 ceph 381 k 2020-11-20T13:54:01.689 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_642:15.2.5-588.ga7b62340.el8 ceph 3.2 M 2020-11-20T13:54:01.689 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_642:15.2.5-588.ga7b62340.el8 ceph 40 k 2020-11-20T13:54:01.689 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_642:15.2.5-588.ga7b62340.el8 ceph 73 k 2020-11-20T13:54:01.689 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 24 k 2020-11-20T13:54:01.689 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 176 k 2020-11-20T13:54:01.690 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 8.7 k 2020-11-20T13:54:01.690 INFO:teuthology.orchestra.run.smithi039.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T13:54:01.690 INFO:teuthology.orchestra.run.smithi039.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T13:54:01.690 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T13:54:01.691 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T13:54:01.691 INFO:teuthology.orchestra.run.smithi039.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T13:54:01.691 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T13:54:01.691 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T13:54:01.691 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T13:54:01.692 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T13:54:01.692 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T13:54:01.692 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T13:54:01.692 INFO:teuthology.orchestra.run.smithi039.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T13:54:01.692 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T13:54:01.693 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T13:54:01.693 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T13:54:01.693 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T13:54:01.693 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T13:54:01.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T13:54:01.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T13:54:01.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T13:54:01.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T13:54:01.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T13:54:01.695 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T13:54:01.695 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T13:54:01.695 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T13:54:01.695 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T13:54:01.695 INFO:teuthology.orchestra.run.smithi039.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T13:54:01.696 INFO:teuthology.orchestra.run.smithi039.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T13:54:01.696 INFO:teuthology.orchestra.run.smithi039.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T13:54:01.696 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T13:54:01.696 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T13:54:01.696 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T13:54:01.697 INFO:teuthology.orchestra.run.smithi039.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T13:54:01.697 INFO:teuthology.orchestra.run.smithi039.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T13:54:01.697 INFO:teuthology.orchestra.run.smithi039.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T13:54:01.697 INFO:teuthology.orchestra.run.smithi039.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T13:54:01.698 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T13:54:01.698 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T13:54:01.698 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T13:54:01.698 INFO:teuthology.orchestra.run.smithi039.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T13:54:01.698 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T13:54:01.699 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T13:54:01.699 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T13:54:01.699 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T13:54:01.699 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T13:54:01.699 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T13:54:01.700 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T13:54:01.700 INFO:teuthology.orchestra.run.smithi039.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T13:54:01.700 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T13:54:01.700 INFO:teuthology.orchestra.run.smithi039.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T13:54:01.700 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T13:54:01.701 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T13:54:01.701 INFO:teuthology.orchestra.run.smithi039.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T13:54:01.701 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T13:54:01.701 INFO:teuthology.orchestra.run.smithi039.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T13:54:01.702 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T13:54:01.702 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T13:54:01.702 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T13:54:01.702 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T13:54:01.702 INFO:teuthology.orchestra.run.smithi039.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T13:54:01.703 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T13:54:01.703 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T13:54:01.703 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T13:54:01.703 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T13:54:01.703 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T13:54:01.704 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T13:54:01.704 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T13:54:01.704 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T13:54:01.704 INFO:teuthology.orchestra.run.smithi039.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T13:54:01.704 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T13:54:01.705 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T13:54:01.705 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T13:54:01.705 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T13:54:01.705 INFO:teuthology.orchestra.run.smithi039.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T13:54:01.706 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T13:54:01.706 INFO:teuthology.orchestra.run.smithi039.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T13:54:01.706 INFO:teuthology.orchestra.run.smithi039.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T13:54:01.706 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T13:54:01.706 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T13:54:01.707 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T13:54:01.707 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T13:54:01.707 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T13:54:01.707 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2020-11-20T13:54:01.707 INFO:teuthology.orchestra.run.smithi039.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T13:54:01.708 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T13:54:01.708 INFO:teuthology.orchestra.run.smithi039.stdout:Downgrading: 2020-11-20T13:54:01.708 INFO:teuthology.orchestra.run.smithi039.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T13:54:01.708 INFO:teuthology.orchestra.run.smithi039.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T13:54:01.708 INFO:teuthology.orchestra.run.smithi039.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T13:54:01.709 INFO:teuthology.orchestra.run.smithi039.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T13:54:01.709 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T13:54:01.709 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:54:01.709 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2020-11-20T13:54:01.710 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2020-11-20T13:54:01.710 INFO:teuthology.orchestra.run.smithi039.stdout:Install 126 Packages 2020-11-20T13:54:01.710 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 2 Packages 2020-11-20T13:54:01.710 INFO:teuthology.orchestra.run.smithi039.stdout:Downgrade 5 Packages 2020-11-20T13:54:01.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:54:01.711 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T13:54:01.712 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T13:54:01.712 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 185 M 2020-11-20T13:54:01.712 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2020-11-20T13:54:01.713 INFO:teuthology.orchestra.run.smithi031.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T13:54:01.714 INFO:teuthology.orchestra.run.smithi031.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T13:54:01.715 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T13:54:01.716 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T13:54:01.742 INFO:teuthology.orchestra.run.smithi039.stdout:(1/133): libkadm5-1.17-9.el8.x86_64.rpm 4.0 MB/s | 184 kB 00:00 2020-11-20T13:54:01.745 INFO:teuthology.orchestra.run.smithi039.stdout:(2/133): krb5-libs-1.17-9.el8.x86_64.rpm 17 MB/s | 851 kB 00:00 2020-11-20T13:54:01.752 INFO:teuthology.orchestra.run.smithi039.stdout:(3/133): krb5-workstation-1.17-9.el8.x86_64.rpm 17 MB/s | 940 kB 00:00 2020-11-20T13:54:01.765 INFO:teuthology.orchestra.run.smithi039.stdout:(4/133): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 29 MB/s | 686 kB 00:00 2020-11-20T13:54:01.775 INFO:teuthology.orchestra.run.smithi039.stdout:(5/133): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 50 MB/s | 1.5 MB 00:00 2020-11-20T13:54:01.853 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2020-11-20T13:54:01.878 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-11-20T13:54:01.879 INFO:teuthology.orchestra.run.smithi031.stdout: Package ArchVersion Repository Size 2020-11-20T13:54:01.879 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-11-20T13:54:01.879 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2020-11-20T13:54:01.880 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_642:15.2.5-588.ga7b62340.el8 ceph 6.4 k 2020-11-20T13:54:01.880 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_642:15.2.5-588.ga7b62340.el8 ceph 5.6 M 2020-11-20T13:54:01.880 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_642:15.2.5-588.ga7b62340.el8 ceph 577 k 2020-11-20T13:54:01.880 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_642:15.2.5-588.ga7b62340.el8 ceph 205 k 2020-11-20T13:54:01.880 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_642:15.2.5-588.ga7b62340.el8 ceph 1.4 M 2020-11-20T13:54:01.881 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_642:15.2.5-588.ga7b62340.el8 ceph 10 M 2020-11-20T13:54:01.881 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_642:15.2.5-588.ga7b62340.el8 ceph 42 M 2020-11-20T13:54:01.881 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm x86_642:15.2.5-588.ga7b62340.el8 ceph 57 k 2020-11-20T13:54:01.881 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_642:15.2.5-588.ga7b62340.el8 ceph 22 k 2020-11-20T13:54:01.882 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_642:15.2.5-588.ga7b62340.el8 ceph 511 k 2020-11-20T13:54:01.882 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_642:15.2.5-588.ga7b62340.el8 ceph 141 k 2020-11-20T13:54:01.882 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_642:15.2.5-588.ga7b62340.el8 ceph 163 k 2020-11-20T13:54:01.882 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_642:15.2.5-588.ga7b62340.el8 ceph 351 k 2020-11-20T13:54:01.882 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_642:15.2.5-588.ga7b62340.el8 ceph 334 k 2020-11-20T13:54:01.883 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_642:15.2.5-588.ga7b62340.el8 ceph 113 k 2020-11-20T13:54:01.883 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_642:15.2.5-588.ga7b62340.el8 ceph 72 k 2020-11-20T13:54:01.883 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_642:15.2.5-588.ga7b62340.el8 ceph 2.7 M 2020-11-20T13:54:01.883 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_642:15.2.5-588.ga7b62340.el8 ceph 141 k 2020-11-20T13:54:01.883 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 65 k 2020-11-20T13:54:01.884 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 3.5 M 2020-11-20T13:54:01.884 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 8.6 M 2020-11-20T13:54:01.884 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 27 k 2020-11-20T13:54:01.884 INFO:teuthology.orchestra.run.smithi031.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T13:54:01.885 INFO:teuthology.orchestra.run.smithi031.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T13:54:01.885 INFO:teuthology.orchestra.run.smithi031.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T13:54:01.885 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T13:54:01.885 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T13:54:01.885 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T13:54:01.886 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T13:54:01.886 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T13:54:01.886 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2020-11-20T13:54:01.886 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_642:15.2.5-588.ga7b62340.el8 ceph 3.6 M 2020-11-20T13:54:01.886 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_642:15.2.5-588.ga7b62340.el8 ceph 1.9 M 2020-11-20T13:54:01.887 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2020-11-20T13:54:01.887 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_642:15.2.5-588.ga7b62340.el8 ceph 21 M 2020-11-20T13:54:01.887 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_642:15.2.5-588.ga7b62340.el8 ceph 2.0 M 2020-11-20T13:54:01.887 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_642:15.2.5-588.ga7b62340.el8 ceph 4.4 M 2020-11-20T13:54:01.888 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_642:15.2.5-588.ga7b62340.el8 ceph 17 M 2020-11-20T13:54:01.888 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_642:15.2.5-588.ga7b62340.el8 ceph 25 k 2020-11-20T13:54:01.888 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_642:15.2.5-588.ga7b62340.el8 ceph 381 k 2020-11-20T13:54:01.888 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_642:15.2.5-588.ga7b62340.el8 ceph 3.2 M 2020-11-20T13:54:01.888 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_642:15.2.5-588.ga7b62340.el8 ceph 40 k 2020-11-20T13:54:01.889 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_642:15.2.5-588.ga7b62340.el8 ceph 73 k 2020-11-20T13:54:01.889 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 24 k 2020-11-20T13:54:01.889 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 176 k 2020-11-20T13:54:01.889 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch2:15.2.5-588.ga7b62340.el8 ceph-noarch 8.7 k 2020-11-20T13:54:01.890 INFO:teuthology.orchestra.run.smithi031.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T13:54:01.890 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T13:54:01.890 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T13:54:01.890 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T13:54:01.891 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T13:54:01.891 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T13:54:01.891 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T13:54:01.891 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T13:54:01.892 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T13:54:01.892 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T13:54:01.892 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T13:54:01.892 INFO:teuthology.orchestra.run.smithi031.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T13:54:01.892 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T13:54:01.893 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T13:54:01.893 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T13:54:01.893 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T13:54:01.893 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T13:54:01.893 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T13:54:01.894 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T13:54:01.894 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T13:54:01.894 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T13:54:01.894 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T13:54:01.894 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T13:54:01.895 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T13:54:01.895 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T13:54:01.895 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T13:54:01.895 INFO:teuthology.orchestra.run.smithi031.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T13:54:01.895 INFO:teuthology.orchestra.run.smithi031.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T13:54:01.896 INFO:teuthology.orchestra.run.smithi031.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T13:54:01.896 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T13:54:01.896 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T13:54:01.896 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T13:54:01.896 INFO:teuthology.orchestra.run.smithi031.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T13:54:01.897 INFO:teuthology.orchestra.run.smithi031.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T13:54:01.897 INFO:teuthology.orchestra.run.smithi031.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T13:54:01.897 INFO:teuthology.orchestra.run.smithi031.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T13:54:01.897 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T13:54:01.898 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T13:54:01.898 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T13:54:01.898 INFO:teuthology.orchestra.run.smithi031.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T13:54:01.898 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T13:54:01.898 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T13:54:01.899 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T13:54:01.899 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T13:54:01.899 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T13:54:01.899 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T13:54:01.899 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T13:54:01.900 INFO:teuthology.orchestra.run.smithi031.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T13:54:01.900 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T13:54:01.900 INFO:teuthology.orchestra.run.smithi031.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T13:54:01.900 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T13:54:01.900 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T13:54:01.901 INFO:teuthology.orchestra.run.smithi031.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T13:54:01.901 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T13:54:01.901 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T13:54:01.901 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T13:54:01.902 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T13:54:01.902 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T13:54:01.902 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T13:54:01.902 INFO:teuthology.orchestra.run.smithi031.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T13:54:01.902 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T13:54:01.903 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T13:54:01.903 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T13:54:01.903 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T13:54:01.903 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T13:54:01.903 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T13:54:01.904 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T13:54:01.904 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T13:54:01.904 INFO:teuthology.orchestra.run.smithi031.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T13:54:01.904 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T13:54:01.904 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T13:54:01.905 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T13:54:01.905 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T13:54:01.905 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T13:54:01.905 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T13:54:01.906 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T13:54:01.906 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T13:54:01.906 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T13:54:01.906 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T13:54:01.906 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T13:54:01.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T13:54:01.907 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T13:54:01.907 INFO:teuthology.orchestra.run.smithi031.stdout:Installing weak dependencies: 2020-11-20T13:54:01.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T13:54:01.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T13:54:01.908 INFO:teuthology.orchestra.run.smithi031.stdout:Downgrading: 2020-11-20T13:54:01.908 INFO:teuthology.orchestra.run.smithi031.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T13:54:01.908 INFO:teuthology.orchestra.run.smithi031.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T13:54:01.908 INFO:teuthology.orchestra.run.smithi031.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T13:54:01.908 INFO:teuthology.orchestra.run.smithi031.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T13:54:01.909 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T13:54:01.909 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:54:01.909 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2020-11-20T13:54:01.909 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2020-11-20T13:54:01.909 INFO:teuthology.orchestra.run.smithi031.stdout:Install 126 Packages 2020-11-20T13:54:01.910 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 2 Packages 2020-11-20T13:54:01.910 INFO:teuthology.orchestra.run.smithi031.stdout:Downgrade 5 Packages 2020-11-20T13:54:01.910 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:54:01.911 INFO:teuthology.orchestra.run.smithi039.stdout:(6/133): ceph-15.2.5-588.ga7b62340.el8.x86_64.r 49 kB/s | 6.4 kB 00:00 2020-11-20T13:54:01.911 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 185 M 2020-11-20T13:54:01.911 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2020-11-20T13:54:01.947 INFO:teuthology.orchestra.run.smithi031.stdout:(1/133): krb5-workstation-1.17-9.el8.x86_64.rpm 18 MB/s | 940 kB 00:00 2020-11-20T13:54:01.950 INFO:teuthology.orchestra.run.smithi031.stdout:(2/133): krb5-libs-1.17-9.el8.x86_64.rpm 16 MB/s | 851 kB 00:00 2020-11-20T13:54:01.952 INFO:teuthology.orchestra.run.smithi031.stdout:(3/133): libkadm5-1.17-9.el8.x86_64.rpm 3.2 MB/s | 184 kB 00:00 2020-11-20T13:54:01.961 INFO:teuthology.orchestra.run.smithi031.stdout:(4/133): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 48 MB/s | 686 kB 00:00 2020-11-20T13:54:01.975 INFO:teuthology.orchestra.run.smithi031.stdout:(5/133): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 58 MB/s | 1.5 MB 00:00 2020-11-20T13:54:02.110 INFO:teuthology.orchestra.run.smithi031.stdout:(6/133): ceph-15.2.5-588.ga7b62340.el8.x86_64.r 41 kB/s | 6.4 kB 00:00 2020-11-20T13:54:02.246 INFO:teuthology.orchestra.run.smithi039.stdout:(7/133): ceph-fuse-15.2.5-588.ga7b62340.el8.x86 1.6 MB/s | 577 kB 00:00 2020-11-20T13:54:02.351 INFO:teuthology.orchestra.run.smithi039.stdout:(8/133): ceph-immutable-object-cache-15.2.5-588 1.9 MB/s | 205 kB 00:00 2020-11-20T13:54:02.708 INFO:teuthology.orchestra.run.smithi031.stdout:(7/133): ceph-fuse-15.2.5-588.ga7b62340.el8.x86 966 kB/s | 577 kB 00:00 2020-11-20T13:54:02.907 INFO:teuthology.orchestra.run.smithi031.stdout:(8/133): ceph-immutable-object-cache-15.2.5-588 1.0 MB/s | 205 kB 00:00 2020-11-20T13:54:03.149 INFO:teuthology.orchestra.run.smithi039.stdout:(9/133): ceph-mds-15.2.5-588.ga7b62340.el8.x86_ 2.6 MB/s | 2.0 MB 00:00 2020-11-20T13:54:03.310 INFO:teuthology.orchestra.run.smithi039.stdout:(10/133): ceph-base-15.2.5-588.ga7b62340.el8.x8 3.6 MB/s | 5.6 MB 00:01 2020-11-20T13:54:03.495 INFO:teuthology.orchestra.run.smithi039.stdout:(11/133): ceph-mgr-15.2.5-588.ga7b62340.el8.x86 4.1 MB/s | 1.4 MB 00:00 2020-11-20T13:54:04.089 INFO:teuthology.orchestra.run.smithi039.stdout:(12/133): ceph-mon-15.2.5-588.ga7b62340.el8.x86 5.6 MB/s | 4.4 MB 00:00 2020-11-20T13:54:04.121 INFO:teuthology.orchestra.run.smithi031.stdout:(9/133): ceph-mds-15.2.5-588.ga7b62340.el8.x86_ 1.7 MB/s | 2.0 MB 00:01 2020-11-20T13:54:04.988 INFO:teuthology.orchestra.run.smithi031.stdout:(10/133): ceph-mgr-15.2.5-588.ga7b62340.el8.x86 1.6 MB/s | 1.4 MB 00:00 2020-11-20T13:54:05.288 INFO:teuthology.orchestra.run.smithi031.stdout:(11/133): ceph-base-15.2.5-588.ga7b62340.el8.x8 1.7 MB/s | 5.6 MB 00:03 2020-11-20T13:54:05.722 INFO:teuthology.orchestra.run.smithi039.stdout:(13/133): ceph-common-15.2.5-588.ga7b62340.el8. 5.3 MB/s | 21 MB 00:03 2020-11-20T13:54:05.763 INFO:teuthology.orchestra.run.smithi039.stdout:(14/133): ceph-selinux-15.2.5-588.ga7b62340.el8 619 kB/s | 25 kB 00:00 2020-11-20T13:54:05.874 INFO:teuthology.orchestra.run.smithi039.stdout:(15/133): ceph-radosgw-15.2.5-588.ga7b62340.el8 5.7 MB/s | 10 MB 00:01 2020-11-20T13:54:05.917 INFO:teuthology.orchestra.run.smithi039.stdout:(16/133): cephadm-15.2.5-588.ga7b62340.el8.x86_ 1.3 MB/s | 57 kB 00:00 2020-11-20T13:54:05.958 INFO:teuthology.orchestra.run.smithi039.stdout:(17/133): libcephfs-devel-15.2.5-588.ga7b62340. 530 kB/s | 22 kB 00:00 2020-11-20T13:54:06.058 INFO:teuthology.orchestra.run.smithi039.stdout:(18/133): libcephfs2-15.2.5-588.ga7b62340.el8.x 5.0 MB/s | 511 kB 00:00 2020-11-20T13:54:06.104 INFO:teuthology.orchestra.run.smithi039.stdout:(19/133): librados-devel-15.2.5-588.ga7b62340.e 3.0 MB/s | 141 kB 00:00 2020-11-20T13:54:06.199 INFO:teuthology.orchestra.run.smithi039.stdout:(20/133): libradosstriper1-15.2.5-588.ga7b62340 3.9 MB/s | 381 kB 00:00 2020-11-20T13:54:06.880 INFO:teuthology.orchestra.run.smithi039.stdout:(21/133): librgw2-15.2.5-588.ga7b62340.el8.x86_ 4.8 MB/s | 3.2 MB 00:00 2020-11-20T13:54:06.911 INFO:teuthology.orchestra.run.smithi031.stdout:(12/133): ceph-mon-15.2.5-588.ga7b62340.el8.x86 2.3 MB/s | 4.4 MB 00:01 2020-11-20T13:54:06.948 INFO:teuthology.orchestra.run.smithi039.stdout:(22/133): python3-ceph-argparse-15.2.5-588.ga7b 604 kB/s | 40 kB 00:00 2020-11-20T13:54:07.015 INFO:teuthology.orchestra.run.smithi039.stdout:(23/133): python3-ceph-common-15.2.5-588.ga7b62 1.1 MB/s | 73 kB 00:00 2020-11-20T13:54:07.084 INFO:teuthology.orchestra.run.smithi039.stdout:(24/133): python3-cephfs-15.2.5-588.ga7b62340.e 2.3 MB/s | 163 kB 00:00 2020-11-20T13:54:07.194 INFO:teuthology.orchestra.run.smithi039.stdout:(25/133): python3-rados-15.2.5-588.ga7b62340.el 3.1 MB/s | 351 kB 00:00 2020-11-20T13:54:07.302 INFO:teuthology.orchestra.run.smithi039.stdout:(26/133): python3-rbd-15.2.5-588.ga7b62340.el8. 3.0 MB/s | 334 kB 00:00 2020-11-20T13:54:07.350 INFO:teuthology.orchestra.run.smithi039.stdout:(27/133): python3-rgw-15.2.5-588.ga7b62340.el8. 2.3 MB/s | 113 kB 00:00 2020-11-20T13:54:07.396 INFO:teuthology.orchestra.run.smithi039.stdout:(28/133): rbd-fuse-15.2.5-588.ga7b62340.el8.x86 1.5 MB/s | 72 kB 00:00 2020-11-20T13:54:07.838 INFO:teuthology.orchestra.run.smithi039.stdout:(29/133): rbd-mirror-15.2.5-588.ga7b62340.el8.x 6.2 MB/s | 2.7 MB 00:00 2020-11-20T13:54:08.002 INFO:teuthology.orchestra.run.smithi039.stdout:(30/133): ceph-osd-15.2.5-588.ga7b62340.el8.x86 3.7 MB/s | 17 MB 00:04 2020-11-20T13:54:08.003 INFO:teuthology.orchestra.run.smithi039.stdout:(31/133): rbd-nbd-15.2.5-588.ga7b62340.el8.x86_ 856 kB/s | 141 kB 00:00 2020-11-20T13:54:08.028 INFO:teuthology.orchestra.run.smithi039.stdout:(32/133): ceph-grafana-dashboards-15.2.5-588.ga 909 kB/s | 24 kB 00:00 2020-11-20T13:54:08.031 INFO:teuthology.orchestra.run.smithi039.stdout:(33/133): ceph-mgr-cephadm-15.2.5-588.ga7b62340 2.3 MB/s | 65 kB 00:00 2020-11-20T13:54:08.056 INFO:teuthology.orchestra.run.smithi031.stdout:(13/133): ceph-common-15.2.5-588.ga7b62340.el8. 3.4 MB/s | 21 MB 00:06 2020-11-20T13:54:08.101 INFO:teuthology.orchestra.run.smithi031.stdout:(14/133): ceph-selinux-15.2.5-588.ga7b62340.el8 575 kB/s | 25 kB 00:00 2020-11-20T13:54:08.807 INFO:teuthology.orchestra.run.smithi039.stdout:(34/133): ceph-mgr-dashboard-15.2.5-588.ga7b623 4.6 MB/s | 3.5 MB 00:00 2020-11-20T13:54:08.857 INFO:teuthology.orchestra.run.smithi039.stdout:(35/133): ceph-mgr-modules-core-15.2.5-588.ga7b 3.4 MB/s | 176 kB 00:00 2020-11-20T13:54:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:(36/133): ceph-mgr-rook-15.2.5-588.ga7b62340.el 610 kB/s | 27 kB 00:00 2020-11-20T13:54:08.946 INFO:teuthology.orchestra.run.smithi039.stdout:(37/133): ceph-prometheus-alerts-15.2.5-588.ga7 198 kB/s | 8.7 kB 00:00 2020-11-20T13:54:08.982 INFO:teuthology.orchestra.run.smithi039.stdout:(38/133): automake-1.16.1-6.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2020-11-20T13:54:08.991 INFO:teuthology.orchestra.run.smithi039.stdout:(39/133): bison-3.0.4-10.el8.x86_64.rpm 77 MB/s | 688 kB 00:00 2020-11-20T13:54:08.995 INFO:teuthology.orchestra.run.smithi039.stdout:(40/133): flex-2.6.1-9.el8.x86_64.rpm 72 MB/s | 320 kB 00:00 2020-11-20T13:54:08.998 INFO:teuthology.orchestra.run.smithi039.stdout:(41/133): jq-1.5-12.el8.x86_64.rpm 60 MB/s | 161 kB 00:00 2020-11-20T13:54:09.003 INFO:teuthology.orchestra.run.smithi039.stdout:(42/133): librdkafka-0.11.4-1.el8.x86_64.rpm 70 MB/s | 353 kB 00:00 2020-11-20T13:54:09.012 INFO:teuthology.orchestra.run.smithi039.stdout:(43/133): libtool-2.4.6-25.el8.x86_64.rpm 77 MB/s | 709 kB 00:00 2020-11-20T13:54:09.016 INFO:teuthology.orchestra.run.smithi039.stdout:(44/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 66 MB/s | 259 kB 00:00 2020-11-20T13:54:09.019 INFO:teuthology.orchestra.run.smithi039.stdout:(45/133): oniguruma-6.8.2-1.el8.x86_64.rpm 64 MB/s | 188 kB 00:00 2020-11-20T13:54:09.071 INFO:teuthology.orchestra.run.smithi039.stdout:(46/133): openblas-0.3.3-2.el8.x86_64.rpm 84 MB/s | 4.3 MB 00:00 2020-11-20T13:54:09.123 INFO:teuthology.orchestra.run.smithi039.stdout:(47/133): openblas-threads-0.3.3-2.el8.x86_64.r 84 MB/s | 4.4 MB 00:00 2020-11-20T13:54:09.180 INFO:teuthology.orchestra.run.smithi039.stdout:(48/133): python3-babel-2.5.1-5.el8.noarch.rpm 84 MB/s | 4.8 MB 00:00 2020-11-20T13:54:09.183 INFO:teuthology.orchestra.run.smithi039.stdout:(49/133): python3-html5lib-0.999999999-6.el8.no 63 MB/s | 214 kB 00:00 2020-11-20T13:54:09.190 INFO:teuthology.orchestra.run.smithi039.stdout:(50/133): python3-jinja2-2.10.1-2.el8_0.noarch. 76 MB/s | 538 kB 00:00 2020-11-20T13:54:09.192 INFO:teuthology.orchestra.run.smithi039.stdout:(51/133): python3-jsonpatch-1.21-2.el8.noarch.r 20 MB/s | 27 kB 00:00 2020-11-20T13:54:09.193 INFO:teuthology.orchestra.run.smithi039.stdout:(52/133): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2020-11-20T13:54:09.211 INFO:teuthology.orchestra.run.smithi039.stdout:(53/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 82 MB/s | 1.5 MB 00:00 2020-11-20T13:54:09.214 INFO:teuthology.orchestra.run.smithi039.stdout:(54/133): python3-mako-1.0.6-13.el8.noarch.rpm 58 MB/s | 157 kB 00:00 2020-11-20T13:54:09.216 INFO:teuthology.orchestra.run.smithi039.stdout:(55/133): python3-markupsafe-0.23-19.el8.x86_64 29 MB/s | 39 kB 00:00 2020-11-20T13:54:09.261 INFO:teuthology.orchestra.run.smithi039.stdout:(56/133): python3-numpy-1.14.3-9.el8.x86_64.rpm 82 MB/s | 3.7 MB 00:00 2020-11-20T13:54:09.265 INFO:teuthology.orchestra.run.smithi039.stdout:(57/133): python3-numpy-f2py-1.14.3-9.el8.x86_6 63 MB/s | 225 kB 00:00 2020-11-20T13:54:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:(58/133): python3-prettytable-0.7.2-14.el8.noar 35 MB/s | 44 kB 00:00 2020-11-20T13:54:09.291 INFO:teuthology.orchestra.run.smithi039.stdout:(59/133): ceph-mgr-diskprediction-local-15.2.5- 6.8 MB/s | 8.6 MB 00:01 2020-11-20T13:54:09.292 INFO:teuthology.orchestra.run.smithi039.stdout:(60/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.9 MB/s | 126 kB 00:00 2020-11-20T13:54:09.299 INFO:teuthology.orchestra.run.smithi039.stdout:(61/133): python3-pytz-2017.2-9.el8.noarch.rpm 22 MB/s | 54 kB 00:00 2020-11-20T13:54:09.361 INFO:teuthology.orchestra.run.smithi039.stdout:(62/133): python3-pyasn1-modules-0.3.7-6.el8.no 1.5 MB/s | 110 kB 00:00 2020-11-20T13:54:09.367 INFO:teuthology.orchestra.run.smithi039.stdout:(63/133): python3-webencodings-0.5.1-6.el8.noar 4.5 MB/s | 27 kB 00:00 2020-11-20T13:54:09.434 INFO:teuthology.orchestra.run.smithi039.stdout:(64/133): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2020-11-20T13:54:09.474 INFO:teuthology.orchestra.run.smithi039.stdout:(65/133): socat-1.7.3.2-6.el8.x86_64.rpm 7.3 MB/s | 298 kB 00:00 2020-11-20T13:54:09.483 INFO:teuthology.orchestra.run.smithi039.stdout:(66/133): elfutils-libelf-devel-0.176-5.el8.x86 6.4 MB/s | 54 kB 00:00 2020-11-20T13:54:09.498 INFO:teuthology.orchestra.run.smithi039.stdout:(67/133): fuse-2.9.7-12.el8.x86_64.rpm 5.5 MB/s | 82 kB 00:00 2020-11-20T13:54:09.503 INFO:teuthology.orchestra.run.smithi039.stdout:(68/133): fuse-common-3.2.1-12.el8.x86_64.rpm 3.6 MB/s | 21 kB 00:00 2020-11-20T13:54:09.597 INFO:teuthology.orchestra.run.smithi039.stdout:(69/133): python3-scipy-1.0.0-20.module_el8.1.0 49 MB/s | 15 MB 00:00 2020-11-20T13:54:09.598 INFO:teuthology.orchestra.run.smithi039.stdout:(70/133): keyutils-libs-devel-1.5.10-6.el8.x86_ 506 kB/s | 48 kB 00:00 2020-11-20T13:54:09.600 INFO:teuthology.orchestra.run.smithi039.stdout:(71/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 9.9 MB/s | 19 kB 00:00 2020-11-20T13:54:09.605 INFO:teuthology.orchestra.run.smithi039.stdout:(72/133): krb5-devel-1.17-9.el8.x86_64.rpm 70 MB/s | 548 kB 00:00 2020-11-20T13:54:09.606 INFO:teuthology.orchestra.run.smithi039.stdout:(73/133): libcom_err-devel-1.44.6-3.el8.x86_64. 6.8 MB/s | 38 kB 00:00 2020-11-20T13:54:09.614 INFO:teuthology.orchestra.run.smithi039.stdout:(74/133): libgfortran-8.3.1-4.5.el8.x86_64.rpm 69 MB/s | 638 kB 00:00 2020-11-20T13:54:09.615 INFO:teuthology.orchestra.run.smithi039.stdout:(75/133): libquadmath-8.3.1-4.5.el8.x86_64.rpm 17 MB/s | 169 kB 00:00 2020-11-20T13:54:09.616 INFO:teuthology.orchestra.run.smithi039.stdout:(76/133): librabbitmq-0.9.0-1.el8.x86_64.rpm 32 MB/s | 47 kB 00:00 2020-11-20T13:54:09.618 INFO:teuthology.orchestra.run.smithi039.stdout:(77/133): libsepol-devel-2.9-1.el8.x86_64.rpm 35 MB/s | 86 kB 00:00 2020-11-20T13:54:09.620 INFO:teuthology.orchestra.run.smithi039.stdout:(78/133): libselinux-devel-2.9-2.1.el8.x86_64.r 44 MB/s | 199 kB 00:00 2020-11-20T13:54:09.621 INFO:teuthology.orchestra.run.smithi039.stdout:(79/133): libuuid-devel-2.32.1-17.el8.x86_64.rp 39 MB/s | 95 kB 00:00 2020-11-20T13:54:09.622 INFO:teuthology.orchestra.run.smithi039.stdout:(80/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 12 MB/s | 18 kB 00:00 2020-11-20T13:54:09.625 INFO:teuthology.orchestra.run.smithi039.stdout:(81/133): libxslt-1.1.32-3.el8.x86_64.rpm 61 MB/s | 249 kB 00:00 2020-11-20T13:54:09.634 INFO:teuthology.orchestra.run.smithi039.stdout:(82/133): pcre2-devel-10.32-1.el8.x86_64.rpm 67 MB/s | 605 kB 00:00 2020-11-20T13:54:09.640 INFO:teuthology.orchestra.run.smithi039.stdout:(83/133): pcre2-utf16-10.32-1.el8.x86_64.rpm 40 MB/s | 228 kB 00:00 2020-11-20T13:54:09.644 INFO:teuthology.orchestra.run.smithi039.stdout:(84/133): pcre2-utf32-10.32-1.el8.x86_64.rpm 51 MB/s | 220 kB 00:00 2020-11-20T13:54:09.648 INFO:teuthology.orchestra.run.smithi039.stdout:(85/133): python3-chardet-3.0.4-7.el8.noarch.rp 49 MB/s | 195 kB 00:00 2020-11-20T13:54:09.650 INFO:teuthology.orchestra.run.smithi039.stdout:(86/133): python3-jwt-1.6.1-2.el8.noarch.rpm 26 MB/s | 43 kB 00:00 2020-11-20T13:54:09.654 INFO:teuthology.orchestra.run.smithi039.stdout:(87/133): python3-oauthlib-2.1.0-1.el8.noarch.r 45 MB/s | 155 kB 00:00 2020-11-20T13:54:09.655 INFO:teuthology.orchestra.run.smithi039.stdout:(88/133): python3-pysocks-1.6.8-3.el8.noarch.rp 23 MB/s | 34 kB 00:00 2020-11-20T13:54:09.659 INFO:teuthology.orchestra.run.smithi039.stdout:(89/133): python3-requests-2.20.0-2.1.el8_1.noa 40 MB/s | 123 kB 00:00 2020-11-20T13:54:09.660 INFO:teuthology.orchestra.run.smithi039.stdout:(90/133): python3-requests-oauthlib-1.0.0-1.el8 26 MB/s | 43 kB 00:00 2020-11-20T13:54:09.665 INFO:teuthology.orchestra.run.smithi039.stdout:(91/133): python3-urllib3-1.24.2-2.el8.noarch.r 45 MB/s | 176 kB 00:00 2020-11-20T13:54:09.667 INFO:teuthology.orchestra.run.smithi039.stdout:(92/133): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 30 MB/s | 69 kB 00:00 2020-11-20T13:54:09.669 INFO:teuthology.orchestra.run.smithi039.stdout:(93/133): zlib-devel-1.2.11-10.el8.x86_64.rpm 30 MB/s | 56 kB 00:00 2020-11-20T13:54:09.677 INFO:teuthology.orchestra.run.smithi039.stdout:(94/133): openssl-devel-1.1.1c-2.el8_1.1.x86_64 42 MB/s | 2.3 MB 00:00 2020-11-20T13:54:09.767 INFO:teuthology.orchestra.run.smithi039.stdout:(95/133): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T13:54:09.774 INFO:teuthology.orchestra.run.smithi039.stdout:(96/133): gperftools-libs-2.7-6.el8.x86_64.rpm 3.2 MB/s | 315 kB 00:00 2020-11-20T13:54:09.791 INFO:teuthology.orchestra.run.smithi039.stdout:(97/133): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-11-20T13:54:09.806 INFO:teuthology.orchestra.run.smithi039.stdout:(98/133): leveldb-1.22-1.el8.x86_64.rpm 4.5 MB/s | 181 kB 00:00 2020-11-20T13:54:09.808 INFO:teuthology.orchestra.run.smithi039.stdout:(99/133): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2020-11-20T13:54:09.824 INFO:teuthology.orchestra.run.smithi039.stdout:(100/133): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.6 MB/s | 44 kB 00:00 2020-11-20T13:54:09.825 INFO:teuthology.orchestra.run.smithi039.stdout:(101/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-11-20T13:54:09.841 INFO:teuthology.orchestra.run.smithi039.stdout:(102/133): python3-beautifulsoup4-4.6.3-2.el8.1 11 MB/s | 185 kB 00:00 2020-11-20T13:54:09.845 INFO:teuthology.orchestra.run.smithi039.stdout:(103/133): python3-cachetools-3.1.1-4.el8.noarc 1.6 MB/s | 33 kB 00:00 2020-11-20T13:54:09.857 INFO:teuthology.orchestra.run.smithi039.stdout:(104/133): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-11-20T13:54:09.866 INFO:teuthology.orchestra.run.smithi039.stdout:(105/133): python3-cheroot-8.2.1-1.el8.noarch.r 6.8 MB/s | 145 kB 00:00 2020-11-20T13:54:09.886 INFO:teuthology.orchestra.run.smithi039.stdout:(106/133): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2020-11-20T13:54:09.891 INFO:teuthology.orchestra.run.smithi039.stdout:(107/133): python3-cherrypy-18.4.0-1.el8.noarch 11 MB/s | 384 kB 00:00 2020-11-20T13:54:09.908 INFO:teuthology.orchestra.run.smithi039.stdout:(108/133): python3-google-auth-1.1.1-10.el8.noa 4.7 MB/s | 81 kB 00:00 2020-11-20T13:54:09.924 INFO:teuthology.orchestra.run.smithi039.stdout:(109/133): python3-jaraco-6.2-6.el8.noarch.rpm 688 kB/s | 11 kB 00:00 2020-11-20T13:54:09.926 INFO:teuthology.orchestra.run.smithi039.stdout:(110/133): python3-execnet-1.7.1-1.el8.noarch.r 8.8 MB/s | 355 kB 00:00 2020-11-20T13:54:09.940 INFO:teuthology.orchestra.run.smithi039.stdout:(111/133): python3-jaraco-functools-2.0-4.el8.n 1.1 MB/s | 18 kB 00:00 2020-11-20T13:54:09.957 INFO:teuthology.orchestra.run.smithi039.stdout:(112/133): python3-logutils-0.3.5-11.el8.noarch 2.9 MB/s | 49 kB 00:00 2020-11-20T13:54:09.974 INFO:teuthology.orchestra.run.smithi039.stdout:(113/133): python3-more-itertools-7.2.0-3.el8.n 3.4 MB/s | 59 kB 00:00 2020-11-20T13:54:09.993 INFO:teuthology.orchestra.run.smithi039.stdout:(114/133): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2020-11-20T13:54:10.006 INFO:teuthology.orchestra.run.smithi039.stdout:(115/133): python3-kubernetes-11.0.0-2.el8.noar 15 MB/s | 1.2 MB 00:00 2020-11-20T13:54:10.009 INFO:teuthology.orchestra.run.smithi039.stdout:(116/133): python3-portend-2.6-1.el8.noarch.rpm 940 kB/s | 16 kB 00:00 2020-11-20T13:54:10.024 INFO:teuthology.orchestra.run.smithi031.stdout:(15/133): ceph-radosgw-15.2.5-588.ga7b62340.el8 3.3 MB/s | 10 MB 00:03 2020-11-20T13:54:10.026 INFO:teuthology.orchestra.run.smithi039.stdout:(117/133): python3-repoze-lru-0.7-6.el8.noarch. 2.0 MB/s | 34 kB 00:00 2020-11-20T13:54:10.027 INFO:teuthology.orchestra.run.smithi039.stdout:(118/133): python3-remoto-1.1.4-4.el8.noarch.rp 2.3 MB/s | 48 kB 00:00 2020-11-20T13:54:10.044 INFO:teuthology.orchestra.run.smithi039.stdout:(119/133): python3-routes-2.4.1-12.el8.noarch.r 11 MB/s | 196 kB 00:00 2020-11-20T13:54:10.047 INFO:teuthology.orchestra.run.smithi039.stdout:(120/133): python3-rsa-3.4.2-15.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2020-11-20T13:54:10.055 INFO:teuthology.orchestra.run.smithi031.stdout:(16/133): cephadm-15.2.5-588.ga7b62340.el8.x86_ 1.8 MB/s | 57 kB 00:00 2020-11-20T13:54:10.061 INFO:teuthology.orchestra.run.smithi039.stdout:(121/133): python3-simplegeneric-0.8.1-17.el8.n 1.1 MB/s | 19 kB 00:00 2020-11-20T13:54:10.066 INFO:teuthology.orchestra.run.smithi039.stdout:(122/133): python3-singledispatch-3.4.0.3-18.el 1.2 MB/s | 24 kB 00:00 2020-11-20T13:54:10.077 INFO:teuthology.orchestra.run.smithi039.stdout:(123/133): python3-tempora-1.14.1-5.el8.noarch. 1.7 MB/s | 29 kB 00:00 2020-11-20T13:54:10.084 INFO:teuthology.orchestra.run.smithi031.stdout:(17/133): libcephfs-devel-15.2.5-588.ga7b62340. 760 kB/s | 22 kB 00:00 2020-11-20T13:54:10.086 INFO:teuthology.orchestra.run.smithi039.stdout:(124/133): python3-trustme-0.6.0-4.el8.noarch.r 1.4 MB/s | 27 kB 00:00 2020-11-20T13:54:10.095 INFO:teuthology.orchestra.run.smithi039.stdout:(125/133): python3-waitress-1.2.1-2.el8.1.noarc 13 MB/s | 241 kB 00:00 2020-11-20T13:54:10.108 INFO:teuthology.orchestra.run.smithi039.stdout:(126/133): python3-webob-1.8.5-1.el8.1.noarch.r 12 MB/s | 251 kB 00:00 2020-11-20T13:54:10.112 INFO:teuthology.orchestra.run.smithi039.stdout:(127/133): python3-websocket-client-0.56.0-5.el 3.6 MB/s | 61 kB 00:00 2020-11-20T13:54:10.128 INFO:teuthology.orchestra.run.smithi039.stdout:(128/133): python3-webtest-2.0.33-1.el8.noarch. 4.2 MB/s | 85 kB 00:00 2020-11-20T13:54:10.129 INFO:teuthology.orchestra.run.smithi039.stdout:(129/133): python3-zc-lockfile-2.0-2.el8.noarch 1.4 MB/s | 23 kB 00:00 2020-11-20T13:54:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:(130/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.4 MB/s | 69 kB 00:00 2020-11-20T13:54:10.189 INFO:teuthology.orchestra.run.smithi031.stdout:(18/133): libcephfs2-15.2.5-588.ga7b62340.el8.x 4.8 MB/s | 511 kB 00:00 2020-11-20T13:54:10.227 INFO:teuthology.orchestra.run.smithi031.stdout:(19/133): librados-devel-15.2.5-588.ga7b62340.e 3.6 MB/s | 141 kB 00:00 2020-11-20T13:54:10.366 INFO:teuthology.orchestra.run.smithi031.stdout:(20/133): libradosstriper1-15.2.5-588.ga7b62340 2.7 MB/s | 381 kB 00:00 2020-11-20T13:54:10.528 INFO:teuthology.orchestra.run.smithi031.stdout:(21/133): ceph-osd-15.2.5-588.ga7b62340.el8.x86 3.2 MB/s | 17 MB 00:05 2020-11-20T13:54:10.540 INFO:teuthology.orchestra.run.smithi039.stdout:(131/133): librbd1-15.2.5-588.ga7b62340.el8.x86 4.9 MB/s | 1.9 MB 00:00 2020-11-20T13:54:10.569 INFO:teuthology.orchestra.run.smithi031.stdout:(22/133): python3-ceph-argparse-15.2.5-588.ga7b 964 kB/s | 40 kB 00:00 2020-11-20T13:54:10.609 INFO:teuthology.orchestra.run.smithi031.stdout:(23/133): python3-ceph-common-15.2.5-588.ga7b62 1.8 MB/s | 73 kB 00:00 2020-11-20T13:54:10.652 INFO:teuthology.orchestra.run.smithi031.stdout:(24/133): python3-cephfs-15.2.5-588.ga7b62340.e 3.7 MB/s | 163 kB 00:00 2020-11-20T13:54:10.740 INFO:teuthology.orchestra.run.smithi031.stdout:(25/133): python3-rados-15.2.5-588.ga7b62340.el 3.9 MB/s | 351 kB 00:00 2020-11-20T13:54:10.827 INFO:teuthology.orchestra.run.smithi031.stdout:(26/133): python3-rbd-15.2.5-588.ga7b62340.el8. 3.7 MB/s | 334 kB 00:00 2020-11-20T13:54:10.865 INFO:teuthology.orchestra.run.smithi031.stdout:(27/133): python3-rgw-15.2.5-588.ga7b62340.el8. 3.0 MB/s | 113 kB 00:00 2020-11-20T13:54:10.891 INFO:teuthology.orchestra.run.smithi031.stdout:(28/133): rbd-fuse-15.2.5-588.ga7b62340.el8.x86 2.6 MB/s | 72 kB 00:00 2020-11-20T13:54:11.059 INFO:teuthology.orchestra.run.smithi031.stdout:(29/133): librgw2-15.2.5-588.ga7b62340.el8.x86_ 4.7 MB/s | 3.2 MB 00:00 2020-11-20T13:54:11.087 INFO:teuthology.orchestra.run.smithi031.stdout:(30/133): rbd-nbd-15.2.5-588.ga7b62340.el8.x86_ 5.0 MB/s | 141 kB 00:00 2020-11-20T13:54:11.110 INFO:teuthology.orchestra.run.smithi031.stdout:(31/133): ceph-grafana-dashboards-15.2.5-588.ga 1.0 MB/s | 24 kB 00:00 2020-11-20T13:54:11.119 INFO:teuthology.orchestra.run.smithi039.stdout:(132/133): ceph-test-15.2.5-588.ga7b62340.el8.x 7.9 MB/s | 42 MB 00:05 2020-11-20T13:54:11.133 INFO:teuthology.orchestra.run.smithi031.stdout:(32/133): ceph-mgr-cephadm-15.2.5-588.ga7b62340 2.7 MB/s | 65 kB 00:00 2020-11-20T13:54:11.157 INFO:teuthology.orchestra.run.smithi039.stdout:(133/133): librados2-15.2.5-588.ga7b62340.el8.x 3.5 MB/s | 3.6 MB 00:01 2020-11-20T13:54:11.162 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2020-11-20T13:54:11.162 INFO:teuthology.orchestra.run.smithi039.stdout:Total 19 MB/s | 185 MB 00:09 2020-11-20T13:54:11.232 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2020-11-20T13:54:11.249 INFO:teuthology.orchestra.run.smithi031.stdout:(33/133): rbd-mirror-15.2.5-588.ga7b62340.el8.x 7.7 MB/s | 2.7 MB 00:00 2020-11-20T13:54:11.413 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2020-11-20T13:54:11.413 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2020-11-20T13:54:11.581 INFO:teuthology.orchestra.run.smithi031.stdout:(34/133): ceph-mgr-dashboard-15.2.5-588.ga7b623 7.9 MB/s | 3.5 MB 00:00 2020-11-20T13:54:11.610 INFO:teuthology.orchestra.run.smithi031.stdout:(35/133): ceph-mgr-modules-core-15.2.5-588.ga7b 6.0 MB/s | 176 kB 00:00 2020-11-20T13:54:11.633 INFO:teuthology.orchestra.run.smithi031.stdout:(36/133): ceph-mgr-rook-15.2.5-588.ga7b62340.el 1.1 MB/s | 27 kB 00:00 2020-11-20T13:54:11.656 INFO:teuthology.orchestra.run.smithi031.stdout:(37/133): ceph-prometheus-alerts-15.2.5-588.ga7 383 kB/s | 8.7 kB 00:00 2020-11-20T13:54:11.694 INFO:teuthology.orchestra.run.smithi031.stdout:(38/133): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-11-20T13:54:11.703 INFO:teuthology.orchestra.run.smithi031.stdout:(39/133): bison-3.0.4-10.el8.x86_64.rpm 77 MB/s | 688 kB 00:00 2020-11-20T13:54:11.708 INFO:teuthology.orchestra.run.smithi031.stdout:(40/133): flex-2.6.1-9.el8.x86_64.rpm 70 MB/s | 320 kB 00:00 2020-11-20T13:54:11.711 INFO:teuthology.orchestra.run.smithi031.stdout:(41/133): jq-1.5-12.el8.x86_64.rpm 58 MB/s | 161 kB 00:00 2020-11-20T13:54:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:(42/133): librdkafka-0.11.4-1.el8.x86_64.rpm 65 MB/s | 353 kB 00:00 2020-11-20T13:54:11.725 INFO:teuthology.orchestra.run.smithi031.stdout:(43/133): libtool-2.4.6-25.el8.x86_64.rpm 79 MB/s | 709 kB 00:00 2020-11-20T13:54:11.729 INFO:teuthology.orchestra.run.smithi031.stdout:(44/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 66 MB/s | 259 kB 00:00 2020-11-20T13:54:11.732 INFO:teuthology.orchestra.run.smithi031.stdout:(45/133): oniguruma-6.8.2-1.el8.x86_64.rpm 63 MB/s | 188 kB 00:00 2020-11-20T13:54:11.783 INFO:teuthology.orchestra.run.smithi031.stdout:(46/133): openblas-0.3.3-2.el8.x86_64.rpm 85 MB/s | 4.3 MB 00:00 2020-11-20T13:54:11.836 INFO:teuthology.orchestra.run.smithi031.stdout:(47/133): openblas-threads-0.3.3-2.el8.x86_64.r 84 MB/s | 4.4 MB 00:00 2020-11-20T13:54:11.893 INFO:teuthology.orchestra.run.smithi031.stdout:(48/133): python3-babel-2.5.1-5.el8.noarch.rpm 84 MB/s | 4.8 MB 00:00 2020-11-20T13:54:11.896 INFO:teuthology.orchestra.run.smithi031.stdout:(49/133): python3-html5lib-0.999999999-6.el8.no 62 MB/s | 214 kB 00:00 2020-11-20T13:54:11.903 INFO:teuthology.orchestra.run.smithi031.stdout:(50/133): python3-jinja2-2.10.1-2.el8_0.noarch. 77 MB/s | 538 kB 00:00 2020-11-20T13:54:11.904 INFO:teuthology.orchestra.run.smithi031.stdout:(51/133): python3-jsonpatch-1.21-2.el8.noarch.r 23 MB/s | 27 kB 00:00 2020-11-20T13:54:11.906 INFO:teuthology.orchestra.run.smithi031.stdout:(52/133): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2020-11-20T13:54:11.924 INFO:teuthology.orchestra.run.smithi031.stdout:(53/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 82 MB/s | 1.5 MB 00:00 2020-11-20T13:54:11.927 INFO:teuthology.orchestra.run.smithi031.stdout:(54/133): python3-mako-1.0.6-13.el8.noarch.rpm 59 MB/s | 157 kB 00:00 2020-11-20T13:54:11.928 INFO:teuthology.orchestra.run.smithi031.stdout:(55/133): python3-markupsafe-0.23-19.el8.x86_64 30 MB/s | 39 kB 00:00 2020-11-20T13:54:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:(56/133): python3-numpy-1.14.3-9.el8.x86_64.rpm 84 MB/s | 3.7 MB 00:00 2020-11-20T13:54:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:(57/133): python3-numpy-f2py-1.14.3-9.el8.x86_6 64 MB/s | 225 kB 00:00 2020-11-20T13:54:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:(58/133): python3-prettytable-0.7.2-14.el8.noar 36 MB/s | 44 kB 00:00 2020-11-20T13:54:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:(59/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 55 MB/s | 126 kB 00:00 2020-11-20T13:54:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:(60/133): python3-pyasn1-modules-0.3.7-6.el8.no 53 MB/s | 110 kB 00:00 2020-11-20T13:54:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:(61/133): python3-pytz-2017.2-9.el8.noarch.rpm 39 MB/s | 54 kB 00:00 2020-11-20T13:54:12.192 INFO:teuthology.orchestra.run.smithi031.stdout:(62/133): python3-scipy-1.0.0-20.module_el8.1.0 70 MB/s | 15 MB 00:00 2020-11-20T13:54:12.193 INFO:teuthology.orchestra.run.smithi031.stdout:(63/133): python3-webencodings-0.5.1-6.el8.noar 19 MB/s | 27 kB 00:00 2020-11-20T13:54:12.199 INFO:teuthology.orchestra.run.smithi031.stdout:(64/133): python3-werkzeug-0.12.2-4.el8.noarch. 73 MB/s | 457 kB 00:00 2020-11-20T13:54:12.204 INFO:teuthology.orchestra.run.smithi031.stdout:(65/133): socat-1.7.3.2-6.el8.x86_64.rpm 68 MB/s | 298 kB 00:00 2020-11-20T13:54:12.205 INFO:teuthology.orchestra.run.smithi031.stdout:(66/133): elfutils-libelf-devel-0.176-5.el8.x86 39 MB/s | 54 kB 00:00 2020-11-20T13:54:12.207 INFO:teuthology.orchestra.run.smithi031.stdout:(67/133): fuse-2.9.7-12.el8.x86_64.rpm 46 MB/s | 82 kB 00:00 2020-11-20T13:54:12.208 INFO:teuthology.orchestra.run.smithi031.stdout:(68/133): fuse-common-3.2.1-12.el8.x86_64.rpm 21 MB/s | 21 kB 00:00 2020-11-20T13:54:12.210 INFO:teuthology.orchestra.run.smithi031.stdout:(69/133): keyutils-libs-devel-1.5.10-6.el8.x86_ 37 MB/s | 48 kB 00:00 2020-11-20T13:54:12.217 INFO:teuthology.orchestra.run.smithi031.stdout:(70/133): krb5-devel-1.17-9.el8.x86_64.rpm 76 MB/s | 548 kB 00:00 2020-11-20T13:54:12.238 INFO:teuthology.orchestra.run.smithi031.stdout:(71/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 884 kB/s | 19 kB 00:00 2020-11-20T13:54:12.240 INFO:teuthology.orchestra.run.smithi031.stdout:(72/133): libcom_err-devel-1.44.6-3.el8.x86_64. 28 MB/s | 38 kB 00:00 2020-11-20T13:54:12.248 INFO:teuthology.orchestra.run.smithi031.stdout:(73/133): libgfortran-8.3.1-4.5.el8.x86_64.rpm 78 MB/s | 638 kB 00:00 2020-11-20T13:54:12.251 INFO:teuthology.orchestra.run.smithi031.stdout:(74/133): libquadmath-8.3.1-4.5.el8.x86_64.rpm 61 MB/s | 169 kB 00:00 2020-11-20T13:54:12.252 INFO:teuthology.orchestra.run.smithi031.stdout:(75/133): librabbitmq-0.9.0-1.el8.x86_64.rpm 38 MB/s | 47 kB 00:00 2020-11-20T13:54:12.256 INFO:teuthology.orchestra.run.smithi031.stdout:(76/133): libselinux-devel-2.9-2.1.el8.x86_64.r 65 MB/s | 199 kB 00:00 2020-11-20T13:54:12.258 INFO:teuthology.orchestra.run.smithi031.stdout:(77/133): libsepol-devel-2.9-1.el8.x86_64.rpm 50 MB/s | 86 kB 00:00 2020-11-20T13:54:12.259 INFO:teuthology.orchestra.run.smithi031.stdout:(78/133): libuuid-devel-2.32.1-17.el8.x86_64.rp 51 MB/s | 95 kB 00:00 2020-11-20T13:54:12.261 INFO:teuthology.orchestra.run.smithi031.stdout:(79/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 17 MB/s | 18 kB 00:00 2020-11-20T13:54:12.264 INFO:teuthology.orchestra.run.smithi031.stdout:(80/133): libxslt-1.1.32-3.el8.x86_64.rpm 70 MB/s | 249 kB 00:00 2020-11-20T13:54:12.292 INFO:teuthology.orchestra.run.smithi031.stdout:(81/133): openssl-devel-1.1.1c-2.el8_1.1.x86_64 83 MB/s | 2.3 MB 00:00 2020-11-20T13:54:12.317 INFO:teuthology.orchestra.run.smithi031.stdout:(82/133): ceph-mgr-diskprediction-local-15.2.5- 8.0 MB/s | 8.6 MB 00:01 2020-11-20T13:54:12.327 INFO:teuthology.orchestra.run.smithi031.stdout:(83/133): pcre2-devel-10.32-1.el8.x86_64.rpm 17 MB/s | 605 kB 00:00 2020-11-20T13:54:12.330 INFO:teuthology.orchestra.run.smithi031.stdout:(84/133): pcre2-utf32-10.32-1.el8.x86_64.rpm 60 MB/s | 220 kB 00:00 2020-11-20T13:54:12.334 INFO:teuthology.orchestra.run.smithi031.stdout:(85/133): python3-chardet-3.0.4-7.el8.noarch.rp 64 MB/s | 195 kB 00:00 2020-11-20T13:54:12.337 INFO:teuthology.orchestra.run.smithi031.stdout:(86/133): python3-jwt-1.6.1-2.el8.noarch.rpm 12 MB/s | 43 kB 00:00 2020-11-20T13:54:12.340 INFO:teuthology.orchestra.run.smithi031.stdout:(87/133): python3-oauthlib-2.1.0-1.el8.noarch.r 48 MB/s | 155 kB 00:00 2020-11-20T13:54:12.347 INFO:teuthology.orchestra.run.smithi031.stdout:(88/133): python3-pysocks-1.6.8-3.el8.noarch.rp 5.6 MB/s | 34 kB 00:00 2020-11-20T13:54:12.349 INFO:teuthology.orchestra.run.smithi031.stdout:(89/133): python3-requests-2.20.0-2.1.el8_1.noa 53 MB/s | 123 kB 00:00 2020-11-20T13:54:12.351 INFO:teuthology.orchestra.run.smithi031.stdout:(90/133): python3-requests-oauthlib-1.0.0-1.el8 27 MB/s | 43 kB 00:00 2020-11-20T13:54:12.352 INFO:teuthology.orchestra.run.smithi031.stdout:(91/133): pcre2-utf16-10.32-1.el8.x86_64.rpm 6.4 MB/s | 228 kB 00:00 2020-11-20T13:54:12.378 INFO:teuthology.orchestra.run.smithi031.stdout:(92/133): python3-urllib3-1.24.2-2.el8.noarch.r 6.4 MB/s | 176 kB 00:00 2020-11-20T13:54:12.379 INFO:teuthology.orchestra.run.smithi031.stdout:(93/133): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 2.5 MB/s | 69 kB 00:00 2020-11-20T13:54:12.380 INFO:teuthology.orchestra.run.smithi031.stdout:(94/133): zlib-devel-1.2.11-10.el8.x86_64.rpm 35 MB/s | 56 kB 00:00 2020-11-20T13:54:12.461 INFO:teuthology.orchestra.run.smithi031.stdout:(95/133): fmt-6.2.1-1.el8.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2020-11-20T13:54:12.477 INFO:teuthology.orchestra.run.smithi031.stdout:(96/133): gperftools-libs-2.7-6.el8.x86_64.rpm 3.2 MB/s | 315 kB 00:00 2020-11-20T13:54:12.494 INFO:teuthology.orchestra.run.smithi031.stdout:(97/133): leveldb-1.22-1.el8.x86_64.rpm 5.3 MB/s | 181 kB 00:00 2020-11-20T13:54:12.494 INFO:teuthology.orchestra.run.smithi031.stdout:(98/133): liboath-2.6.2-3.el8.x86_64.rpm 3.3 MB/s | 59 kB 00:00 2020-11-20T13:54:12.511 INFO:teuthology.orchestra.run.smithi031.stdout:(99/133): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2020-11-20T13:54:12.511 INFO:teuthology.orchestra.run.smithi031.stdout:(100/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.2 MB/s | 21 kB 00:00 2020-11-20T13:54:12.528 INFO:teuthology.orchestra.run.smithi031.stdout:(101/133): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.6 MB/s | 44 kB 00:00 2020-11-20T13:54:12.529 INFO:teuthology.orchestra.run.smithi031.stdout:(102/133): python3-beautifulsoup4-4.6.3-2.el8.1 10 MB/s | 185 kB 00:00 2020-11-20T13:54:12.544 INFO:teuthology.orchestra.run.smithi031.stdout:(103/133): python3-cachetools-3.1.1-4.el8.noarc 2.0 MB/s | 33 kB 00:00 2020-11-20T13:54:12.545 INFO:teuthology.orchestra.run.smithi031.stdout:(104/133): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-11-20T13:54:12.562 INFO:teuthology.orchestra.run.smithi031.stdout:(105/133): python3-cheroot-8.2.1-1.el8.noarch.r 8.2 MB/s | 145 kB 00:00 2020-11-20T13:54:12.579 INFO:teuthology.orchestra.run.smithi031.stdout:(106/133): python3-cherrypy-18.4.0-1.el8.noarch 11 MB/s | 384 kB 00:00 2020-11-20T13:54:12.579 INFO:teuthology.orchestra.run.smithi031.stdout:(107/133): python3-cssselect-0.9.2-10.el8.noarc 2.2 MB/s | 40 kB 00:00 2020-11-20T13:54:12.598 INFO:teuthology.orchestra.run.smithi031.stdout:(108/133): python3-execnet-1.7.1-1.el8.noarch.r 19 MB/s | 355 kB 00:00 2020-11-20T13:54:12.598 INFO:teuthology.orchestra.run.smithi031.stdout:(109/133): python3-google-auth-1.1.1-10.el8.noa 4.2 MB/s | 81 kB 00:00 2020-11-20T13:54:12.614 INFO:teuthology.orchestra.run.smithi031.stdout:(110/133): python3-jaraco-6.2-6.el8.noarch.rpm 690 kB/s | 11 kB 00:00 2020-11-20T13:54:12.615 INFO:teuthology.orchestra.run.smithi031.stdout:(111/133): python3-jaraco-functools-2.0-4.el8.n 1.1 MB/s | 18 kB 00:00 2020-11-20T13:54:12.631 INFO:teuthology.orchestra.run.smithi031.stdout:(112/133): python3-logutils-0.3.5-11.el8.noarch 2.9 MB/s | 49 kB 00:00 2020-11-20T13:54:12.648 INFO:teuthology.orchestra.run.smithi031.stdout:(113/133): python3-more-itertools-7.2.0-3.el8.n 3.5 MB/s | 59 kB 00:00 2020-11-20T13:54:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:(114/133): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2020-11-20T13:54:12.681 INFO:teuthology.orchestra.run.smithi031.stdout:(115/133): python3-kubernetes-11.0.0-2.el8.noar 17 MB/s | 1.2 MB 00:00 2020-11-20T13:54:12.684 INFO:teuthology.orchestra.run.smithi031.stdout:(116/133): python3-portend-2.6-1.el8.noarch.rpm 954 kB/s | 16 kB 00:00 2020-11-20T13:54:12.697 INFO:teuthology.orchestra.run.smithi031.stdout:(117/133): python3-remoto-1.1.4-4.el8.noarch.rp 2.8 MB/s | 48 kB 00:00 2020-11-20T13:54:12.700 INFO:teuthology.orchestra.run.smithi031.stdout:(118/133): python3-repoze-lru-0.7-6.el8.noarch. 2.0 MB/s | 34 kB 00:00 2020-11-20T13:54:12.715 INFO:teuthology.orchestra.run.smithi031.stdout:(119/133): python3-routes-2.4.1-12.el8.noarch.r 11 MB/s | 196 kB 00:00 2020-11-20T13:54:12.717 INFO:teuthology.orchestra.run.smithi031.stdout:(120/133): python3-rsa-3.4.2-15.el8.noarch.rpm 4.2 MB/s | 73 kB 00:00 2020-11-20T13:54:12.732 INFO:teuthology.orchestra.run.smithi031.stdout:(121/133): python3-simplegeneric-0.8.1-17.el8.n 1.1 MB/s | 19 kB 00:00 2020-11-20T13:54:12.734 INFO:teuthology.orchestra.run.smithi031.stdout:(122/133): python3-singledispatch-3.4.0.3-18.el 1.4 MB/s | 24 kB 00:00 2020-11-20T13:54:12.748 INFO:teuthology.orchestra.run.smithi031.stdout:(123/133): python3-tempora-1.14.1-5.el8.noarch. 1.7 MB/s | 29 kB 00:00 2020-11-20T13:54:12.750 INFO:teuthology.orchestra.run.smithi031.stdout:(124/133): python3-trustme-0.6.0-4.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2020-11-20T13:54:12.767 INFO:teuthology.orchestra.run.smithi031.stdout:(125/133): python3-waitress-1.2.1-2.el8.1.noarc 13 MB/s | 241 kB 00:00 2020-11-20T13:54:12.769 INFO:teuthology.orchestra.run.smithi031.stdout:(126/133): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-11-20T13:54:12.784 INFO:teuthology.orchestra.run.smithi031.stdout:(127/133): python3-websocket-client-0.56.0-5.el 3.6 MB/s | 61 kB 00:00 2020-11-20T13:54:12.786 INFO:teuthology.orchestra.run.smithi031.stdout:(128/133): python3-webtest-2.0.33-1.el8.noarch. 4.9 MB/s | 85 kB 00:00 2020-11-20T13:54:12.800 INFO:teuthology.orchestra.run.smithi031.stdout:(129/133): python3-zc-lockfile-2.0-2.el8.noarch 1.4 MB/s | 23 kB 00:00 2020-11-20T13:54:12.803 INFO:teuthology.orchestra.run.smithi031.stdout:(130/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.0 MB/s | 69 kB 00:00 2020-11-20T13:54:12.864 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2020-11-20T13:54:12.864 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2020-11-20T13:54:13.185 INFO:teuthology.orchestra.run.smithi031.stdout:(131/133): ceph-test-15.2.5-588.ga7b62340.el8.x 8.3 MB/s | 42 MB 00:05 2020-11-20T13:54:13.218 INFO:teuthology.orchestra.run.smithi031.stdout:(132/133): librbd1-15.2.5-588.ga7b62340.el8.x86 4.7 MB/s | 1.9 MB 00:00 2020-11-20T13:54:13.470 INFO:teuthology.orchestra.run.smithi031.stdout:(133/133): librados2-15.2.5-588.ga7b62340.el8.x 5.3 MB/s | 3.6 MB 00:00 2020-11-20T13:54:13.474 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2020-11-20T13:54:13.475 INFO:teuthology.orchestra.run.smithi031.stdout:Total 16 MB/s | 185 MB 00:11 2020-11-20T13:54:13.543 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2020-11-20T13:54:13.724 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2020-11-20T13:54:13.724 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2020-11-20T13:54:15.165 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2020-11-20T13:54:15.166 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2020-11-20T13:54:18.050 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2020-11-20T13:54:18.259 INFO:teuthology.orchestra.run.smithi039.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/140 2020-11-20T13:54:18.314 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/140 2020-11-20T13:54:18.460 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/140 2020-11-20T13:54:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/140 2020-11-20T13:54:18.823 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/140 2020-11-20T13:54:18.962 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/140 2020-11-20T13:54:19.024 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/140 2020-11-20T13:54:19.214 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/140 2020-11-20T13:54:19.404 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/140 2020-11-20T13:54:19.812 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/140 2020-11-20T13:54:20.012 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:15.2.5-588.ga7b62340.el8.x86_64 8/140 2020-11-20T13:54:20.259 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:15.2.5-588.ga7b62340.el8.x86_64 8/140 2020-11-20T13:54:20.378 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2020-11-20T13:54:20.478 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:15.2.5-588.ga7b62340.el8.x86_64 9/140 2020-11-20T13:54:20.570 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:15.2.5-588.ga7b62340.el8.x86_64 9/140 2020-11-20T13:54:20.594 INFO:teuthology.orchestra.run.smithi031.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/140 2020-11-20T13:54:20.670 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/140 2020-11-20T13:54:20.720 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:15.2.5-588.ga7b62340.el8.x86_64 10/140 2020-11-20T13:54:20.806 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/140 2020-11-20T13:54:20.829 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:15.2.5-588.ga7b62340.el8.x86_64 10/140 2020-11-20T13:54:20.935 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/140 2020-11-20T13:54:21.119 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/140 2020-11-20T13:54:21.250 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/140 2020-11-20T13:54:21.300 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:15.2.5-588.ga7b62340.el8.x86_64 11/140 2020-11-20T13:54:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/140 2020-11-20T13:54:21.437 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:15.2.5-588.ga7b62340.el8.x86_64 12/140 2020-11-20T13:54:21.522 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/140 2020-11-20T13:54:21.625 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:15.2.5-588.ga7b62340.el8.x86_64 12/140 2020-11-20T13:54:21.683 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/140 2020-11-20T13:54:21.859 INFO:teuthology.orchestra.run.smithi039.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/140 2020-11-20T13:54:22.027 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/140 2020-11-20T13:54:22.105 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/140 2020-11-20T13:54:22.247 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/140 2020-11-20T13:54:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:15.2.5-588.ga7b62340.el8.x86_64 8/140 2020-11-20T13:54:22.439 INFO:teuthology.orchestra.run.smithi039.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/140 2020-11-20T13:54:22.546 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:15.2.5-588.ga7b62340.el8.x86_64 8/140 2020-11-20T13:54:22.570 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:15.2.5-588.ga7b62340.el8.x86_ 17/140 2020-11-20T13:54:22.678 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:15.2.5-588.ga7b62340.el8.x86_ 17/140 2020-11-20T13:54:22.750 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:15.2.5-588.ga7b62340.el8.x86_64 9/140 2020-11-20T13:54:22.852 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:15.2.5-588.ga7b62340.el8.x86_64 9/140 2020-11-20T13:54:22.926 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/140 2020-11-20T13:54:22.983 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:15.2.5-588.ga7b62340.el8.x86_64 10/140 2020-11-20T13:54:23.066 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 19/140 2020-11-20T13:54:23.076 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:15.2.5-588.ga7b62340.el8.x86_64 10/140 2020-11-20T13:54:23.229 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 20/140 2020-11-20T13:54:23.429 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 21/140 2020-11-20T13:54:23.546 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:15.2.5-588.ga7b62340.el8.x86_64 11/140 2020-11-20T13:54:23.578 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 22/140 2020-11-20T13:54:23.682 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:15.2.5-588.ga7b62340.el8.x86_64 12/140 2020-11-20T13:54:23.708 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 22/140 2020-11-20T13:54:23.850 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:15.2.5-588.ga7b62340.el8.x86_64 12/140 2020-11-20T13:54:23.861 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 23/140 2020-11-20T13:54:24.038 INFO:teuthology.orchestra.run.smithi031.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/140 2020-11-20T13:54:24.240 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/140 2020-11-20T13:54:24.401 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/140 2020-11-20T13:54:24.441 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 23/140 2020-11-20T13:54:24.595 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.3-2.el8.x86_64 24/140 2020-11-20T13:54:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/140 2020-11-20T13:54:24.799 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:15.2.5-588.ga7b62340.el8.x86_ 17/140 2020-11-20T13:54:24.928 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:15.2.5-588.ga7b62340.el8.x86_ 17/140 2020-11-20T13:54:25.155 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 24/140 2020-11-20T13:54:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/140 2020-11-20T13:54:25.295 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 25/140 2020-11-20T13:54:25.405 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 19/140 2020-11-20T13:54:25.568 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 20/140 2020-11-20T13:54:25.743 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 21/140 2020-11-20T13:54:25.882 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 22/140 2020-11-20T13:54:26.028 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 25/140 2020-11-20T13:54:26.029 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 22/140 2020-11-20T13:54:26.199 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 23/140 2020-11-20T13:54:26.351 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 26/140 2020-11-20T13:54:26.534 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/140 2020-11-20T13:54:26.674 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/140 2020-11-20T13:54:26.771 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 23/140 2020-11-20T13:54:26.899 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.3-2.el8.x86_64 24/140 2020-11-20T13:54:26.994 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/140 2020-11-20T13:54:27.158 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:15.2.5-588.ga7b62340.el8.x 30/140 2020-11-20T13:54:27.280 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:15.2.5-588.ga7b62340.el8 31/140 2020-11-20T13:54:27.485 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 24/140 2020-11-20T13:54:27.511 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:15.2.5-588.ga7b62340.el8.x86_64 32/140 2020-11-20T13:54:27.615 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 25/140 2020-11-20T13:54:28.358 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 25/140 2020-11-20T13:54:28.479 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/140 2020-11-20T13:54:28.673 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 26/140 2020-11-20T13:54:28.810 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/140 2020-11-20T13:54:28.889 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/140 2020-11-20T13:54:29.028 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/140 2020-11-20T13:54:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/140 2020-11-20T13:54:29.199 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/140 2020-11-20T13:54:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 36/140 2020-11-20T13:54:29.370 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:15.2.5-588.ga7b62340.el8.x 30/140 2020-11-20T13:54:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:15.2.5-588.ga7b62340.el8 31/140 2020-11-20T13:54:29.707 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:15.2.5-588.ga7b62340.el8.x86_64 32/140 2020-11-20T13:54:30.900 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/140 2020-11-20T13:54:31.222 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/140 2020-11-20T13:54:31.366 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 36/140 2020-11-20T13:54:31.507 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/140 2020-11-20T13:54:31.697 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 37/140 2020-11-20T13:54:31.806 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 36/140 2020-11-20T13:54:31.912 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 38/140 2020-11-20T13:54:32.167 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 39/140 2020-11-20T13:54:32.395 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/140 2020-11-20T13:54:32.581 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 41/140 2020-11-20T13:54:32.781 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:15.2.5-588.ga7b62340.el8.x86_64 42/140 2020-11-20T13:54:32.942 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:15.2.5-588.ga7b62340.el8.x86_64 43/140 2020-11-20T13:54:33.134 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:15.2.5-588.ga7b62340.el8.x86_64 44/140 2020-11-20T13:54:33.336 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 45/140 2020-11-20T13:54:33.509 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 46/140 2020-11-20T13:54:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 47/140 2020-11-20T13:54:33.904 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 36/140 2020-11-20T13:54:33.961 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 48/140 2020-11-20T13:54:34.118 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/140 2020-11-20T13:54:34.209 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 37/140 2020-11-20T13:54:34.265 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 50/140 2020-11-20T13:54:34.431 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 51/140 2020-11-20T13:54:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 38/140 2020-11-20T13:54:34.623 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 52/140 2020-11-20T13:54:34.636 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 39/140 2020-11-20T13:54:34.824 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 53/140 2020-11-20T13:54:34.864 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/140 2020-11-20T13:54:34.997 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 54/140 2020-11-20T13:54:35.133 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 55/140 2020-11-20T13:54:35.177 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 41/140 2020-11-20T13:54:35.438 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 56/140 2020-11-20T13:54:35.652 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:15.2.5-588.ga7b62340.el8.x86_64 42/140 2020-11-20T13:54:35.657 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 57/140 2020-11-20T13:54:35.825 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 58/140 2020-11-20T13:54:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:15.2.5-588.ga7b62340.el8.x86_64 43/140 2020-11-20T13:54:36.047 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-2.6-1.el8.noarch 59/140 2020-11-20T13:54:36.165 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:15.2.5-588.ga7b62340.el8.x86_64 44/140 2020-11-20T13:54:36.255 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 60/140 2020-11-20T13:54:36.324 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 45/140 2020-11-20T13:54:36.401 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 61/140 2020-11-20T13:54:36.504 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 46/140 2020-11-20T13:54:36.569 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/140 2020-11-20T13:54:36.762 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 47/140 2020-11-20T13:54:36.778 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/140 2020-11-20T13:54:36.946 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/140 2020-11-20T13:54:37.007 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 48/140 2020-11-20T13:54:37.151 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 65/140 2020-11-20T13:54:37.180 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/140 2020-11-20T13:54:37.336 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 50/140 2020-11-20T13:54:37.431 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 66/140 2020-11-20T13:54:37.459 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 51/140 2020-11-20T13:54:37.625 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 67/140 2020-11-20T13:54:37.651 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 52/140 2020-11-20T13:54:37.829 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 68/140 2020-11-20T13:54:37.869 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 53/140 2020-11-20T13:54:38.000 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 69/140 2020-11-20T13:54:38.017 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 54/140 2020-11-20T13:54:38.145 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 55/140 2020-11-20T13:54:38.201 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 70/140 2020-11-20T13:54:38.324 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 56/140 2020-11-20T13:54:38.434 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 71/140 2020-11-20T13:54:38.502 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 57/140 2020-11-20T13:54:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 58/140 2020-11-20T13:54:38.792 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 72/140 2020-11-20T13:54:38.882 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-2.6-1.el8.noarch 59/140 2020-11-20T13:54:39.003 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 73/140 2020-11-20T13:54:39.083 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 60/140 2020-11-20T13:54:39.184 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 74/140 2020-11-20T13:54:39.229 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 61/140 2020-11-20T13:54:39.380 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/140 2020-11-20T13:54:39.549 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/140 2020-11-20T13:54:39.758 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/140 2020-11-20T13:54:39.930 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 65/140 2020-11-20T13:54:40.160 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 66/140 2020-11-20T13:54:40.304 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/140 2020-11-20T13:54:40.465 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 67/140 2020-11-20T13:54:40.547 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 76/140 2020-11-20T13:54:40.659 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 68/140 2020-11-20T13:54:40.777 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 77/140 2020-11-20T13:54:40.845 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 69/140 2020-11-20T13:54:41.022 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 70/140 2020-11-20T13:54:41.083 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 78/140 2020-11-20T13:54:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 71/140 2020-11-20T13:54:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 72/140 2020-11-20T13:54:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 73/140 2020-11-20T13:54:41.670 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 79/140 2020-11-20T13:54:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 74/140 2020-11-20T13:54:41.842 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 80/140 2020-11-20T13:54:42.002 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 81/140 2020-11-20T13:54:42.278 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 82/140 2020-11-20T13:54:42.589 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 83/140 2020-11-20T13:54:42.740 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 84/140 2020-11-20T13:54:42.938 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/140 2020-11-20T13:54:42.951 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 85/140 2020-11-20T13:54:43.167 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 76/140 2020-11-20T13:54:43.203 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 86/140 2020-11-20T13:54:43.204 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 87/140 2020-11-20T13:54:43.204 INFO:teuthology.orchestra.run.smithi039.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T13:54:43.204 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:54:43.421 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 77/140 2020-11-20T13:54:43.588 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.7-12.el8.x86_64 88/140 2020-11-20T13:54:43.694 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 78/140 2020-11-20T13:54:43.812 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 89/140 2020-11-20T13:54:43.857 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 79/140 2020-11-20T13:54:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 80/140 2020-11-20T13:54:44.034 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 90/140 2020-11-20T13:54:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 81/140 2020-11-20T13:54:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 82/140 2020-11-20T13:54:44.438 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 91/140 2020-11-20T13:54:44.576 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 83/140 2020-11-20T13:54:44.698 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 92/140 2020-11-20T13:54:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 84/140 2020-11-20T13:54:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 85/140 2020-11-20T13:54:45.026 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 93/140 2020-11-20T13:54:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 86/140 2020-11-20T13:54:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 87/140 2020-11-20T13:54:45.124 INFO:teuthology.orchestra.run.smithi031.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T13:54:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:54:45.326 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 94/140 2020-11-20T13:54:45.475 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 95/140 2020-11-20T13:54:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.7-12.el8.x86_64 88/140 2020-11-20T13:54:45.708 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 89/140 2020-11-20T13:54:45.939 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 90/140 2020-11-20T13:54:46.351 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 91/140 2020-11-20T13:54:46.608 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 92/140 2020-11-20T13:54:46.941 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 93/140 2020-11-20T13:54:47.196 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 94/140 2020-11-20T13:54:47.346 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 95/140 2020-11-20T13:54:49.324 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 96/140 2020-11-20T13:54:49.566 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 96/140 2020-11-20T13:54:50.288 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 96/140 2020-11-20T13:54:50.588 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:15.2.5-588.ga7b62340.el8.x86_64 97/140 2020-11-20T13:54:50.678 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:15.2.5-588.ga7b62340.el8.x86_64 97/140 2020-11-20T13:54:50.799 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:15.2.5-588.ga7b62340.el8.x86_64 98/140 2020-11-20T13:54:51.170 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 96/140 2020-11-20T13:54:51.470 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 96/140 2020-11-20T13:54:52.170 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 96/140 2020-11-20T13:54:52.464 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:15.2.5-588.ga7b62340.el8.x86_64 97/140 2020-11-20T13:54:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:15.2.5-588.ga7b62340.el8.x86_64 97/140 2020-11-20T13:54:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:15.2.5-588.ga7b62340.el8.x86_64 98/140 2020-11-20T13:55:08.302 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:15.2.5-588.ga7b62340.el8.x86_64 98/140 2020-11-20T13:55:08.303 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2020-11-20T13:55:08.303 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2020-11-20T13:55:08.303 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /dev 2020-11-20T13:55:08.303 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /run 2020-11-20T13:55:08.304 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2020-11-20T13:55:08.304 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2020-11-20T13:55:08.304 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2020-11-20T13:55:08.304 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2020-11-20T13:55:08.304 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /dev 2020-11-20T13:55:08.305 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:15.2.5-588.ga7b62340.el8.x86_64 99/140 2020-11-20T13:55:09.083 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:15.2.5-588.ga7b62340.el8.x86_64 99/140 2020-11-20T13:55:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:15.2.5-588.ga7b62340.el8.x86_64 100/140 2020-11-20T13:55:10.089 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:15.2.5-588.ga7b62340.el8.x86_64 98/140 2020-11-20T13:55:10.089 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2020-11-20T13:55:10.089 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2020-11-20T13:55:10.090 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2020-11-20T13:55:10.090 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /run 2020-11-20T13:55:10.090 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2020-11-20T13:55:10.090 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2020-11-20T13:55:10.091 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2020-11-20T13:55:10.091 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2020-11-20T13:55:10.091 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2020-11-20T13:55:10.091 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:15.2.5-588.ga7b62340.el8.x86_64 99/140 2020-11-20T13:55:10.762 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:15.2.5-588.ga7b62340.el8.x86_64 100/140 2020-11-20T13:55:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:15.2.5-588.ga7b62340.el8.x86_64 99/140 2020-11-20T13:55:10.943 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:15.2.5-588.ga7b62340.el8.x86_64 101/140 2020-11-20T13:55:10.975 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:15.2.5-588.ga7b62340.el8.x86_64 101/140 2020-11-20T13:55:11.019 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:15.2.5-588.ga7b62340.el8.x86_64 100/140 2020-11-20T13:55:11.153 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 102/140 2020-11-20T13:55:11.400 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 103/140 2020-11-20T13:55:11.554 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 104/140 2020-11-20T13:55:11.638 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 104/140 2020-11-20T13:55:11.930 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jq-1.5-12.el8.x86_64 105/140 2020-11-20T13:55:12.147 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : automake-1.16.1-6.el8.noarch 106/140 2020-11-20T13:55:12.270 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:15.2.5-588.ga7b62340.el 107/140 2020-11-20T13:55:12.480 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:15.2.5-588.ga7b62340.e 108/140 2020-11-20T13:55:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:15.2.5-588.ga7b62340.el8.x86_64 100/140 2020-11-20T13:55:12.711 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:15.2.5-588.ga7b62340.el8.x86_64 101/140 2020-11-20T13:55:12.742 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:15.2.5-588.ga7b62340.el8.x86_64 101/140 2020-11-20T13:55:12.941 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 102/140 2020-11-20T13:55:13.145 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 103/140 2020-11-20T13:55:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 104/140 2020-11-20T13:55:13.933 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 104/140 2020-11-20T13:55:13.934 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:15.2.5-588.ga7b62340.el8.x86_64 109/140 2020-11-20T13:55:14.216 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.5-12.el8.x86_64 105/140 2020-11-20T13:55:14.442 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : automake-1.16.1-6.el8.noarch 106/140 2020-11-20T13:55:14.541 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:15.2.5-588.ga7b62340.el 107/140 2020-11-20T13:55:14.717 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:15.2.5-588.ga7b62340.e 108/140 2020-11-20T13:55:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:15.2.5-588.ga7b62340.el8.x86_64 109/140 2020-11-20T13:55:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:15.2.5-588.ga7b62340.el8.noar 110/140 2020-11-20T13:55:16.174 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.5-588.ga7b62340.el8.noar 110/140 2020-11-20T13:55:16.181 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:15.2.5-588.ga7b62340.el8.x86_64 109/140 2020-11-20T13:55:16.361 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:15.2.5-588.ga7b62340.el8.x86_64 109/140 2020-11-20T13:55:16.417 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:15.2.5-588.ga7b62340.el8.no 111/140 2020-11-20T13:55:16.565 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:15.2.5-588.ga7b62340.el8.noar 110/140 2020-11-20T13:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.5-588.ga7b62340.el8.noar 110/140 2020-11-20T13:55:17.524 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.5-588.ga7b62340.el8.no 111/140 2020-11-20T13:55:17.745 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.5-588.ga7b6 112/140 2020-11-20T13:55:17.768 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:15.2.5-588.ga7b62340.el8.no 111/140 2020-11-20T13:55:17.823 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.5-588.ga7b6 112/140 2020-11-20T13:55:18.140 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:15.2.5-588.ga7b62340.el8 113/140 2020-11-20T13:55:18.375 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:15.2.5-588.ga7b62340.el8.x86_64 114/140 2020-11-20T13:55:18.404 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:15.2.5-588.ga7b62340.el8.x86_64 114/140 2020-11-20T13:55:18.553 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:15.2.5-588.ga7b62340.el8.noarch 115/140 2020-11-20T13:55:18.568 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.5-588.ga7b62340.el8.noarch 115/140 2020-11-20T13:55:18.738 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:15.2.5-588.ga7b62340.el8.x86_64 116/140 2020-11-20T13:55:18.878 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.5-588.ga7b62340.el8.no 111/140 2020-11-20T13:55:18.903 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/140 2020-11-20T13:55:19.365 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.5-588.ga7b6 112/140 2020-11-20T13:55:19.448 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.5-588.ga7b6 112/140 2020-11-20T13:55:19.766 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:15.2.5-588.ga7b62340.el8 113/140 2020-11-20T13:55:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:15.2.5-588.ga7b62340.el8.x86_64 114/140 2020-11-20T13:55:19.971 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:15.2.5-588.ga7b62340.el8.x86_64 114/140 2020-11-20T13:55:20.098 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:15.2.5-588.ga7b62340.el8.noarch 115/140 2020-11-20T13:55:20.112 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.5-588.ga7b62340.el8.noarch 115/140 2020-11-20T13:55:20.310 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:15.2.5-588.ga7b62340.el8.x86_64 116/140 2020-11-20T13:55:20.448 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/140 2020-11-20T13:55:23.053 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/140 2020-11-20T13:55:24.282 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:15.2.5-588.ga7b62340.el8.x86_64 118/140 2020-11-20T13:55:24.486 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:15.2.5-588.ga7b62340.el8.x86_64 119/140 2020-11-20T13:55:24.833 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:15.2.5-588.ga7b62340.el8.x86_64 119/140 2020-11-20T13:55:24.986 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:15.2.5-588.ga7b62340.el8.x86_64 120/140 2020-11-20T13:55:25.059 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:15.2.5-588.ga7b62340.el8.x86_64 120/140 2020-11-20T13:55:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/140 2020-11-20T13:55:25.954 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 121/140 2020-11-20T13:55:26.197 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 122/140 2020-11-20T13:55:26.413 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 123/140 2020-11-20T13:55:26.630 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:15.2.5-588.ga7b62340.el8.x86_6 124/140 2020-11-20T13:55:26.736 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:15.2.5-588.ga7b62340.el8.x86_64 118/140 2020-11-20T13:55:26.923 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:15.2.5-588.ga7b62340.el8.x86_64 119/140 2020-11-20T13:55:27.007 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 125/140 2020-11-20T13:55:27.266 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:15.2.5-588.ga7b62340.el8.x86_64 119/140 2020-11-20T13:55:27.394 INFO:teuthology.orchestra.run.smithi039.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 126/140 2020-11-20T13:55:27.440 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:15.2.5-588.ga7b62340.el8.x86_64 120/140 2020-11-20T13:55:27.511 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:15.2.5-588.ga7b62340.el8.x86_64 120/140 2020-11-20T13:55:27.616 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 127/140 2020-11-20T13:55:27.822 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:15.2.5-588.ga7b62340.el8.x86_64 128/140 2020-11-20T13:55:27.994 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:15.2.5-588.ga7b623 129/140 2020-11-20T13:55:28.107 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.5-588.ga7b623 129/140 2020-11-20T13:55:28.345 INFO:teuthology.orchestra.run.smithi039.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 130/140 2020-11-20T13:55:28.452 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 121/140 2020-11-20T13:55:28.536 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/140 2020-11-20T13:55:28.709 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 122/140 2020-11-20T13:55:28.710 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/140 2020-11-20T13:55:28.809 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/140 2020-11-20T13:55:28.850 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 123/140 2020-11-20T13:55:29.008 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:15.2.5-588.ga7b62340.el8.x86_6 124/140 2020-11-20T13:55:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/140 2020-11-20T13:55:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/140 2020-11-20T13:55:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 134/140 2020-11-20T13:55:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 135/140 2020-11-20T13:55:29.391 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 125/140 2020-11-20T13:55:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 136/140 2020-11-20T13:55:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 137/140 2020-11-20T13:55:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/140 2020-11-20T13:55:29.746 INFO:teuthology.orchestra.run.smithi031.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 126/140 2020-11-20T13:55:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/140 2020-11-20T13:55:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/140 2020-11-20T13:55:29.978 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 127/140 2020-11-20T13:55:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/140 2020-11-20T13:55:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 140/140 2020-11-20T13:55:30.226 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:15.2.5-588.ga7b62340.el8.x86_64 128/140 2020-11-20T13:55:30.422 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:15.2.5-588.ga7b623 129/140 2020-11-20T13:55:30.536 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.5-588.ga7b623 129/140 2020-11-20T13:55:30.781 INFO:teuthology.orchestra.run.smithi031.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 130/140 2020-11-20T13:55:30.981 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/140 2020-11-20T13:55:31.073 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 140/140 2020-11-20T13:55:31.073 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/140 2020-11-20T13:55:31.073 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/140 2020-11-20T13:55:31.073 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/140 2020-11-20T13:55:31.074 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/140 2020-11-20T13:55:31.074 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/140 2020-11-20T13:55:31.074 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/140 2020-11-20T13:55:31.074 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/140 2020-11-20T13:55:31.075 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/140 2020-11-20T13:55:31.075 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/140 2020-11-20T13:55:31.075 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/140 2020-11-20T13:55:31.075 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:15.2.5-588.ga7b62340.el8.x86_64 11/140 2020-11-20T13:55:31.075 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:15.2.5-588.ga7b62340.el8.x86_64 12/140 2020-11-20T13:55:31.076 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 13/140 2020-11-20T13:55:31.076 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 14/140 2020-11-20T13:55:31.076 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:15.2.5-588.ga7b623 15/140 2020-11-20T13:55:31.076 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:15.2.5-588.ga7b62340.el8.x86_64 16/140 2020-11-20T13:55:31.077 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:15.2.5-588.ga7b62340.el8.x86_64 17/140 2020-11-20T13:55:31.077 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:15.2.5-588.ga7b62340.el8.x86_64 18/140 2020-11-20T13:55:31.077 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:15.2.5-588.ga7b62340.el8.x86_64 19/140 2020-11-20T13:55:31.077 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:15.2.5-588.ga7b62340.el8.x86_64 20/140 2020-11-20T13:55:31.077 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:15.2.5-588.ga7b62340.el8.x86_64 21/140 2020-11-20T13:55:31.078 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:15.2.5-588.ga7b62340.el8.x86_64 22/140 2020-11-20T13:55:31.078 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:15.2.5-588.ga7b62340.el8.x86_64 23/140 2020-11-20T13:55:31.078 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:15.2.5-588.ga7b62340.el8.x86_6 24/140 2020-11-20T13:55:31.078 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:15.2.5-588.ga7b62340.el8.x86_64 25/140 2020-11-20T13:55:31.078 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:15.2.5-588.ga7b62340.el8.x86_64 26/140 2020-11-20T13:55:31.079 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:15.2.5-588.ga7b62340.el8.x86_ 27/140 2020-11-20T13:55:31.079 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:15.2.5-588.ga7b62340.el8.x86_64 28/140 2020-11-20T13:55:31.079 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:15.2.5-588.ga7b62340.el8 29/140 2020-11-20T13:55:31.079 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:15.2.5-588.ga7b62340.el8.x 30/140 2020-11-20T13:55:31.080 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:15.2.5-588.ga7b62340.el8.x86_64 31/140 2020-11-20T13:55:31.080 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:15.2.5-588.ga7b62340.el8.x86_64 32/140 2020-11-20T13:55:31.088 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:15.2.5-588.ga7b62340.el8.x86_64 33/140 2020-11-20T13:55:31.088 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:15.2.5-588.ga7b62340.el8.x86_64 34/140 2020-11-20T13:55:31.088 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 35/140 2020-11-20T13:55:31.089 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:15.2.5-588.ga7b62340.el8.x86_64 36/140 2020-11-20T13:55:31.089 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:15.2.5-588.ga7b62340.el8.x86_64 37/140 2020-11-20T13:55:31.089 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:15.2.5-588.ga7b62340.e 38/140 2020-11-20T13:55:31.089 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:15.2.5-588.ga7b62340.el8.noar 39/140 2020-11-20T13:55:31.089 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:15.2.5-588.ga7b62340.el8.no 40/140 2020-11-20T13:55:31.090 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.5-588.ga7b6 41/140 2020-11-20T13:55:31.090 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:15.2.5-588.ga7b62340.el8 42/140 2020-11-20T13:55:31.090 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:15.2.5-588.ga7b62340.el8.noarch 43/140 2020-11-20T13:55:31.090 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:15.2.5-588.ga7b62340.el 44/140 2020-11-20T13:55:31.091 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/140 2020-11-20T13:55:31.091 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/140 2020-11-20T13:55:31.091 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/140 2020-11-20T13:55:31.091 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jq-1.5-12.el8.x86_64 48/140 2020-11-20T13:55:31.091 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/140 2020-11-20T13:55:31.092 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/140 2020-11-20T13:55:31.092 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/140 2020-11-20T13:55:31.092 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/140 2020-11-20T13:55:31.092 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/140 2020-11-20T13:55:31.092 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/140 2020-11-20T13:55:31.093 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/140 2020-11-20T13:55:31.093 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/140 2020-11-20T13:55:31.093 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/140 2020-11-20T13:55:31.093 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/140 2020-11-20T13:55:31.094 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/140 2020-11-20T13:55:31.094 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/140 2020-11-20T13:55:31.094 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/140 2020-11-20T13:55:31.094 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/140 2020-11-20T13:55:31.094 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/140 2020-11-20T13:55:31.095 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/140 2020-11-20T13:55:31.095 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/140 2020-11-20T13:55:31.095 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/140 2020-11-20T13:55:31.095 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/140 2020-11-20T13:55:31.095 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/140 2020-11-20T13:55:31.096 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/140 2020-11-20T13:55:31.096 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/140 2020-11-20T13:55:31.096 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/140 2020-11-20T13:55:31.096 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/140 2020-11-20T13:55:31.097 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/140 2020-11-20T13:55:31.097 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/140 2020-11-20T13:55:31.097 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/140 2020-11-20T13:55:31.097 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/140 2020-11-20T13:55:31.098 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/140 2020-11-20T13:55:31.098 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/140 2020-11-20T13:55:31.098 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/140 2020-11-20T13:55:31.098 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/140 2020-11-20T13:55:31.099 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/140 2020-11-20T13:55:31.099 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/140 2020-11-20T13:55:31.099 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/140 2020-11-20T13:55:31.099 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/140 2020-11-20T13:55:31.099 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/140 2020-11-20T13:55:31.100 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/140 2020-11-20T13:55:31.100 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/140 2020-11-20T13:55:31.100 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/140 2020-11-20T13:55:31.100 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/140 2020-11-20T13:55:31.100 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/140 2020-11-20T13:55:31.101 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/140 2020-11-20T13:55:31.101 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/140 2020-11-20T13:55:31.101 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/140 2020-11-20T13:55:31.101 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/140 2020-11-20T13:55:31.101 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/140 2020-11-20T13:55:31.102 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/140 2020-11-20T13:55:31.102 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/140 2020-11-20T13:55:31.102 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/140 2020-11-20T13:55:31.102 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/140 2020-11-20T13:55:31.102 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/140 2020-11-20T13:55:31.103 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/140 2020-11-20T13:55:31.103 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/140 2020-11-20T13:55:31.103 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/140 2020-11-20T13:55:31.103 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/140 2020-11-20T13:55:31.103 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/140 2020-11-20T13:55:31.104 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/140 2020-11-20T13:55:31.104 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/140 2020-11-20T13:55:31.104 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/140 2020-11-20T13:55:31.104 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/140 2020-11-20T13:55:31.104 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/140 2020-11-20T13:55:31.105 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/140 2020-11-20T13:55:31.105 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/140 2020-11-20T13:55:31.105 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/140 2020-11-20T13:55:31.105 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/140 2020-11-20T13:55:31.105 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/140 2020-11-20T13:55:31.106 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/140 2020-11-20T13:55:31.106 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/140 2020-11-20T13:55:31.106 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/140 2020-11-20T13:55:31.106 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/140 2020-11-20T13:55:31.106 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/140 2020-11-20T13:55:31.107 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/140 2020-11-20T13:55:31.107 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/140 2020-11-20T13:55:31.107 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/140 2020-11-20T13:55:31.107 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/140 2020-11-20T13:55:31.107 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/140 2020-11-20T13:55:31.108 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 126/140 2020-11-20T13:55:31.108 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/140 2020-11-20T13:55:31.108 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/140 2020-11-20T13:55:31.108 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/140 2020-11-20T13:55:31.108 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 130/140 2020-11-20T13:55:31.109 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/140 2020-11-20T13:55:31.109 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/140 2020-11-20T13:55:31.109 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/140 2020-11-20T13:55:31.109 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/140 2020-11-20T13:55:31.110 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/140 2020-11-20T13:55:31.110 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/140 2020-11-20T13:55:31.110 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:15.2.5-588.ga7b62340.el8.x86_64 137/140 2020-11-20T13:55:31.110 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/140 2020-11-20T13:55:31.110 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:15.2.5-588.ga7b62340.el8.x86_64 139/140 2020-11-20T13:55:31.163 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/140 2020-11-20T13:55:31.255 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/140 2020-11-20T13:55:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/140 2020-11-20T13:55:31.492 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/140 2020-11-20T13:55:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 134/140 2020-11-20T13:55:31.785 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 135/140 2020-11-20T13:55:31.976 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 136/140 2020-11-20T13:55:32.132 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 137/140 2020-11-20T13:55:32.132 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/140 2020-11-20T13:55:32.342 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/140 2020-11-20T13:55:32.342 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/140 2020-11-20T13:55:32.560 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/140 2020-11-20T13:55:32.560 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 140/140 2020-11-20T13:55:32.701 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/140 2020-11-20T13:55:32.701 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:32.702 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2020-11-20T13:55:32.702 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.702 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.702 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:32.702 INFO:teuthology.orchestra.run.smithi039.stdout:Downgraded: 2020-11-20T13:55:32.703 INFO:teuthology.orchestra.run.smithi039.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-11-20T13:55:32.703 INFO:teuthology.orchestra.run.smithi039.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T13:55:32.703 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T13:55:32.703 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:32.704 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2020-11-20T13:55:32.704 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.704 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.704 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.705 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.705 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.705 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.705 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.705 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.706 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.706 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.706 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.706 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.706 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.707 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.707 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.707 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.707 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.708 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.708 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:32.708 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:32.708 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:32.708 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:32.709 INFO:teuthology.orchestra.run.smithi039.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T13:55:32.709 INFO:teuthology.orchestra.run.smithi039.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T13:55:32.709 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T13:55:32.709 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-11-20T13:55:32.709 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T13:55:32.710 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-11-20T13:55:32.710 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T13:55:32.710 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-11-20T13:55:32.710 INFO:teuthology.orchestra.run.smithi039.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T13:55:32.711 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T13:55:32.711 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T13:55:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: jq-1.5-12.el8.x86_64 2020-11-20T13:55:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T13:55:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T13:55:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-11-20T13:55:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.3-2.el8.x86_64 2020-11-20T13:55:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-11-20T13:55:32.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T13:55:32.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T13:55:32.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T13:55:32.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T13:55:32.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T13:55:32.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T13:55:32.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T13:55:32.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T13:55:32.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T13:55:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T13:55:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T13:55:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T13:55:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T13:55:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-11-20T13:55:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T13:55:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T13:55:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.3.2-6.el8.x86_64 2020-11-20T13:55:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T13:55:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T13:55:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T13:55:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: krb5-devel-1.17-9.el8.x86_64 2020-11-20T13:55:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-11-20T13:55:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-11-20T13:55:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-11-20T13:55:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-11-20T13:55:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-11-20T13:55:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T13:55:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T13:55:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: libxslt-1.1.32-3.el8.x86_64 2020-11-20T13:55:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-11-20T13:55:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-11-20T13:55:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-11-20T13:55:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-11-20T13:55:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T13:55:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T13:55:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-11-20T13:55:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-11-20T13:55:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T13:55:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-11-20T13:55:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-11-20T13:55:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T13:55:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T13:55:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T13:55:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T13:55:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T13:55:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T13:55:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T13:55:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T13:55:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T13:55:32.726 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T13:55:32.726 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T13:55:32.726 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T13:55:32.726 INFO:teuthology.orchestra.run.smithi039.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T13:55:32.726 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T13:55:32.727 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T13:55:32.727 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T13:55:32.727 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T13:55:32.727 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T13:55:32.727 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T13:55:32.728 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T13:55:32.728 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T13:55:32.728 INFO:teuthology.orchestra.run.smithi039.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T13:55:32.728 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T13:55:32.728 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T13:55:32.729 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T13:55:32.729 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T13:55:32.729 INFO:teuthology.orchestra.run.smithi039.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T13:55:32.729 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T13:55:32.730 INFO:teuthology.orchestra.run.smithi039.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T13:55:32.730 INFO:teuthology.orchestra.run.smithi039.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T13:55:32.730 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T13:55:32.730 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T13:55:32.730 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T13:55:32.731 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T13:55:32.731 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T13:55:32.731 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:32.732 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2020-11-20T13:55:32.887 DEBUG:teuthology.parallel:result is None 2020-11-20T13:55:33.412 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 140/140 2020-11-20T13:55:33.412 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/140 2020-11-20T13:55:33.412 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/140 2020-11-20T13:55:33.412 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/140 2020-11-20T13:55:33.413 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/140 2020-11-20T13:55:33.413 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/140 2020-11-20T13:55:33.413 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/140 2020-11-20T13:55:33.413 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/140 2020-11-20T13:55:33.414 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/140 2020-11-20T13:55:33.414 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/140 2020-11-20T13:55:33.414 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/140 2020-11-20T13:55:33.414 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:15.2.5-588.ga7b62340.el8.x86_64 11/140 2020-11-20T13:55:33.414 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:15.2.5-588.ga7b62340.el8.x86_64 12/140 2020-11-20T13:55:33.415 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 13/140 2020-11-20T13:55:33.415 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 14/140 2020-11-20T13:55:33.415 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:15.2.5-588.ga7b623 15/140 2020-11-20T13:55:33.415 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:15.2.5-588.ga7b62340.el8.x86_64 16/140 2020-11-20T13:55:33.416 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:15.2.5-588.ga7b62340.el8.x86_64 17/140 2020-11-20T13:55:33.416 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:15.2.5-588.ga7b62340.el8.x86_64 18/140 2020-11-20T13:55:33.416 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:15.2.5-588.ga7b62340.el8.x86_64 19/140 2020-11-20T13:55:33.416 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:15.2.5-588.ga7b62340.el8.x86_64 20/140 2020-11-20T13:55:33.417 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:15.2.5-588.ga7b62340.el8.x86_64 21/140 2020-11-20T13:55:33.417 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:15.2.5-588.ga7b62340.el8.x86_64 22/140 2020-11-20T13:55:33.417 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:15.2.5-588.ga7b62340.el8.x86_64 23/140 2020-11-20T13:55:33.417 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:15.2.5-588.ga7b62340.el8.x86_6 24/140 2020-11-20T13:55:33.418 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:15.2.5-588.ga7b62340.el8.x86_64 25/140 2020-11-20T13:55:33.418 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:15.2.5-588.ga7b62340.el8.x86_64 26/140 2020-11-20T13:55:33.418 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:15.2.5-588.ga7b62340.el8.x86_ 27/140 2020-11-20T13:55:33.419 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:15.2.5-588.ga7b62340.el8.x86_64 28/140 2020-11-20T13:55:33.419 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:15.2.5-588.ga7b62340.el8 29/140 2020-11-20T13:55:33.429 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:15.2.5-588.ga7b62340.el8.x 30/140 2020-11-20T13:55:33.429 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:15.2.5-588.ga7b62340.el8.x86_64 31/140 2020-11-20T13:55:33.430 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:15.2.5-588.ga7b62340.el8.x86_64 32/140 2020-11-20T13:55:33.430 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:15.2.5-588.ga7b62340.el8.x86_64 33/140 2020-11-20T13:55:33.430 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:15.2.5-588.ga7b62340.el8.x86_64 34/140 2020-11-20T13:55:33.430 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 35/140 2020-11-20T13:55:33.430 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:15.2.5-588.ga7b62340.el8.x86_64 36/140 2020-11-20T13:55:33.431 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:15.2.5-588.ga7b62340.el8.x86_64 37/140 2020-11-20T13:55:33.431 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:15.2.5-588.ga7b62340.e 38/140 2020-11-20T13:55:33.431 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:15.2.5-588.ga7b62340.el8.noar 39/140 2020-11-20T13:55:33.432 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:15.2.5-588.ga7b62340.el8.no 40/140 2020-11-20T13:55:33.432 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.5-588.ga7b6 41/140 2020-11-20T13:55:33.432 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:15.2.5-588.ga7b62340.el8 42/140 2020-11-20T13:55:33.432 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:15.2.5-588.ga7b62340.el8.noarch 43/140 2020-11-20T13:55:33.433 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:15.2.5-588.ga7b62340.el 44/140 2020-11-20T13:55:33.433 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/140 2020-11-20T13:55:33.433 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/140 2020-11-20T13:55:33.433 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/140 2020-11-20T13:55:33.433 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.5-12.el8.x86_64 48/140 2020-11-20T13:55:33.434 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/140 2020-11-20T13:55:33.434 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/140 2020-11-20T13:55:33.434 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/140 2020-11-20T13:55:33.434 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/140 2020-11-20T13:55:33.435 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/140 2020-11-20T13:55:33.435 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/140 2020-11-20T13:55:33.435 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/140 2020-11-20T13:55:33.435 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/140 2020-11-20T13:55:33.435 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/140 2020-11-20T13:55:33.436 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/140 2020-11-20T13:55:33.436 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/140 2020-11-20T13:55:33.436 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/140 2020-11-20T13:55:33.437 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/140 2020-11-20T13:55:33.437 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/140 2020-11-20T13:55:33.437 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/140 2020-11-20T13:55:33.437 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/140 2020-11-20T13:55:33.438 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/140 2020-11-20T13:55:33.438 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/140 2020-11-20T13:55:33.438 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/140 2020-11-20T13:55:33.439 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/140 2020-11-20T13:55:33.439 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/140 2020-11-20T13:55:33.439 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/140 2020-11-20T13:55:33.439 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/140 2020-11-20T13:55:33.439 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/140 2020-11-20T13:55:33.440 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/140 2020-11-20T13:55:33.440 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/140 2020-11-20T13:55:33.440 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/140 2020-11-20T13:55:33.440 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/140 2020-11-20T13:55:33.441 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/140 2020-11-20T13:55:33.441 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/140 2020-11-20T13:55:33.441 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/140 2020-11-20T13:55:33.441 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/140 2020-11-20T13:55:33.442 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/140 2020-11-20T13:55:33.442 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/140 2020-11-20T13:55:33.442 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/140 2020-11-20T13:55:33.443 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/140 2020-11-20T13:55:33.443 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/140 2020-11-20T13:55:33.443 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/140 2020-11-20T13:55:33.443 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/140 2020-11-20T13:55:33.443 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/140 2020-11-20T13:55:33.444 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/140 2020-11-20T13:55:33.444 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/140 2020-11-20T13:55:33.444 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/140 2020-11-20T13:55:33.444 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/140 2020-11-20T13:55:33.445 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/140 2020-11-20T13:55:33.445 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/140 2020-11-20T13:55:33.445 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/140 2020-11-20T13:55:33.445 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/140 2020-11-20T13:55:33.445 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/140 2020-11-20T13:55:33.446 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/140 2020-11-20T13:55:33.446 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/140 2020-11-20T13:55:33.446 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/140 2020-11-20T13:55:33.446 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/140 2020-11-20T13:55:33.447 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/140 2020-11-20T13:55:33.447 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/140 2020-11-20T13:55:33.447 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/140 2020-11-20T13:55:33.447 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/140 2020-11-20T13:55:33.448 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/140 2020-11-20T13:55:33.448 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/140 2020-11-20T13:55:33.448 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/140 2020-11-20T13:55:33.448 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/140 2020-11-20T13:55:33.449 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/140 2020-11-20T13:55:33.449 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/140 2020-11-20T13:55:33.449 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/140 2020-11-20T13:55:33.450 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/140 2020-11-20T13:55:33.450 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/140 2020-11-20T13:55:33.450 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/140 2020-11-20T13:55:33.450 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/140 2020-11-20T13:55:33.451 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/140 2020-11-20T13:55:33.451 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/140 2020-11-20T13:55:33.451 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/140 2020-11-20T13:55:33.451 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/140 2020-11-20T13:55:33.451 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/140 2020-11-20T13:55:33.452 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/140 2020-11-20T13:55:33.452 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/140 2020-11-20T13:55:33.452 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/140 2020-11-20T13:55:33.453 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/140 2020-11-20T13:55:33.453 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 126/140 2020-11-20T13:55:33.453 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/140 2020-11-20T13:55:33.453 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/140 2020-11-20T13:55:33.454 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/140 2020-11-20T13:55:33.454 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 130/140 2020-11-20T13:55:33.454 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/140 2020-11-20T13:55:33.454 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/140 2020-11-20T13:55:33.454 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/140 2020-11-20T13:55:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/140 2020-11-20T13:55:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/140 2020-11-20T13:55:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/140 2020-11-20T13:55:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:15.2.5-588.ga7b62340.el8.x86_64 137/140 2020-11-20T13:55:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/140 2020-11-20T13:55:33.456 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:15.2.5-588.ga7b62340.el8.x86_64 139/140 2020-11-20T13:55:35.025 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/140 2020-11-20T13:55:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:35.026 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2020-11-20T13:55:35.026 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.027 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.027 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:35.027 INFO:teuthology.orchestra.run.smithi031.stdout:Downgraded: 2020-11-20T13:55:35.028 INFO:teuthology.orchestra.run.smithi031.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-11-20T13:55:35.028 INFO:teuthology.orchestra.run.smithi031.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T13:55:35.028 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T13:55:35.028 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:35.029 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2020-11-20T13:55:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.030 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.031 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.032 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:35.033 INFO:teuthology.orchestra.run.smithi031.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T13:55:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T13:55:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T13:55:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-11-20T13:55:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T13:55:35.034 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-11-20T13:55:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T13:55:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-11-20T13:55:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T13:55:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T13:55:35.035 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.036 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:15.2.5-588.ga7b62340.el8.x86_64 2020-11-20T13:55:35.037 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:15.2.5-588.ga7b62340.el8.noarch 2020-11-20T13:55:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T13:55:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: jq-1.5-12.el8.x86_64 2020-11-20T13:55:35.038 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T13:55:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T13:55:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-11-20T13:55:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.3-2.el8.x86_64 2020-11-20T13:55:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-11-20T13:55:35.039 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T13:55:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T13:55:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T13:55:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T13:55:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T13:55:35.040 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T13:55:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T13:55:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T13:55:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T13:55:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T13:55:35.041 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T13:55:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T13:55:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T13:55:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-11-20T13:55:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T13:55:35.042 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T13:55:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.3.2-6.el8.x86_64 2020-11-20T13:55:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T13:55:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T13:55:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T13:55:35.043 INFO:teuthology.orchestra.run.smithi031.stdout: krb5-devel-1.17-9.el8.x86_64 2020-11-20T13:55:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-11-20T13:55:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-11-20T13:55:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-11-20T13:55:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-11-20T13:55:35.044 INFO:teuthology.orchestra.run.smithi031.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-11-20T13:55:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T13:55:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T13:55:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: libxslt-1.1.32-3.el8.x86_64 2020-11-20T13:55:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-11-20T13:55:35.045 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-11-20T13:55:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-11-20T13:55:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-11-20T13:55:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T13:55:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T13:55:35.046 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-11-20T13:55:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-11-20T13:55:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T13:55:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-11-20T13:55:35.047 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-11-20T13:55:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T13:55:35.048 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T13:55:35.050 INFO:teuthology.orchestra.run.smithi031.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T13:55:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T13:55:35.051 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T13:55:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T13:55:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T13:55:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T13:55:35.052 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T13:55:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T13:55:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T13:55:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T13:55:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T13:55:35.053 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T13:55:35.054 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T13:55:35.054 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T13:55:35.054 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T13:55:35.054 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T13:55:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T13:55:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T13:55:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T13:55:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T13:55:35.055 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T13:55:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T13:55:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T13:55:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T13:55:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T13:55:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T13:55:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T13:55:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T13:55:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T13:55:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T13:55:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T13:55:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T13:55:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T13:55:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:35.059 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2020-11-20T13:55:35.183 DEBUG:teuthology.parallel:result is None 2020-11-20T13:55:35.184 INFO:teuthology.orchestra.run.smithi039:> sudo lsb_release -is 2020-11-20T13:55:35.244 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS 2020-11-20T13:55:35.246 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T13:55:35.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7b62340ad27b26642bb54ec916a97c7e1f07a34 2020-11-20T13:55:35.426 INFO:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T13:55:35.449 INFO:teuthology.orchestra.run.smithi039.stdout:15.2.5-588.ga7b62340.el8 2020-11-20T13:55:35.450 INFO:teuthology.packaging:The installed version of ceph is 15.2.5-588.ga7b62340.el8 2020-11-20T13:55:35.451 INFO:teuthology.task.install:The correct ceph version 15.2.5-588.ga7b62340 is installed. 2020-11-20T13:55:35.451 INFO:teuthology.orchestra.run.smithi031:> sudo lsb_release -is 2020-11-20T13:55:35.510 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS 2020-11-20T13:55:35.511 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T13:55:35.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7b62340ad27b26642bb54ec916a97c7e1f07a34 2020-11-20T13:55:35.669 INFO:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T13:55:35.691 INFO:teuthology.orchestra.run.smithi031.stdout:15.2.5-588.ga7b62340.el8 2020-11-20T13:55:35.691 INFO:teuthology.packaging:The installed version of ceph is 15.2.5-588.ga7b62340.el8 2020-11-20T13:55:35.692 INFO:teuthology.task.install:The correct ceph version 15.2.5-588.ga7b62340 is installed. 2020-11-20T13:55:35.693 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-20T13:55:35.693 INFO:teuthology.orchestra.run.smithi039:> set -ex 2020-11-20T13:55:35.694 INFO:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T13:55:35.711 INFO:teuthology.orchestra.run.smithi039.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T13:55:35.730 INFO:teuthology.orchestra.run.smithi039.stderr:24+1 records in 2020-11-20T13:55:35.730 INFO:teuthology.orchestra.run.smithi039.stderr:24+1 records out 2020-11-20T13:55:35.730 INFO:teuthology.orchestra.run.smithi039.stderr:12667 bytes (13 kB, 12 KiB) copied, 9.5215e-05 s, 133 MB/s 2020-11-20T13:55:35.731 INFO:teuthology.orchestra.run.smithi031:> set -ex 2020-11-20T13:55:35.732 INFO:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T13:55:35.746 INFO:teuthology.orchestra.run.smithi031.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T13:55:35.762 INFO:teuthology.orchestra.run.smithi031.stderr:24+1 records in 2020-11-20T13:55:35.762 INFO:teuthology.orchestra.run.smithi031.stderr:24+1 records out 2020-11-20T13:55:35.763 INFO:teuthology.orchestra.run.smithi031.stderr:12667 bytes (13 kB, 12 KiB) copied, 8.2598e-05 s, 153 MB/s 2020-11-20T13:55:35.763 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-20T13:55:35.764 INFO:teuthology.orchestra.run.smithi039:> set -ex 2020-11-20T13:55:35.764 INFO:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T13:55:35.787 INFO:teuthology.orchestra.run.smithi039.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T13:55:35.805 INFO:teuthology.orchestra.run.smithi039.stderr:5+1 records in 2020-11-20T13:55:35.806 INFO:teuthology.orchestra.run.smithi039.stderr:5+1 records out 2020-11-20T13:55:35.806 INFO:teuthology.orchestra.run.smithi039.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.6515e-05 s, 65.7 MB/s 2020-11-20T13:55:35.808 INFO:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T13:55:35.881 INFO:teuthology.orchestra.run.smithi031:> set -ex 2020-11-20T13:55:35.881 INFO:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T13:55:35.895 INFO:teuthology.orchestra.run.smithi031.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T13:55:35.913 INFO:teuthology.orchestra.run.smithi031.stderr:5+1 records in 2020-11-20T13:55:35.913 INFO:teuthology.orchestra.run.smithi031.stderr:5+1 records out 2020-11-20T13:55:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 5.084e-05 s, 60.1 MB/s 2020-11-20T13:55:35.914 INFO:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T13:55:35.985 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-20T13:55:35.985 INFO:teuthology.orchestra.run.smithi039:> set -ex 2020-11-20T13:55:35.986 INFO:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T13:55:36.003 INFO:teuthology.orchestra.run.smithi039.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T13:55:36.020 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2020-11-20T13:55:36.021 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2020-11-20T13:55:36.021 INFO:teuthology.orchestra.run.smithi039.stderr:299 bytes copied, 3.5624e-05 s, 8.4 MB/s 2020-11-20T13:55:36.022 INFO:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T13:55:36.095 INFO:teuthology.orchestra.run.smithi031:> set -ex 2020-11-20T13:55:36.095 INFO:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T13:55:36.109 INFO:teuthology.orchestra.run.smithi031.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T13:55:36.125 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2020-11-20T13:55:36.125 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2020-11-20T13:55:36.126 INFO:teuthology.orchestra.run.smithi031.stderr:299 bytes copied, 2.9422e-05 s, 10.2 MB/s 2020-11-20T13:55:36.127 INFO:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T13:55:36.197 INFO:teuthology.run_tasks:Running task ceph... 2020-11-20T13:55:36.252 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-20T13:55:36.253 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2020-11-20T13:55:36.256 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 777 /var/log/ceph 2020-11-20T13:55:36.290 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-20T13:55:36.291 INFO:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T13:55:36.327 INFO:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T13:55:36.362 INFO:tasks.ceph:Creating extra log directories... 2020-11-20T13:55:36.362 INFO:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T13:55:36.398 INFO:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T13:55:36.434 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-11-20T13:55:36.434 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-11-20T13:55:36.435 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-11-20T13:55:36.435 INFO:teuthology.orchestra.run.smithi039:> set -ex 2020-11-20T13:55:36.435 INFO:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T13:55:36.488 INFO:teuthology.orchestra.run.smithi039.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T13:55:36.490 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2020-11-20T13:55:36.490 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2020-11-20T13:55:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:408 bytes copied, 3.2849e-05 s, 12.4 MB/s 2020-11-20T13:55:36.491 INFO:teuthology.orchestra.run.smithi039:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T13:55:36.614 INFO:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T13:55:36.645 INFO:teuthology.orchestra.run.smithi031:> set -ex 2020-11-20T13:55:36.645 INFO:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T13:55:36.659 INFO:teuthology.orchestra.run.smithi031.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T13:55:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2020-11-20T13:55:36.661 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2020-11-20T13:55:36.661 INFO:teuthology.orchestra.run.smithi031.stderr:408 bytes copied, 3.0324e-05 s, 13.5 MB/s 2020-11-20T13:55:36.662 INFO:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T13:55:36.784 INFO:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T13:55:36.815 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-20T13:55:36.815 INFO:tasks.ceph:config {'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-11-20T13:55:36.816 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2020-11-16_04:10:02-fs-octopus-distro-basic-smithi/5628499', 'branch': 'octopus', 'description': 'fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_latest} tasks/cfuse_workunit_norstats}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5628499', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2020-11-16_04:10:02-fs-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.1', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'octopus', 'sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'git://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_octopus/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'suite_sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'a7b62340ad27b26642bb54ec916a97c7e1f07a34'}}, {'ceph': None}, {'ceph-fuse': None}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'all': ['fs/norstats']}}}], 'teuthology_branch': 'master', 'timestamp': '2020-11-16_04:10:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.3628', 'targets': {'smithi039.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDQAGWpxbo7DDT1AmqSJmG87Qjh6bgyUOibwWsvtKPDXf0ZQjZ5/Tm5zl8lx4dILf7lVTvaoyULrvFZbMnxe5wWq+O06OABqf6ipUxTDqg1Cd1X+xjCM1IyNDBmReTpQHtgnmGFx1ZWyNuikkZI7md/+iK45uP8XThMtT2WECsWUVILSEfXIOtLxkE+ipmbx8W5aUw1oVvTTkM2kPC40q6VujqSeURGFe4/tUaMljELkO9A3XpzZTZ9x/EkKEk0r5YHPx8f+6BHXxs4GCbS+80ovh/K9hE3j6PY5nKbYB3SdYhvTU93LdJU6aLvOjh8k90A6yYGUeKrSaBOEJvZM4ejI/SWG96z5LQH5F0nP/fkG1symo/gFE5UW+2UI+qIMyGR1r1LIoPONT6/bZRBFNRO6nY80xIffwlFZWbyOFFRy4fwASiWOIKPvEWlH+FsG/3t6+Hp2l8rPsUTxmQEsyELQsV1T0HNd5YtzPsCe8Z2s7dk+OgR7s6fl6kBbC6+fc=', 'smithi031.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCZIraucxohIm3ZlT1bl7mJS49K9g1stkOSKl7Q+EGd7IkRFLrDRG/7G0NFGmnyOAUJsKVmlYGbMRiyfj98IUiA9vpFYacWp5lvIImhrtnjR6a6UkjUge2LaDP0HUmO7UKcI/BgJgW4LvBAP6E6nDd4evJKMeX1UruNdQLh4fxYZewBXwpljIL0DEZpBZokokGE3/KAlQ540yxjlRs7SU6Tq9Cw+BdatLxuRTHCa4IPFYAzyp7q03u37H8UHvm7IBanyEyua7qcRNxCsldRf8q1q0DxCo92VYIxNdQWZ1BKeOpeeQfV0HjUxVHjLSbXDIfRhO/9btmXTeoVvaHt9jcuALGRG9zDaTRgIEJPQsW4rdFFliF+ZZm23oF/DLZUZseC5YCDY0AJzHTBGxRDxU0AUpFKUyY0/5STBG8SeMKEPOspP096E7/2/KPpdoFxUe9v2p02ViP0WX5MWlJrzAkYTM1PKOB+I5yRgvTNoSNAQBR3apwsQhNG0jsulf6djc='}} 2020-11-20T13:55:36.816 INFO:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T13:55:36.857 INFO:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T13:55:36.872 INFO:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T13:55:36.911 INFO:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T13:55:36.943 INFO:teuthology.orchestra.run.smithi039:> set -ex 2020-11-20T13:55:36.944 INFO:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T13:55:36.997 INFO:teuthology.orchestra.run.smithi039.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T13:55:36.998 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/vg_nvme/lv_1 2020-11-20T13:55:36.998 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/vg_nvme/lv_2 2020-11-20T13:55:36.998 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/vg_nvme/lv_3 2020-11-20T13:55:36.999 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/vg_nvme/lv_4 2020-11-20T13:55:36.999 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2020-11-20T13:55:36.999 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2020-11-20T13:55:36.999 INFO:teuthology.orchestra.run.smithi039.stderr:72 bytes copied, 5.1013e-05 s, 1.4 MB/s 2020-11-20T13:55:37.000 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T13:55:37.000 INFO:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T13:55:37.053 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T13:55:37.053 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T13:55:37.053 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 58256 Links: 1 2020-11-20T13:55:37.054 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T13:55:37.054 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T13:55:37.054 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2020-11-20 13:55:30.685410852 +0000 2020-11-20T13:55:37.054 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2020-11-20 13:53:39.464159216 +0000 2020-11-20T13:55:37.054 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2020-11-20 13:53:39.464159216 +0000 2020-11-20T13:55:37.055 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2020-11-20T13:55:37.069 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2020-11-20T13:55:37.070 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2020-11-20T13:55:37.070 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000351771 s, 1.5 MB/s 2020-11-20T13:55:37.072 INFO:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T13:55:37.127 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T13:55:37.127 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T13:55:37.128 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 59375 Links: 1 2020-11-20T13:55:37.128 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T13:55:37.128 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T13:55:37.128 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2020-11-20 13:55:30.686410831 +0000 2020-11-20T13:55:37.129 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2020-11-20 13:53:39.800152923 +0000 2020-11-20T13:55:37.129 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2020-11-20 13:53:39.800152923 +0000 2020-11-20T13:55:37.129 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2020-11-20T13:55:37.143 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2020-11-20T13:55:37.143 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2020-11-20T13:55:37.143 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000272934 s, 1.9 MB/s 2020-11-20T13:55:37.145 INFO:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T13:55:37.200 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T13:55:37.200 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T13:55:37.201 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 63545 Links: 1 2020-11-20T13:55:37.201 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T13:55:37.201 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T13:55:37.201 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2020-11-20 13:55:30.686410831 +0000 2020-11-20T13:55:37.201 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2020-11-20 13:53:40.135146649 +0000 2020-11-20T13:55:37.202 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2020-11-20 13:53:40.135146649 +0000 2020-11-20T13:55:37.202 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2020-11-20T13:55:37.217 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2020-11-20T13:55:37.217 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2020-11-20T13:55:37.218 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000251247 s, 2.0 MB/s 2020-11-20T13:55:37.219 INFO:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T13:55:37.273 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T13:55:37.274 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T13:55:37.274 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 58344 Links: 1 2020-11-20T13:55:37.274 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T13:55:37.275 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T13:55:37.275 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2020-11-20 13:55:30.686410831 +0000 2020-11-20T13:55:37.275 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2020-11-20 13:53:40.478140225 +0000 2020-11-20T13:55:37.275 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2020-11-20 13:53:40.478140225 +0000 2020-11-20T13:55:37.275 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2020-11-20T13:55:37.290 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2020-11-20T13:55:37.291 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2020-11-20T13:55:37.291 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000286164 s, 1.8 MB/s 2020-11-20T13:55:37.293 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:37.294 INFO:teuthology.orchestra.run.smithi031:> set -ex 2020-11-20T13:55:37.294 INFO:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T13:55:37.308 INFO:teuthology.orchestra.run.smithi031.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T13:55:37.310 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/vg_nvme/lv_1 2020-11-20T13:55:37.310 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/vg_nvme/lv_2 2020-11-20T13:55:37.310 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/vg_nvme/lv_3 2020-11-20T13:55:37.311 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/vg_nvme/lv_4 2020-11-20T13:55:37.311 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2020-11-20T13:55:37.311 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2020-11-20T13:55:37.311 INFO:teuthology.orchestra.run.smithi031.stderr:72 bytes copied, 3.8505e-05 s, 1.9 MB/s 2020-11-20T13:55:37.312 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T13:55:37.312 INFO:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T13:55:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T13:55:37.365 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T13:55:37.366 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 59171 Links: 1 2020-11-20T13:55:37.366 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T13:55:37.366 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T13:55:37.366 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2020-11-20 13:55:33.052448467 +0000 2020-11-20T13:55:37.366 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2020-11-20 13:53:39.456616542 +0000 2020-11-20T13:55:37.367 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2020-11-20 13:53:39.456616542 +0000 2020-11-20T13:55:37.367 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2020-11-20T13:55:37.382 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2020-11-20T13:55:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2020-11-20T13:55:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000236929 s, 2.2 MB/s 2020-11-20T13:55:37.386 INFO:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T13:55:37.441 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T13:55:37.441 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T13:55:37.441 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 61093 Links: 1 2020-11-20T13:55:37.442 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T13:55:37.442 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T13:55:37.442 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2020-11-20 13:55:33.052448467 +0000 2020-11-20T13:55:37.442 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2020-11-20 13:53:39.794611159 +0000 2020-11-20T13:55:37.442 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2020-11-20 13:53:39.794611159 +0000 2020-11-20T13:55:37.443 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2020-11-20T13:55:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2020-11-20T13:55:37.458 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2020-11-20T13:55:37.458 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000221503 s, 2.3 MB/s 2020-11-20T13:55:37.460 INFO:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T13:55:37.515 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T13:55:37.516 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T13:55:37.516 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 63045 Links: 1 2020-11-20T13:55:37.516 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T13:55:37.517 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T13:55:37.517 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2020-11-20 13:55:33.052448467 +0000 2020-11-20T13:55:37.517 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2020-11-20 13:53:40.127605856 +0000 2020-11-20T13:55:37.517 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2020-11-20 13:53:40.127605856 +0000 2020-11-20T13:55:37.518 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2020-11-20T13:55:37.532 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2020-11-20T13:55:37.533 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2020-11-20T13:55:37.533 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000208904 s, 2.5 MB/s 2020-11-20T13:55:37.535 INFO:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T13:55:37.589 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T13:55:37.589 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T13:55:37.590 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 61921 Links: 1 2020-11-20T13:55:37.590 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T13:55:37.590 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T13:55:37.590 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2020-11-20 13:55:33.052448467 +0000 2020-11-20T13:55:37.590 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2020-11-20 13:53:40.480600234 +0000 2020-11-20T13:55:37.591 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2020-11-20 13:53:40.480600234 +0000 2020-11-20T13:55:37.591 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2020-11-20T13:55:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2020-11-20T13:55:37.606 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2020-11-20T13:55:37.606 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000206871 s, 2.5 MB/s 2020-11-20T13:55:37.608 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:37.609 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-11-20T13:55:37.609 INFO:tasks.ceph:Generating config... 2020-11-20T13:55:37.610 INFO:tasks.ceph:[client] client dirsize rbytes = False 2020-11-20T13:55:37.611 INFO:tasks.ceph:[client] client mount timeout = 600 2020-11-20T13:55:37.611 INFO:tasks.ceph:[client] debug client = 20 2020-11-20T13:55:37.611 INFO:tasks.ceph:[client] debug ms = 1 2020-11-20T13:55:37.612 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2020-11-20T13:55:37.612 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2020-11-20T13:55:37.612 INFO:tasks.ceph:[mds] debug mds = 20 2020-11-20T13:55:37.613 INFO:tasks.ceph:[mds] debug ms = 1 2020-11-20T13:55:37.613 INFO:tasks.ceph:[mds] mds bal frag = True 2020-11-20T13:55:37.613 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-11-20T13:55:37.614 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-11-20T13:55:37.614 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-11-20T13:55:37.615 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-11-20T13:55:37.615 INFO:tasks.ceph:[mds] mds debug frag = True 2020-11-20T13:55:37.616 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-11-20T13:55:37.616 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-11-20T13:55:37.616 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-11-20T13:55:37.617 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-11-20T13:55:37.617 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2020-11-20T13:55:37.617 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2020-11-20T13:55:37.617 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-20T13:55:37.618 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-20T13:55:37.618 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-20T13:55:37.619 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-20T13:55:37.619 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-20T13:55:37.620 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-11-20T13:55:37.620 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-20T13:55:37.620 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-20T13:55:37.621 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-20T13:55:37.621 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-20T13:55:37.621 INFO:tasks.ceph:[osd] osd objectstore = filestore 2020-11-20T13:55:37.622 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-11-20T13:55:37.622 INFO:tasks.ceph:[osd] osd sloppy crc = True 2020-11-20T13:55:37.622 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10 2020-11-20T13:55:37.623 INFO:tasks.ceph:Setting up mon.a... 2020-11-20T13:55:37.623 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-20T13:55:37.679 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.keyring 2020-11-20T13:55:37.682 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-20T13:55:37.727 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T13:55:37.759 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.39'), ('mon.b', '172.21.15.31'), ('mon.c', '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]')] 2020-11-20T13:55:37.759 INFO:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.39 --add b 172.21.15.31 --addv c '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:37.836 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:37.837 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: generated fsid 52a00615-6ac7-45c8-8003-8fe417b7b412 2020-11-20T13:55:37.837 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 0 2020-11-20T13:55:37.837 INFO:teuthology.orchestra.run.smithi039.stdout:fsid 52a00615-6ac7-45c8-8003-8fe417b7b412 2020-11-20T13:55:37.837 INFO:teuthology.orchestra.run.smithi039.stdout:last_changed 2020-11-20T13:55:37.837055+0000 2020-11-20T13:55:37.838 INFO:teuthology.orchestra.run.smithi039.stdout:created 2020-11-20T13:55:37.837055+0000 2020-11-20T13:55:37.838 INFO:teuthology.orchestra.run.smithi039.stdout:min_mon_release 0 (unknown) 2020-11-20T13:55:37.838 INFO:teuthology.orchestra.run.smithi039.stdout:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2020-11-20T13:55:37.838 INFO:teuthology.orchestra.run.smithi039.stdout:1: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.b 2020-11-20T13:55:37.839 INFO:teuthology.orchestra.run.smithi039.stdout:2: [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] mon.c 2020-11-20T13:55:37.839 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-20T13:55:37.840 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 52a00615-6ac7-45c8-8003-8fe417b7b412... 2020-11-20T13:55:37.842 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T13:55:37.846 INFO:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T13:55:37.906 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2020-11-20T13:55:37.906 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2020-11-20T13:55:37.907 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T13:55:37.907 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2020-11-20T13:55:37.907 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.907 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2020-11-20T13:55:37.908 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.908 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2020-11-20T13:55:37.908 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.908 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2020-11-20T13:55:37.908 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2020-11-20T13:55:37.909 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.909 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2020-11-20T13:55:37.909 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2020-11-20T13:55:37.909 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.910 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T13:55:37.910 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2020-11-20T13:55:37.910 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.910 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T13:55:37.911 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T13:55:37.911 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.911 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2020-11-20T13:55:37.911 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.911 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2020-11-20T13:55:37.912 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2020-11-20T13:55:37.912 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2020-11-20T13:55:37.912 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2020-11-20T13:55:37.912 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2020-11-20T13:55:37.913 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2020-11-20T13:55:37.913 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2020-11-20T13:55:37.913 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T13:55:37.913 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T13:55:37.914 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.914 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T13:55:37.914 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.914 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2020-11-20T13:55:37.914 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.915 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2020-11-20T13:55:37.915 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.915 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2020-11-20T13:55:37.915 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2020-11-20T13:55:37.915 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.39,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2020-11-20T13:55:37.916 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = 52a00615-6ac7-45c8-8003-8fe417b7b412 2020-11-20T13:55:37.916 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.916 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2020-11-20T13:55:37.916 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2020-11-20T13:55:37.916 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.917 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2020-11-20T13:55:37.917 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2020-11-20T13:55:37.917 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.917 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2020-11-20T13:55:37.918 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2020-11-20T13:55:37.918 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.918 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2020-11-20T13:55:37.918 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2020-11-20T13:55:37.918 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2020-11-20T13:55:37.919 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.919 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2020-11-20T13:55:37.919 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2020-11-20T13:55:37.919 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.919 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2020-11-20T13:55:37.920 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.920 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2020-11-20T13:55:37.920 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.920 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2020-11-20T13:55:37.921 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.921 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2020-11-20T13:55:37.921 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2020-11-20T13:55:37.921 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.921 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2020-11-20T13:55:37.922 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2020-11-20T13:55:37.922 INFO:teuthology.orchestra.run.smithi031.stdout: debug filestore = 20 2020-11-20T13:55:37.922 INFO:teuthology.orchestra.run.smithi031.stdout: debug journal = 20 2020-11-20T13:55:37.922 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 20 2020-11-20T13:55:37.922 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 25 2020-11-20T13:55:37.923 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = filestore 2020-11-20T13:55:37.923 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2020-11-20T13:55:37.923 INFO:teuthology.orchestra.run.smithi031.stdout: osd sloppy crc = True 2020-11-20T13:55:37.923 INFO:teuthology.orchestra.run.smithi031.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T13:55:37.923 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.924 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2020-11-20T13:55:37.924 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2020-11-20T13:55:37.924 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2020-11-20T13:55:37.924 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2020-11-20T13:55:37.925 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2020-11-20T13:55:37.925 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2020-11-20T13:55:37.925 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2020-11-20T13:55:37.925 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2020-11-20T13:55:37.925 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.926 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2020-11-20T13:55:37.926 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2020-11-20T13:55:37.926 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2020-11-20T13:55:37.926 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2020-11-20T13:55:37.926 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2020-11-20T13:55:37.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2020-11-20T13:55:37.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2020-11-20T13:55:37.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2020-11-20T13:55:37.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2020-11-20T13:55:37.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2020-11-20T13:55:37.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2020-11-20T13:55:37.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2020-11-20T13:55:37.928 INFO:teuthology.orchestra.run.smithi031.stdout: 2020-11-20T13:55:37.928 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2020-11-20T13:55:37.929 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2020-11-20T13:55:37.929 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2020-11-20T13:55:37.929 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2020-11-20T13:55:37.929 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T13:55:37.929 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T13:55:37.930 INFO:teuthology.orchestra.run.smithi031.stdout: client dirsize rbytes = False 2020-11-20T13:55:37.930 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2020-11-20T13:55:37.930 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2020-11-20T13:55:37.930 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2020-11-20T13:55:37.930 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 15m 2020-11-20T13:55:37.931 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 15m 2020-11-20T13:55:37.931 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2020-11-20T13:55:37.931 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2020-11-20T13:55:37.931 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2020-11-20T13:55:37.931 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2020-11-20T13:55:37.932 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2020-11-20T13:55:37.932 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2020-11-20T13:55:37.932 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2020-11-20T13:55:37.932 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2020-11-20T13:55:37.933 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal frag = True 2020-11-20T13:55:37.933 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal fragment size max = 10000 2020-11-20T13:55:37.933 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal merge size = 5 2020-11-20T13:55:37.933 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split bits = 3 2020-11-20T13:55:37.933 INFO:teuthology.orchestra.run.smithi031.stdout: mds bal split size = 100 2020-11-20T13:55:37.934 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2020-11-20T13:55:37.934 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2020-11-20T13:55:37.934 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2020-11-20T13:55:37.934 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2020-11-20T13:55:37.934 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2020-11-20T13:55:37.935 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 15m 2020-11-20T13:55:37.935 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 15m 2020-11-20T13:55:37.942 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2020-11-20T13:55:37.942 INFO:teuthology.orchestra.run.smithi039.stdout: chdir = "" 2020-11-20T13:55:37.943 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T13:55:37.943 INFO:teuthology.orchestra.run.smithi039.stdout: auth supported = cephx 2020-11-20T13:55:37.943 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.943 INFO:teuthology.orchestra.run.smithi039.stdout: filestore xattr use omap = true 2020-11-20T13:55:37.944 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.944 INFO:teuthology.orchestra.run.smithi039.stdout: mon clock drift allowed = 1.000 2020-11-20T13:55:37.944 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.944 INFO:teuthology.orchestra.run.smithi039.stdout: osd crush chooseleaf type = 0 2020-11-20T13:55:37.944 INFO:teuthology.orchestra.run.smithi039.stdout: auth debug = true 2020-11-20T13:55:37.945 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.945 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on old message = true 2020-11-20T13:55:37.945 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on bug = true 2020-11-20T13:55:37.946 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.946 INFO:teuthology.orchestra.run.smithi039.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T13:55:37.946 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn max object skew = 0 2020-11-20T13:55:37.946 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.948 INFO:teuthology.orchestra.run.smithi039.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T13:55:37.948 INFO:teuthology.orchestra.run.smithi039.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T13:55:37.948 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.949 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default size = 2 2020-11-20T13:55:37.949 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.949 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow primary affinity = true 2020-11-20T13:55:37.949 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow pg remap = true 2020-11-20T13:55:37.950 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on legacy crush tunables = false 2020-11-20T13:55:37.950 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on crush straw calc version zero = false 2020-11-20T13:55:37.950 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on no sortbitwise = false 2020-11-20T13:55:37.950 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = false 2020-11-20T13:55:37.950 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on too few osds = false 2020-11-20T13:55:37.951 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T13:55:37.951 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T13:55:37.951 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.951 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T13:55:37.951 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.952 INFO:teuthology.orchestra.run.smithi039.stdout: osd default data pool replay window = 5 2020-11-20T13:55:37.952 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.952 INFO:teuthology.orchestra.run.smithi039.stdout: mon allow pool delete = true 2020-11-20T13:55:37.952 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.952 INFO:teuthology.orchestra.run.smithi039.stdout: mon cluster log file level = debug 2020-11-20T13:55:37.953 INFO:teuthology.orchestra.run.smithi039.stdout: debug asserts on shutdown = true 2020-11-20T13:55:37.953 INFO:teuthology.orchestra.run.smithi039.stdout: mon host = "172.21.15.39,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2020-11-20T13:55:37.953 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 52a00615-6ac7-45c8-8003-8fe417b7b412 2020-11-20T13:55:37.953 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.953 INFO:teuthology.orchestra.run.smithi039.stdout:[osd] 2020-11-20T13:55:37.954 INFO:teuthology.orchestra.run.smithi039.stdout: osd journal size = 100 2020-11-20T13:55:37.954 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.954 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub load threshold = 5.0 2020-11-20T13:55:37.954 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub max interval = 600 2020-11-20T13:55:37.954 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.955 INFO:teuthology.orchestra.run.smithi039.stdout: osd recover clone overlap = true 2020-11-20T13:55:37.955 INFO:teuthology.orchestra.run.smithi039.stdout: osd recovery max chunk = 1048576 2020-11-20T13:55:37.955 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.955 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug shutdown = true 2020-11-20T13:55:37.956 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug op order = true 2020-11-20T13:55:37.956 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify stray on activate = true 2020-11-20T13:55:37.956 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.956 INFO:teuthology.orchestra.run.smithi039.stdout: osd open classes on start = true 2020-11-20T13:55:37.956 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug pg log writeout = true 2020-11-20T13:55:37.957 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.957 INFO:teuthology.orchestra.run.smithi039.stdout: osd deep scrub update digest min age = 30 2020-11-20T13:55:37.957 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.957 INFO:teuthology.orchestra.run.smithi039.stdout: osd map max advance = 10 2020-11-20T13:55:37.957 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.958 INFO:teuthology.orchestra.run.smithi039.stdout: journal zero on create = true 2020-11-20T13:55:37.958 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.958 INFO:teuthology.orchestra.run.smithi039.stdout: filestore ondisk finisher threads = 3 2020-11-20T13:55:37.958 INFO:teuthology.orchestra.run.smithi039.stdout: filestore apply finisher threads = 3 2020-11-20T13:55:37.959 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.959 INFO:teuthology.orchestra.run.smithi039.stdout: bdev debug aio = true 2020-11-20T13:55:37.959 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug misdirected ops = true 2020-11-20T13:55:37.959 INFO:teuthology.orchestra.run.smithi039.stdout: debug filestore = 20 2020-11-20T13:55:37.959 INFO:teuthology.orchestra.run.smithi039.stdout: debug journal = 20 2020-11-20T13:55:37.960 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 20 2020-11-20T13:55:37.960 INFO:teuthology.orchestra.run.smithi039.stdout: debug osd = 25 2020-11-20T13:55:37.960 INFO:teuthology.orchestra.run.smithi039.stdout: osd objectstore = filestore 2020-11-20T13:55:37.960 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2020-11-20T13:55:37.961 INFO:teuthology.orchestra.run.smithi039.stdout: osd sloppy crc = True 2020-11-20T13:55:37.961 INFO:teuthology.orchestra.run.smithi039.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T13:55:37.961 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.961 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr] 2020-11-20T13:55:37.961 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2020-11-20T13:55:37.962 INFO:teuthology.orchestra.run.smithi039.stdout: debug mgr = 20 2020-11-20T13:55:37.962 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2020-11-20T13:55:37.962 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2020-11-20T13:55:37.962 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2020-11-20T13:55:37.962 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2020-11-20T13:55:37.963 INFO:teuthology.orchestra.run.smithi039.stdout: mgr/telemetry/nag = false 2020-11-20T13:55:37.963 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.963 INFO:teuthology.orchestra.run.smithi039.stdout:[mon] 2020-11-20T13:55:37.963 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2020-11-20T13:55:37.964 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2020-11-20T13:55:37.964 INFO:teuthology.orchestra.run.smithi039.stdout: debug paxos = 20 2020-11-20T13:55:37.964 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2020-11-20T13:55:37.964 INFO:teuthology.orchestra.run.smithi039.stdout: mon data avail warn = 5 2020-11-20T13:55:37.964 INFO:teuthology.orchestra.run.smithi039.stdout: mon mgr mkfs grace = 240 2020-11-20T13:55:37.965 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2020-11-20T13:55:37.965 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd reporter subtree level = osd 2020-11-20T13:55:37.965 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd prime pg temp = true 2020-11-20T13:55:37.965 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2020-11-20T13:55:37.966 INFO:teuthology.orchestra.run.smithi039.stdout: mon op complaint time = 120 2020-11-20T13:55:37.966 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:55:37.966 INFO:teuthology.orchestra.run.smithi039.stdout:[client] 2020-11-20T13:55:37.966 INFO:teuthology.orchestra.run.smithi039.stdout: rgw cache enabled = true 2020-11-20T13:55:37.966 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable ops log = true 2020-11-20T13:55:37.967 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable usage log = true 2020-11-20T13:55:37.967 INFO:teuthology.orchestra.run.smithi039.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T13:55:37.967 INFO:teuthology.orchestra.run.smithi039.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T13:55:37.967 INFO:teuthology.orchestra.run.smithi039.stdout: client dirsize rbytes = False 2020-11-20T13:55:37.967 INFO:teuthology.orchestra.run.smithi039.stdout: client mount timeout = 600 2020-11-20T13:55:37.968 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2020-11-20T13:55:37.968 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2020-11-20T13:55:37.968 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 15m 2020-11-20T13:55:37.968 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 15m 2020-11-20T13:55:37.968 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.a] 2020-11-20T13:55:37.969 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.b] 2020-11-20T13:55:37.969 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.c] 2020-11-20T13:55:37.969 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2020-11-20T13:55:37.969 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2020-11-20T13:55:37.969 INFO:teuthology.orchestra.run.smithi039.stdout:[mds] 2020-11-20T13:55:37.970 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds = 20 2020-11-20T13:55:37.970 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2020-11-20T13:55:37.970 INFO:teuthology.orchestra.run.smithi039.stdout: mds bal frag = True 2020-11-20T13:55:37.970 INFO:teuthology.orchestra.run.smithi039.stdout: mds bal fragment size max = 10000 2020-11-20T13:55:37.970 INFO:teuthology.orchestra.run.smithi039.stdout: mds bal merge size = 5 2020-11-20T13:55:37.971 INFO:teuthology.orchestra.run.smithi039.stdout: mds bal split bits = 3 2020-11-20T13:55:37.971 INFO:teuthology.orchestra.run.smithi039.stdout: mds bal split size = 100 2020-11-20T13:55:37.971 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug frag = True 2020-11-20T13:55:37.971 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug scatterstat = True 2020-11-20T13:55:37.972 INFO:teuthology.orchestra.run.smithi039.stdout: mds op complaint time = 180 2020-11-20T13:55:37.972 INFO:teuthology.orchestra.run.smithi039.stdout: mds verify scatter = True 2020-11-20T13:55:37.972 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2020-11-20T13:55:37.972 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 15m 2020-11-20T13:55:37.972 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 15m 2020-11-20T13:55:37.973 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-20T13:55:37.974 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-20T13:55:38.029 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-20T13:55:38.046 DEBUG:teuthology.orchestra.remote:smithi039:/etc/ceph/ceph.keyring is 206B 2020-11-20T13:55:38.140 DEBUG:teuthology.orchestra.remote:smithi039:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-11-20T13:55:38.189 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi039.front.sepia.ceph.com 2020-11-20T13:55:38.189 INFO:teuthology.orchestra.run.smithi039:> set -ex 2020-11-20T13:55:38.190 INFO:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T13:55:38.190 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T13:55:38.203 INFO:teuthology.orchestra.run.smithi039.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T13:55:38.219 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2020-11-20T13:55:38.220 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2020-11-20T13:55:38.220 INFO:teuthology.orchestra.run.smithi039.stderr:206 bytes copied, 4.7321e-05 s, 4.4 MB/s 2020-11-20T13:55:38.220 INFO:teuthology.orchestra.run.smithi039.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T13:55:38.238 INFO:teuthology.orchestra.run.smithi039:> set -ex 2020-11-20T13:55:38.239 INFO:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:38.291 INFO:teuthology.orchestra.run.smithi039.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:38.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2020-11-20T13:55:38.292 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2020-11-20T13:55:38.293 INFO:teuthology.orchestra.run.smithi039.stderr:379 bytes copied, 5.6341e-05 s, 6.7 MB/s 2020-11-20T13:55:38.293 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2020-11-20T13:55:38.293 INFO:teuthology.orchestra.run.smithi031:> set -ex 2020-11-20T13:55:38.294 INFO:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T13:55:38.294 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T13:55:38.308 INFO:teuthology.orchestra.run.smithi031.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T13:55:38.325 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2020-11-20T13:55:38.325 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2020-11-20T13:55:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:206 bytes copied, 3.029e-05 s, 6.8 MB/s 2020-11-20T13:55:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T13:55:38.343 INFO:teuthology.orchestra.run.smithi031:> set -ex 2020-11-20T13:55:38.344 INFO:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:38.397 INFO:teuthology.orchestra.run.smithi031.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:38.398 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2020-11-20T13:55:38.398 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2020-11-20T13:55:38.398 INFO:teuthology.orchestra.run.smithi031.stderr:379 bytes copied, 3.4858e-05 s, 10.9 MB/s 2020-11-20T13:55:38.399 INFO:tasks.ceph:Setting up mon nodes... 2020-11-20T13:55:38.399 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-20T13:55:38.399 INFO:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T13:55:38.460 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T13:55:38.462 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T13:55:38.532 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T13:55:38.534 INFO:tasks.ceph:Setting up mds nodes... 2020-11-20T13:55:38.535 INFO:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T13:55:38.595 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T13:55:38.597 INFO:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-11-20T13:55:38.628 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T13:55:38.691 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T13:55:38.693 INFO:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-11-20T13:55:38.724 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-20T13:55:38.725 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-20T13:55:38.769 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-20T13:55:38.788 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-20T13:55:38.788 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-11-20T13:55:38.789 INFO:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-20T13:55:38.819 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:38.820 INFO:tasks.ceph:role: osd.0 2020-11-20T13:55:38.820 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com 2020-11-20T13:55:38.820 INFO:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T13:55:40.214 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T13:55:40.215 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T13:55:40.215 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T13:55:40.215 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 2020-11-20T13:55:40.215 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T13:55:40.216 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2020-11-20T13:55:40.216 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T13:55:40.216 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T13:55:40.216 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T13:55:40.216 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T13:55:40.217 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2020-11-20T13:55:40.218 INFO:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-20T13:55:40.270 INFO:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-20T13:55:40.309 INFO:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-20T13:55:40.381 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:40.382 INFO:tasks.ceph:role: osd.1 2020-11-20T13:55:40.382 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com 2020-11-20T13:55:40.382 INFO:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T13:55:41.780 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T13:55:41.780 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T13:55:41.781 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T13:55:41.781 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 2020-11-20T13:55:41.781 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T13:55:41.781 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2020-11-20T13:55:41.781 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T13:55:41.782 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T13:55:41.782 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T13:55:41.782 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T13:55:41.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2020-11-20T13:55:41.783 INFO:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-11-20T13:55:41.835 INFO:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-20T13:55:41.872 INFO:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-20T13:55:41.945 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:41.946 INFO:tasks.ceph:role: osd.2 2020-11-20T13:55:41.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com 2020-11-20T13:55:41.947 INFO:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T13:55:43.343 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T13:55:43.343 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T13:55:43.344 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T13:55:43.344 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 2020-11-20T13:55:43.344 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T13:55:43.345 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2020-11-20T13:55:43.345 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T13:55:43.346 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T13:55:43.346 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T13:55:43.346 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T13:55:43.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2020-11-20T13:55:43.349 INFO:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-11-20T13:55:43.402 INFO:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-20T13:55:43.440 INFO:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-20T13:55:43.512 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:43.512 INFO:tasks.ceph:role: osd.3 2020-11-20T13:55:43.513 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com 2020-11-20T13:55:43.513 INFO:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T13:55:44.912 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T13:55:44.913 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T13:55:44.913 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T13:55:44.913 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 2020-11-20T13:55:44.914 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T13:55:44.914 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2020-11-20T13:55:44.914 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T13:55:44.914 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T13:55:44.915 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T13:55:44.915 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T13:55:44.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2020-11-20T13:55:44.917 INFO:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-11-20T13:55:44.969 INFO:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-20T13:55:45.005 INFO:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:45.097 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.096+0000 7fac05af9ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-20T13:55:45.097 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.097+0000 7fac05af9ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-20T13:55:45.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.120+0000 7fac05af9ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:45.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.121+0000 7fac05af9ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T13:55:45.231 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.231+0000 7fac05af9ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:45.233 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.233+0000 7fac05af9ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:45.234 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.233+0000 7fac05af9ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:45.241 INFO:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-20T13:55:45.272 INFO:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:45.360 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.359+0000 7f8811a94ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-20T13:55:45.361 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.359+0000 7f8811a94ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-20T13:55:45.372 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.372+0000 7f8811a94ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:45.373 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.372+0000 7f8811a94ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T13:55:45.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.476+0000 7f8811a94ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:45.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.477+0000 7f8811a94ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:45.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.477+0000 7f8811a94ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:45.485 INFO:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-20T13:55:45.518 INFO:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:45.605 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.604+0000 7f935fbe3ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-20T13:55:45.605 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.605+0000 7f935fbe3ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-20T13:55:45.630 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.629+0000 7f935fbe3ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:45.630 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.629+0000 7f935fbe3ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T13:55:45.737 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.737+0000 7f935fbe3ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:45.739 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.739+0000 7f935fbe3ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:45.740 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.739+0000 7f935fbe3ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:45.746 INFO:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-20T13:55:45.777 INFO:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:45.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.865+0000 7f34ff6a8ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-20T13:55:45.866 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.865+0000 7f34ff6a8ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-20T13:55:45.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.880+0000 7f34ff6a8ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:45.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.880+0000 7f34ff6a8ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T13:55:45.985 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.984+0000 7f34ff6a8ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:45.987 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.986+0000 7f34ff6a8ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:45.987 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:45.986+0000 7f34ff6a8ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:45.994 INFO:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-20T13:55:46.025 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-20T13:55:46.062 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:46.063 INFO:tasks.ceph:role: osd.4 2020-11-20T13:55:46.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2020-11-20T13:55:46.063 INFO:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T13:55:46.587 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T13:55:46.587 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T13:55:46.588 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T13:55:46.588 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2020-11-20T13:55:46.588 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T13:55:46.588 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2020-11-20T13:55:46.588 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T13:55:46.589 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T13:55:46.589 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T13:55:46.589 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T13:55:46.590 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2020-11-20T13:55:46.590 INFO:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-11-20T13:55:46.717 INFO:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-20T13:55:46.758 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-20T13:55:46.831 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:46.832 INFO:tasks.ceph:role: osd.5 2020-11-20T13:55:46.832 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2020-11-20T13:55:46.832 INFO:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T13:55:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T13:55:47.337 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T13:55:47.338 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T13:55:47.338 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2020-11-20T13:55:47.338 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T13:55:47.338 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2020-11-20T13:55:47.338 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T13:55:47.339 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T13:55:47.339 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T13:55:47.339 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T13:55:47.340 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2020-11-20T13:55:47.340 INFO:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-20T13:55:47.393 INFO:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-20T13:55:47.429 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-20T13:55:47.503 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:47.504 INFO:tasks.ceph:role: osd.6 2020-11-20T13:55:47.504 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2020-11-20T13:55:47.504 INFO:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T13:55:48.049 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T13:55:48.050 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T13:55:48.050 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T13:55:48.050 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2020-11-20T13:55:48.051 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T13:55:48.051 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2020-11-20T13:55:48.051 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T13:55:48.051 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T13:55:48.051 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T13:55:48.052 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T13:55:48.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2020-11-20T13:55:48.053 INFO:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-20T13:55:48.130 INFO:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-20T13:55:48.166 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-20T13:55:48.238 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T13:55:48.239 INFO:tasks.ceph:role: osd.7 2020-11-20T13:55:48.239 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2020-11-20T13:55:48.240 INFO:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T13:55:48.785 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T13:55:48.785 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T13:55:48.785 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T13:55:48.785 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2020-11-20T13:55:48.786 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T13:55:48.786 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2020-11-20T13:55:48.786 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T13:55:48.786 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T13:55:48.787 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T13:55:48.787 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T13:55:48.789 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2020-11-20T13:55:48.789 INFO:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-11-20T13:55:48.898 INFO:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-20T13:55:48.934 INFO:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:49.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.023+0000 7f9a54f37ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-20T13:55:49.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.027+0000 7f9a54f37ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-20T13:55:49.041 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.041+0000 7f9a54f37ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:49.042 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.042+0000 7f9a54f37ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T13:55:49.292 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.292+0000 7f9a54f37ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:49.296 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.296+0000 7f9a54f37ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:49.296 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.296+0000 7f9a54f37ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:49.311 INFO:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-20T13:55:49.342 INFO:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:49.431 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.430+0000 7f514ce59ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-20T13:55:49.432 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.432+0000 7f514ce59ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-20T13:55:49.449 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.449+0000 7f514ce59ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:49.449 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.449+0000 7f514ce59ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T13:55:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.660+0000 7f514ce59ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.661+0000 7f514ce59ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.661+0000 7f514ce59ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:49.671 INFO:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-20T13:55:49.702 INFO:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:49.790 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.789+0000 7f73e4ff7ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-20T13:55:49.790 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.790+0000 7f73e4ff7ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-20T13:55:49.794 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.794+0000 7f73e4ff7ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:49.794 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.794+0000 7f73e4ff7ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T13:55:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.933+0000 7f73e4ff7ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.934+0000 7f73e4ff7ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:49.934+0000 7f73e4ff7ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:49.940 INFO:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-20T13:55:49.971 INFO:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:50.058+0000 7f9b27a5dec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-20T13:55:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:50.058+0000 7f9b27a5dec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-20T13:55:50.062 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:50.062+0000 7f9b27a5dec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:50.062 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:50.062+0000 7f9b27a5dec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T13:55:50.182 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:50.182+0000 7f9b27a5dec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:55:50.183 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:50.182+0000 7f9b27a5dec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:50.183 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:55:50.182+0000 7f9b27a5dec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T13:55:50.192 INFO:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-20T13:55:50.223 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-20T13:55:50.223 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:55:50.241 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.d6rcYopvS0 2020-11-20T13:55:50.242 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.d6rcYopvS0 2020-11-20T13:55:50.318 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.d6rcYopvS0 2020-11-20T13:55:50.453 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.d6rcYopvS0 is 56B 2020-11-20T13:55:50.501 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.d6rcYopvS0 2020-11-20T13:55:50.517 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:55:50.572 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.2m1Cy5r6wn 2020-11-20T13:55:50.573 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.2m1Cy5r6wn 2020-11-20T13:55:50.645 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.2m1Cy5r6wn 2020-11-20T13:55:50.781 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.2m1Cy5r6wn is 56B 2020-11-20T13:55:50.831 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.2m1Cy5r6wn 2020-11-20T13:55:50.847 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:55:50.901 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.Qpur7k98K4 2020-11-20T13:55:50.902 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.Qpur7k98K4 2020-11-20T13:55:50.973 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.Qpur7k98K4 2020-11-20T13:55:51.101 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.Qpur7k98K4 is 56B 2020-11-20T13:55:51.149 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.Qpur7k98K4 2020-11-20T13:55:51.164 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:55:51.217 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.F3ln2VgvhK 2020-11-20T13:55:51.217 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.F3ln2VgvhK 2020-11-20T13:55:51.289 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.F3ln2VgvhK 2020-11-20T13:55:51.416 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.F3ln2VgvhK is 56B 2020-11-20T13:55:51.465 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.F3ln2VgvhK 2020-11-20T13:55:51.480 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:55:51.534 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.Ms4x9aRSP1 2020-11-20T13:55:51.534 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.Ms4x9aRSP1 2020-11-20T13:55:51.605 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.Ms4x9aRSP1 2020-11-20T13:55:51.732 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.Ms4x9aRSP1 is 56B 2020-11-20T13:55:51.781 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.Ms4x9aRSP1 2020-11-20T13:55:51.797 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:55:51.849 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.MIoLhh6a5Y 2020-11-20T13:55:51.850 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.MIoLhh6a5Y 2020-11-20T13:55:51.920 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.MIoLhh6a5Y 2020-11-20T13:55:52.048 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.MIoLhh6a5Y is 56B 2020-11-20T13:55:52.097 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.MIoLhh6a5Y 2020-11-20T13:55:52.111 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:55:52.129 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.FvNrr6b09K 2020-11-20T13:55:52.130 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.FvNrr6b09K 2020-11-20T13:55:52.205 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.FvNrr6b09K 2020-11-20T13:55:52.340 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.FvNrr6b09K is 56B 2020-11-20T13:55:52.390 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.FvNrr6b09K 2020-11-20T13:55:52.406 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:55:52.462 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.Va0GX97uyE 2020-11-20T13:55:52.462 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.Va0GX97uyE 2020-11-20T13:55:52.537 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.Va0GX97uyE 2020-11-20T13:55:52.670 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.Va0GX97uyE is 56B 2020-11-20T13:55:52.718 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.Va0GX97uyE 2020-11-20T13:55:52.735 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:55:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.8BwC3hCH8x 2020-11-20T13:55:52.791 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.8BwC3hCH8x 2020-11-20T13:55:52.883 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.8BwC3hCH8x 2020-11-20T13:55:52.974 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.8BwC3hCH8x is 56B 2020-11-20T13:55:53.023 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.8BwC3hCH8x 2020-11-20T13:55:53.039 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:55:53.093 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.WUqNR0jEGA 2020-11-20T13:55:53.094 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.WUqNR0jEGA 2020-11-20T13:55:53.171 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.WUqNR0jEGA 2020-11-20T13:55:53.303 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.WUqNR0jEGA is 56B 2020-11-20T13:55:53.351 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.WUqNR0jEGA 2020-11-20T13:55:53.366 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:55:53.421 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.15PevlyjPd 2020-11-20T13:55:53.422 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.15PevlyjPd 2020-11-20T13:55:53.505 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.15PevlyjPd 2020-11-20T13:55:53.635 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.15PevlyjPd is 56B 2020-11-20T13:55:53.683 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.15PevlyjPd 2020-11-20T13:55:53.701 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:55:53.754 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.1h0YQgF9Er 2020-11-20T13:55:53.755 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.1h0YQgF9Er 2020-11-20T13:55:53.842 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.1h0YQgF9Er 2020-11-20T13:55:53.931 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.1h0YQgF9Er is 56B 2020-11-20T13:55:53.980 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.1h0YQgF9Er 2020-11-20T13:55:54.015 DEBUG:teuthology.orchestra.remote:smithi039:/etc/ceph/ceph.client.0.keyring is 59B 2020-11-20T13:55:54.064 INFO:tasks.ceph:Adding keys to all mons... 2020-11-20T13:55:54.065 INFO:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T13:55:54.068 INFO:teuthology.orchestra.run.smithi039:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T13:55:54.095 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2020-11-20T13:55:54.095 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDayrdfvad5GxAA4AHCTY6MN5kcIvwcc0h4lA== 2020-11-20T13:55:54.095 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2020-11-20T13:55:54.096 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDayrdf766KIxAAnkKKLvIEGCalF6X9r/w0kg== 2020-11-20T13:55:54.096 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2020-11-20T13:55:54.096 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDhyrdfy13SBRAAjWEbDpqzf8/TZZ3+V00txA== 2020-11-20T13:55:54.096 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2020-11-20T13:55:54.096 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDhyrdfYt95FRAAf6U0PtIhqj03Gqx87l76AQ== 2020-11-20T13:55:54.097 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2020-11-20T13:55:54.097 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDhyrdfI6QZJBAAImR61lz1kK9rA3PekMOXUw== 2020-11-20T13:55:54.097 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2020-11-20T13:55:54.097 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDhyrdfYQGgMxAAnNWza8eeP8aqKuaUp2lyTQ== 2020-11-20T13:55:54.097 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2020-11-20T13:55:54.098 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDayrdfh0jBHxAAqDUg00TY6U6UBr1VGY/mmg== 2020-11-20T13:55:54.098 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2020-11-20T13:55:54.098 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDayrdfR9o5KRAAQuHfbymiTQJxw+wyO9DQ8w== 2020-11-20T13:55:54.098 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2020-11-20T13:55:54.098 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDlyrdfagFxARAAkv1dDc26EwsWUmwi2ZtTwA== 2020-11-20T13:55:54.099 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2020-11-20T13:55:54.099 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDlyrdfZLGqGRAAEzvflVSXyEQ5569HqYVZ4w== 2020-11-20T13:55:54.099 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2020-11-20T13:55:54.099 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDlyrdfxCUaLxAAqoumeFP90amZVVnL6KA86g== 2020-11-20T13:55:54.100 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2020-11-20T13:55:54.100 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDmyrdfYHd8AxAAqqeboLs1xoAjHXYoD/psLA== 2020-11-20T13:55:54.100 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2020-11-20T13:55:54.100 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDayrdfcmPhLRAA6PqITphhrHYk+DdpgdIR3Q== 2020-11-20T13:55:54.111 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.y] 2020-11-20T13:55:54.112 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDayrdfvad5GxAA4AHCTY6MN5kcIvwcc0h4lA== 2020-11-20T13:55:54.112 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2020-11-20T13:55:54.112 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDayrdf766KIxAAnkKKLvIEGCalF6X9r/w0kg== 2020-11-20T13:55:54.113 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.0] 2020-11-20T13:55:54.113 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDhyrdfy13SBRAAjWEbDpqzf8/TZZ3+V00txA== 2020-11-20T13:55:54.114 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.1] 2020-11-20T13:55:54.114 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDhyrdfYt95FRAAf6U0PtIhqj03Gqx87l76AQ== 2020-11-20T13:55:54.114 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.2] 2020-11-20T13:55:54.115 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDhyrdfI6QZJBAAImR61lz1kK9rA3PekMOXUw== 2020-11-20T13:55:54.115 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.3] 2020-11-20T13:55:54.115 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDhyrdfYQGgMxAAnNWza8eeP8aqKuaUp2lyTQ== 2020-11-20T13:55:54.115 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.x] 2020-11-20T13:55:54.116 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDayrdfh0jBHxAAqDUg00TY6U6UBr1VGY/mmg== 2020-11-20T13:55:54.116 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2020-11-20T13:55:54.116 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDayrdfR9o5KRAAQuHfbymiTQJxw+wyO9DQ8w== 2020-11-20T13:55:54.116 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.4] 2020-11-20T13:55:54.116 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDlyrdfagFxARAAkv1dDc26EwsWUmwi2ZtTwA== 2020-11-20T13:55:54.117 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.5] 2020-11-20T13:55:54.117 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDlyrdfZLGqGRAAEzvflVSXyEQ5569HqYVZ4w== 2020-11-20T13:55:54.117 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.6] 2020-11-20T13:55:54.117 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDlyrdfxCUaLxAAqoumeFP90amZVVnL6KA86g== 2020-11-20T13:55:54.117 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.7] 2020-11-20T13:55:54.118 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDmyrdfYHd8AxAAqqeboLs1xoAjHXYoD/psLA== 2020-11-20T13:55:54.118 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2020-11-20T13:55:54.119 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDayrdfcmPhLRAA6PqITphhrHYk+DdpgdIR3Q== 2020-11-20T13:55:54.120 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T13:55:54.144 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T13:55:54.271 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T13:55:54.273 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T13:55:54.414 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:54.416 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:54.702 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:54.705 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:54.789 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:54.795 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:54.909 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:54.912 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:55.024 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T13:55:55.026 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T13:55:55.199 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T13:55:55.201 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T13:55:55.258 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:55.260 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:55.314 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:55.317 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:55.371 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:55.374 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:55.428 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:55.430 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T13:55:55.482 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T13:55:55.485 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T13:55:55.542 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-20T13:55:55.542 INFO:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-20T13:55:55.573 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T13:55:55.680 INFO:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-20T13:55:55.711 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-20T13:55:55.743 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T13:55:55.841 INFO:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-20T13:55:55.872 INFO:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-20T13:55:55.942 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T13:55:56.042 INFO:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-20T13:55:56.073 INFO:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:56.115 INFO:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T13:55:56.130 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-20T13:55:56.131 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-20T13:55:56.131 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-20T13:55:56.173 INFO:tasks.ceph.mon.a:Started 2020-11-20T13:55:56.173 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-20T13:55:56.174 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-20T13:55:56.176 INFO:tasks.ceph.mon.b:Started 2020-11-20T13:55:56.176 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-20T13:55:56.177 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-20T13:55:56.179 INFO:tasks.ceph.mon.c:Started 2020-11-20T13:55:56.179 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-20T13:55:56.179 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-20T13:55:56.180 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-20T13:55:56.182 INFO:tasks.ceph.mgr.y:Started 2020-11-20T13:55:56.182 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-20T13:55:56.183 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-20T13:55:56.184 INFO:tasks.ceph.mgr.x:Started 2020-11-20T13:55:56.185 INFO:tasks.ceph:Setting crush tunables to default 2020-11-20T13:55:56.185 INFO:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd crush tunables default 2020-11-20T13:56:02.311 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.302+0000 7f3d39995700 1 Processor -- start 2020-11-20T13:56:02.312 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.302+0000 7f3d39995700 1 -- start start 2020-11-20T13:56:02.313 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d39995700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d39995700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d340a5420 con 0x7f3d340a7600 2020-11-20T13:56:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d39995700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d340a4ce0 con 0x7f3d340abf70 2020-11-20T13:56:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d39995700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d340a3180 con 0x7f3d340a7170 2020-11-20T13:56:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d32ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d32ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44584/0 (socket says 172.21.15.39:44584) 2020-11-20T13:56:02.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 learned_addr learned my addr 172.21.15.39:0/797275129 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:02.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d337fe700 1 --1- 172.21.15.39:0/797275129 >> v1:172.21.15.39:6789/0 conn(0x7f3d340abf70 0x7f3d340a4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34754/0 (socket says 172.21.15.39:34754) 2020-11-20T13:56:02.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 msgr2=0x7f3d3407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T13:56:02.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 msgr2=0x7f3d3407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.303+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T13:56:02.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.504+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.504+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 msgr2=0x7f3d3407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T13:56:02.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.504+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 msgr2=0x7f3d3407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.504+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.504+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T13:56:02.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.905+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.905+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 msgr2=0x7f3d3407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T13:56:02.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.905+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 msgr2=0x7f3d3407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.905+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:56.905+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T13:56:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:57.706+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:57.706+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 msgr2=0x7f3d3407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T13:56:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:57.706+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 msgr2=0x7f3d3407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:57.706+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:57.706+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T13:56:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 msgr2=0x7f3d3407f6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T13:56:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d317fa700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d3407f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 >> v1:172.21.15.39:6789/0 conn(0x7f3d340abf70 legacy=0x7f3d340a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 >> v1:172.21.15.31:6789/0 conn(0x7f3d340a7600 legacy=0x7f3d3407fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:02.320 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d317fa700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:02.320 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d317fa700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:02.320 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d340a3180 con 0x7f3d20049f20 2020-11-20T13:56:02.320 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2004cab0 con 0x7f3d20047400 2020-11-20T13:56:02.320 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 msgr2=0x7f3d2004c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T13:56:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 msgr2=0x7f3d2004c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 msgr2=0x7f3d20049850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-11-20T13:56:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 msgr2=0x7f3d20049850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.322 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.322 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.322 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T13:56:02.322 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.303+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T13:56:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 msgr2=0x7f3d20049850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T13:56:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 msgr2=0x7f3d20049850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.324 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.324 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T13:56:02.324 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 msgr2=0x7f3d2004c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-11-20T13:56:02.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 msgr2=0x7f3d2004c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.504+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T13:56:02.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.326 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 msgr2=0x7f3d2004c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T13:56:02.326 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 msgr2=0x7f3d2004c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.326 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 msgr2=0x7f3d20049850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-11-20T13:56:02.326 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 msgr2=0x7f3d20049850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.326 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.327 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.327 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T13:56:02.327 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:55:59.905+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T13:56:02.327 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.327 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.327 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 msgr2=0x7f3d2004c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-11-20T13:56:02.328 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 msgr2=0x7f3d20049850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T13:56:02.328 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d32ffd700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 msgr2=0x7f3d2004c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.328 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 msgr2=0x7f3d20049850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T13:56:02.328 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.328 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T13:56:02.329 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T13:56:02.329 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:00.706+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T13:56:02.329 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 msgr2=0x7f3d20049850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T13:56:02.329 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d317fa700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d20047400 0x7f3d20049850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.329 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 msgr2=0x7f3d2004c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T13:56:02.330 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d317fa700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20049f20 0x7f3d2004c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.330 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d317fa700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d2004eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:02.330 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d33fff700 1 -- 172.21.15.39:0/797275129 reap_dead start 2020-11-20T13:56:02.330 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d317fa700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20047840 0x7f3d2004a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:02.331 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d340a4f80 con 0x7f3d340a7600 2020-11-20T13:56:02.331 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d340a3180 con 0x7f3d20047840 2020-11-20T13:56:02.331 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d317fa700 1 -- 172.21.15.39:0/797275129 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2004cab0 con 0x7f3d340a7170 2020-11-20T13:56:02.331 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.39:3300/0 conn(0x7f3d340a7170 0x7f3d2004eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.332 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.303+0000 7f3d33fff700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20047840 0x7f3d2004a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.332 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20047840 msgr2=0x7f3d2004a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:02.332 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20047840 0x7f3d2004a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.332 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 >> v1:172.21.15.31:6789/0 conn(0x7f3d340a7600 legacy=0x7f3d200513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:02.332 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d337fe700 1 -- 172.21.15.39:0/797275129 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2004b8d0 con 0x7f3d340a7170 2020-11-20T13:56:02.332 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d337fe700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d340a7170 0x7f3d2004eec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f3d2c00b000 tx=0x7f3d2c009040).ready entity=mon.1 client_cookie=c9cab25d8de0c701 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:02.333 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d327fc700 1 -- 172.21.15.39:0/797275129 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d2c0166a0 con 0x7f3d340a7170 2020-11-20T13:56:02.333 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d327fc700 1 -- 172.21.15.39:0/797275129 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c016800 con 0x7f3d340a7170 2020-11-20T13:56:02.334 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d327fc700 1 -- 172.21.15.39:0/797275129 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d2c016b60 con 0x7f3d340a7170 2020-11-20T13:56:02.334 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d39995700 1 -- 172.21.15.39:0/797275129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d340a7170 msgr2=0x7f3d2004eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:02.334 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.304+0000 7f3d39995700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d340a7170 0x7f3d2004eec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f3d2c00b000 tx=0x7f3d2c009040).stop 2020-11-20T13:56:02.334 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.305+0000 7f3d39995700 1 -- 172.21.15.39:0/797275129 shutdown_connections 2020-11-20T13:56:02.334 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.305+0000 7f3d39995700 1 --2- 172.21.15.39:0/797275129 >> v2:172.21.15.31:3300/0 conn(0x7f3d20047840 0x7f3d2004a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.335 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.305+0000 7f3d39995700 1 --2- 172.21.15.39:0/797275129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d340a7170 0x7f3d2004eec0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.335 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.305+0000 7f3d39995700 1 -- 172.21.15.39:0/797275129 >> 172.21.15.39:0/797275129 conn(0x7f3d34061d50 msgr2=0x7f3d340ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:02.335 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.305+0000 7f3d39995700 1 -- 172.21.15.39:0/797275129 shutdown_connections 2020-11-20T13:56:02.335 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.305+0000 7f3d39995700 1 -- 172.21.15.39:0/797275129 wait complete. 2020-11-20T13:56:02.335 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.306+0000 7f3d39995700 1 Processor -- start 2020-11-20T13:56:02.336 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d39995700 1 -- start start 2020-11-20T13:56:02.336 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d39995700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20047840 0x7f3d3407ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:02.336 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d39995700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d340a7170 0x7f3d3407f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:02.336 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d39995700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d340a7600 0x7f3d3409d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:02.336 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d39995700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3409e1d0 con 0x7f3d340a7600 2020-11-20T13:56:02.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d39995700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340a6a30 con 0x7f3d20047840 2020-11-20T13:56:02.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d39995700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3409cb60 con 0x7f3d340a7170 2020-11-20T13:56:02.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d337fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20047840 0x7f3d3407ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d337fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20047840 0x7f3d3407ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44650/0 (socket says 172.21.15.39:44650) 2020-11-20T13:56:02.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d337fe700 1 -- 172.21.15.39:0/317091357 learned_addr learned my addr 172.21.15.39:0/317091357 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:02.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d33fff700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d340a7600 0x7f3d3409d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.307+0000 7f3d32ffd700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d340a7170 0x7f3d3407f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:02.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d33fff700 1 -- 172.21.15.39:0/317091357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d340a7170 msgr2=0x7f3d3407f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:02.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d33fff700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d340a7170 0x7f3d3407f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d33fff700 1 -- 172.21.15.39:0/317091357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20047840 msgr2=0x7f3d3407ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:02.339 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d33fff700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20047840 0x7f3d3407ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.339 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d33fff700 1 -- 172.21.15.39:0/317091357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d341279c0 con 0x7f3d340a7600 2020-11-20T13:56:02.339 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d337fe700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20047840 0x7f3d3407ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:02.339 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d33fff700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d340a7600 0x7f3d3409d180 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3d3409dfd0 tx=0x7f3d24007990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:02.339 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d1bfff700 1 -- 172.21.15.39:0/317091357 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d24007e40 con 0x7f3d340a7600 2020-11-20T13:56:02.340 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d1bfff700 1 -- 172.21.15.39:0/317091357 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d240133f0 con 0x7f3d340a7600 2020-11-20T13:56:02.340 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d39995700 1 -- 172.21.15.39:0/317091357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3409c8c0 con 0x7f3d340a7600 2020-11-20T13:56:02.340 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d1bfff700 1 -- 172.21.15.39:0/317091357 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d24013750 con 0x7f3d340a7600 2020-11-20T13:56:02.340 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d39995700 1 -- 172.21.15.39:0/317091357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3409c310 con 0x7f3d340a7600 2020-11-20T13:56:02.340 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d1bfff700 1 -- 172.21.15.39:0/317091357 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f3d2401a030 con 0x7f3d340a7600 2020-11-20T13:56:02.341 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.308+0000 7f3d1bfff700 1 -- 172.21.15.39:0/317091357 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3d2401d7b0 con 0x7f3d340a7600 2020-11-20T13:56:02.341 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.309+0000 7f3d39995700 1 -- 172.21.15.39:0/317091357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d34057050 con 0x7f3d340a7600 2020-11-20T13:56:02.342 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.311+0000 7f3d1bfff700 1 -- 172.21.15.39:0/317091357 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f3d24018070 con 0x7f3d340a7600 2020-11-20T13:56:02.391 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.391+0000 7f3d39995700 1 -- 172.21.15.39:0/317091357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3d340a7cf0 con 0x7f3d340a7600 2020-11-20T13:56:02.396 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.395+0000 7f3d1bfff700 1 -- 172.21.15.39:0/317091357 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3d2401d970 con 0x7f3d340a7600 2020-11-20T13:56:02.398 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.397+0000 7f3d39995700 1 -- 172.21.15.39:0/317091357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d340a7600 msgr2=0x7f3d3409d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:02.398 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.397+0000 7f3d39995700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d340a7600 0x7f3d3409d180 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3d3409dfd0 tx=0x7f3d24007990).stop 2020-11-20T13:56:02.398 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.397+0000 7f3d39995700 1 -- 172.21.15.39:0/317091357 shutdown_connections 2020-11-20T13:56:02.398 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.397+0000 7f3d39995700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20047840 0x7f3d3407ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.399 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.397+0000 7f3d39995700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d340a7600 0x7f3d3409d180 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.399 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.397+0000 7f3d39995700 1 --2- 172.21.15.39:0/317091357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d340a7170 0x7f3d3407f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:02.399 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.397+0000 7f3d39995700 1 -- 172.21.15.39:0/317091357 >> 172.21.15.39:0/317091357 conn(0x7f3d34061d50 msgr2=0x7f3d340a8700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:02.399 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.397+0000 7f3d39995700 1 -- 172.21.15.39:0/317091357 shutdown_connections 2020-11-20T13:56:02.399 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:02.397+0000 7f3d39995700 1 -- 172.21.15.39:0/317091357 wait complete. 2020-11-20T13:56:02.400 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2020-11-20T13:56:02.411 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-20T13:56:02.412 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:56:02.426 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.8r8GwhCTlJ 2020-11-20T13:56:02.427 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.8r8GwhCTlJ 2020-11-20T13:56:02.528 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.8r8GwhCTlJ 2020-11-20T13:56:02.617 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.8r8GwhCTlJ is 37B 2020-11-20T13:56:02.664 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.8r8GwhCTlJ 2020-11-20T13:56:02.678 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:56:02.731 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.xvBXBXEoNT 2020-11-20T13:56:02.732 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.xvBXBXEoNT 2020-11-20T13:56:02.802 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.xvBXBXEoNT 2020-11-20T13:56:02.931 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.xvBXBXEoNT is 37B 2020-11-20T13:56:02.978 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.xvBXBXEoNT 2020-11-20T13:56:02.993 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:56:03.045 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.nGQTDnjAGN 2020-11-20T13:56:03.046 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.nGQTDnjAGN 2020-11-20T13:56:03.117 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.nGQTDnjAGN 2020-11-20T13:56:03.244 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.nGQTDnjAGN is 37B 2020-11-20T13:56:03.294 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.nGQTDnjAGN 2020-11-20T13:56:03.309 INFO:teuthology.orchestra.run.smithi039:> mktemp 2020-11-20T13:56:03.370 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.36n2Emk4zw 2020-11-20T13:56:03.370 INFO:teuthology.orchestra.run.smithi039:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.36n2Emk4zw 2020-11-20T13:56:03.442 INFO:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.36n2Emk4zw 2020-11-20T13:56:03.572 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.36n2Emk4zw is 37B 2020-11-20T13:56:03.620 INFO:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.36n2Emk4zw 2020-11-20T13:56:03.635 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:56:03.650 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.67aTAmedRu 2020-11-20T13:56:03.651 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.67aTAmedRu 2020-11-20T13:56:03.724 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.67aTAmedRu 2020-11-20T13:56:03.851 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.67aTAmedRu is 37B 2020-11-20T13:56:03.899 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.67aTAmedRu 2020-11-20T13:56:03.914 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:56:03.967 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.3dv3yXe4xq 2020-11-20T13:56:03.968 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.3dv3yXe4xq 2020-11-20T13:56:04.039 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.3dv3yXe4xq 2020-11-20T13:56:04.167 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.3dv3yXe4xq is 37B 2020-11-20T13:56:04.215 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.3dv3yXe4xq 2020-11-20T13:56:04.230 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:56:04.284 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.UIdxiVJcyR 2020-11-20T13:56:04.284 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.UIdxiVJcyR 2020-11-20T13:56:04.354 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.UIdxiVJcyR 2020-11-20T13:56:04.484 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.UIdxiVJcyR is 37B 2020-11-20T13:56:04.532 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.UIdxiVJcyR 2020-11-20T13:56:04.547 INFO:teuthology.orchestra.run.smithi031:> mktemp 2020-11-20T13:56:04.600 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.vsOIlylyBT 2020-11-20T13:56:04.600 INFO:teuthology.orchestra.run.smithi031:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.vsOIlylyBT 2020-11-20T13:56:04.673 INFO:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.vsOIlylyBT 2020-11-20T13:56:04.802 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.vsOIlylyBT is 37B 2020-11-20T13:56:04.850 INFO:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.vsOIlylyBT 2020-11-20T13:56:04.865 INFO:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 70258e98-258a-42f9-be42-3d27596f28ba 0 2020-11-20T13:56:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.016+0000 7fe780f04700 1 Processor -- start 2020-11-20T13:56:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe780f04700 1 -- start start 2020-11-20T13:56:05.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe780f04700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe77c0abf70 0x7fe77c0a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe780f04700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe77c0a7170 0x7fe77c07f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe780f04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7600 0x7fe77c07fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe780f04700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c0a3180 con 0x7fe77c0abf70 2020-11-20T13:56:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe780f04700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c0a5420 con 0x7fe77c0a7170 2020-11-20T13:56:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe780f04700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0a4ce0 con 0x7fe77c0a7600 2020-11-20T13:56:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe77b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7600 0x7fe77c07fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe77ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe77c0abf70 0x7fe77c0a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe77b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7600 0x7fe77c07fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36704/0 (socket says 172.21.15.31:36704) 2020-11-20T13:56:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe77ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe77c0abf70 0x7fe77c0a4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48196/0 (socket says 172.21.15.31:48196) 2020-11-20T13:56:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.017+0000 7fe77b59e700 1 -- 172.21.15.31:0/3949691534 learned_addr learned my addr 172.21.15.31:0/3949691534 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe77a59c700 1 --2- 172.21.15.31:0/3949691534 >> v2:172.21.15.39:3300/0 conn(0x7fe77c0a7170 0x7fe77c07f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe77ad9d700 1 -- 172.21.15.31:0/3949691534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7600 msgr2=0x7fe77c07fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe77ad9d700 1 --2- 172.21.15.31:0/3949691534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7600 0x7fe77c07fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe77ad9d700 1 -- 172.21.15.31:0/3949691534 >> v2:172.21.15.39:3300/0 conn(0x7fe77c0a7170 msgr2=0x7fe77c07f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:05.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe77ad9d700 1 --2- 172.21.15.31:0/3949691534 >> v2:172.21.15.39:3300/0 conn(0x7fe77c0a7170 0x7fe77c07f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe77ad9d700 1 -- 172.21.15.31:0/3949691534 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0a4f80 con 0x7fe77c0abf70 2020-11-20T13:56:05.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe77b59e700 1 --2- 172.21.15.31:0/3949691534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7600 0x7fe77c07fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:05.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe77ad9d700 1 --2- 172.21.15.31:0/3949691534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0abf70 0x7fe77c0a4100 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe76c002f30 tx=0x7fe76c006dc0).ready entity=mon.0 client_cookie=fa3446a31345a6e6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:05.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe779d9b700 1 -- 172.21.15.31:0/3949691534 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76c009650 con 0x7fe77c0abf70 2020-11-20T13:56:05.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe779d9b700 1 -- 172.21.15.31:0/3949691534 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c0097b0 con 0x7fe77c0abf70 2020-11-20T13:56:05.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe779d9b700 1 -- 172.21.15.31:0/3949691534 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76c009b10 con 0x7fe77c0abf70 2020-11-20T13:56:05.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe780f04700 1 -- 172.21.15.31:0/3949691534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0abf70 msgr2=0x7fe77c0a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.018+0000 7fe780f04700 1 --2- 172.21.15.31:0/3949691534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0abf70 0x7fe77c0a4100 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe76c002f30 tx=0x7fe76c006dc0).stop 2020-11-20T13:56:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.019+0000 7fe780f04700 1 -- 172.21.15.31:0/3949691534 shutdown_connections 2020-11-20T13:56:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.019+0000 7fe780f04700 1 --2- 172.21.15.31:0/3949691534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7600 0x7fe77c07fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.019+0000 7fe780f04700 1 --2- 172.21.15.31:0/3949691534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0abf70 0x7fe77c0a4100 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.019+0000 7fe780f04700 1 --2- 172.21.15.31:0/3949691534 >> v2:172.21.15.39:3300/0 conn(0x7fe77c0a7170 0x7fe77c07f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.019+0000 7fe780f04700 1 -- 172.21.15.31:0/3949691534 >> 172.21.15.31:0/3949691534 conn(0x7fe77c061d50 msgr2=0x7fe77c0ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.019+0000 7fe780f04700 1 -- 172.21.15.31:0/3949691534 shutdown_connections 2020-11-20T13:56:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.019+0000 7fe780f04700 1 -- 172.21.15.31:0/3949691534 wait complete. 2020-11-20T13:56:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe780f04700 1 Processor -- start 2020-11-20T13:56:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe780f04700 1 -- start start 2020-11-20T13:56:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe780f04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7170 0x7fe77c1373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe780f04700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0a7600 0x7fe77c09d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe780f04700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77c0abf70 0x7fe77c09d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe780f04700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c1220d0 con 0x7fe77c0a7600 2020-11-20T13:56:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe780f04700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c09c120 con 0x7fe77c0abf70 2020-11-20T13:56:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe780f04700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c09c3c0 con 0x7fe77c0a7170 2020-11-20T13:56:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe77ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7170 0x7fe77c1373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe77a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0a7600 0x7fe77c09d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe77ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7170 0x7fe77c1373d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36706/0 (socket says 172.21.15.31:36706) 2020-11-20T13:56:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe77a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0a7600 0x7fe77c09d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48200/0 (socket says 172.21.15.31:48200) 2020-11-20T13:56:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe77ad9d700 1 -- 172.21.15.31:0/2355024516 learned_addr learned my addr 172.21.15.31:0/2355024516 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.020+0000 7fe77b59e700 1 --2- 172.21.15.31:0/2355024516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77c0abf70 0x7fe77c09d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe77a59c700 1 -- 172.21.15.31:0/2355024516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7170 msgr2=0x7fe77c1373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe77a59c700 1 --2- 172.21.15.31:0/2355024516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7170 0x7fe77c1373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe77a59c700 1 -- 172.21.15.31:0/2355024516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77c0abf70 msgr2=0x7fe77c09d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe77a59c700 1 --2- 172.21.15.31:0/2355024516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77c0abf70 0x7fe77c09d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe77a59c700 1 -- 172.21.15.31:0/2355024516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c09c660 con 0x7fe77c0a7600 2020-11-20T13:56:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe77b59e700 1 --2- 172.21.15.31:0/2355024516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77c0abf70 0x7fe77c09d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe77a59c700 1 --2- 172.21.15.31:0/2355024516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0a7600 0x7fe77c09d2f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe77000c000 tx=0x7fe770006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe76b7fe700 1 -- 172.21.15.31:0/2355024516 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe77000ca10 con 0x7fe77c0a7600 2020-11-20T13:56:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe76b7fe700 1 -- 172.21.15.31:0/2355024516 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77000cb70 con 0x7fe77c0a7600 2020-11-20T13:56:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe780f04700 1 -- 172.21.15.31:0/2355024516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c09cb60 con 0x7fe77c0a7600 2020-11-20T13:56:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe76b7fe700 1 -- 172.21.15.31:0/2355024516 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe77000be80 con 0x7fe77c0a7600 2020-11-20T13:56:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.021+0000 7fe780f04700 1 -- 172.21.15.31:0/2355024516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c1378c0 con 0x7fe77c0a7600 2020-11-20T13:56:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.022+0000 7fe76b7fe700 1 -- 172.21.15.31:0/2355024516 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 2) v1 ==== 31561+0+0 (secure 0 0 0) 0x7fe77001c460 con 0x7fe77c0a7600 2020-11-20T13:56:05.039 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.022+0000 7fe76b7fe700 1 -- 172.21.15.31:0/2355024516 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fe770038fe0 con 0x7fe77c0a7600 2020-11-20T13:56:05.039 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.022+0000 7fe780f04700 1 -- 172.21.15.31:0/2355024516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c09c7f0 con 0x7fe77c0a7600 2020-11-20T13:56:05.039 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.024+0000 7fe76b7fe700 1 -- 172.21.15.31:0/2355024516 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fe7700108a0 con 0x7fe77c0a7600 2020-11-20T13:56:05.113 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.112+0000 7fe780f04700 1 -- 172.21.15.31:0/2355024516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "70258e98-258a-42f9-be42-3d27596f28ba", "id": 0} v 0) v1 -- 0x7fe77c057050 con 0x7fe77c0a7600 2020-11-20T13:56:05.117 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.116+0000 7fe76b7fe700 1 -- 172.21.15.31:0/2355024516 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70258e98-258a-42f9-be42-3d27596f28ba", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe77002a0b0 con 0x7fe77c0a7600 2020-11-20T13:56:05.117 INFO:teuthology.orchestra.run.smithi031.stdout:0 2020-11-20T13:56:05.118 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.117+0000 7fe780f04700 1 -- 172.21.15.31:0/2355024516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0a7600 msgr2=0x7fe77c09d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.117+0000 7fe780f04700 1 --2- 172.21.15.31:0/2355024516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0a7600 0x7fe77c09d2f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe77000c000 tx=0x7fe770006dc0).stop 2020-11-20T13:56:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.117+0000 7fe780f04700 1 -- 172.21.15.31:0/2355024516 shutdown_connections 2020-11-20T13:56:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.117+0000 7fe780f04700 1 --2- 172.21.15.31:0/2355024516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77c0abf70 0x7fe77c09d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.117+0000 7fe780f04700 1 --2- 172.21.15.31:0/2355024516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe77c0a7170 0x7fe77c1373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.119 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.117+0000 7fe780f04700 1 --2- 172.21.15.31:0/2355024516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe77c0a7600 0x7fe77c09d2f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.117+0000 7fe780f04700 1 -- 172.21.15.31:0/2355024516 >> 172.21.15.31:0/2355024516 conn(0x7fe77c061d50 msgr2=0x7fe77c0a87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:05.120 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.117+0000 7fe780f04700 1 -- 172.21.15.31:0/2355024516 shutdown_connections 2020-11-20T13:56:05.121 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.117+0000 7fe780f04700 1 -- 172.21.15.31:0/2355024516 wait complete. 2020-11-20T13:56:05.129 INFO:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new af7acda6-6b94-47d7-b6f8-adbc029495f1 1 2020-11-20T13:56:05.249 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.243+0000 7f9fc3748700 1 Processor -- start 2020-11-20T13:56:05.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.243+0000 7f9fc3748700 1 -- start start 2020-11-20T13:56:05.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc3748700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9fbc0abf70 0x7f9fbc0a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc3748700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0a7600 0x7f9fbc07fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc3748700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc0a5420 con 0x7f9fbc0a7170 2020-11-20T13:56:05.250 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc3748700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc0a3180 con 0x7f9fbc0abf70 2020-11-20T13:56:05.251 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc3748700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0a4ce0 con 0x7f9fbc0a7600 2020-11-20T13:56:05.251 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc1ce5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9fbc0abf70 0x7f9fbc0a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.251 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc14e4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9fbc0a7170 0x7f9fbc07f6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37830/0 (socket says 172.21.15.31:37830) 2020-11-20T13:56:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc14e4700 1 -- 172.21.15.31:0/658735556 learned_addr learned my addr 172.21.15.31:0/658735556 (peer_addr_for_me v1:172.21.15.31:0/0) 2020-11-20T13:56:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc24e6700 1 --2- 172.21.15.31:0/658735556 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0a7600 0x7f9fbc07fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc1ce5700 1 -- 172.21.15.31:0/658735556 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0a7600 msgr2=0x7f9fbc07fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:05.253 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc1ce5700 1 --2- 172.21.15.31:0/658735556 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0a7600 0x7f9fbc07fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc1ce5700 1 -- 172.21.15.31:0/658735556 >> v1:172.21.15.31:6789/0 conn(0x7f9fbc0a7170 legacy=0x7f9fbc07f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc1ce5700 1 -- 172.21.15.31:0/658735556 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc0a4f80 con 0x7f9fbc0abf70 2020-11-20T13:56:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc0ce3700 1 -- 172.21.15.31:0/658735556 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457652484 0 0) 0x7f9fbc0a5420 con 0x7f9fbc0a7170 2020-11-20T13:56:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.244+0000 7f9fc1ce5700 1 --2- 172.21.15.31:0/658735556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0abf70 0x7f9fbc0a4100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9fb8002f30 tx=0x7f9fb8006dc0).ready entity=mon.0 client_cookie=11c546d696469162 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:05.255 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc0ce3700 1 -- 172.21.15.31:0/658735556 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fb8009760 con 0x7f9fbc0abf70 2020-11-20T13:56:05.255 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc0ce3700 1 -- 172.21.15.31:0/658735556 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb80098c0 con 0x7f9fbc0abf70 2020-11-20T13:56:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc0ce3700 1 -- 172.21.15.31:0/658735556 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fb8009c20 con 0x7f9fbc0abf70 2020-11-20T13:56:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc3748700 1 -- 172.21.15.31:0/658735556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0abf70 msgr2=0x7f9fbc0a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.256 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc3748700 1 --2- 172.21.15.31:0/658735556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0abf70 0x7f9fbc0a4100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9fb8002f30 tx=0x7f9fb8006dc0).stop 2020-11-20T13:56:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc3748700 1 -- 172.21.15.31:0/658735556 shutdown_connections 2020-11-20T13:56:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc3748700 1 --2- 172.21.15.31:0/658735556 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0a7600 0x7f9fbc07fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.257 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc3748700 1 --2- 172.21.15.31:0/658735556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0abf70 0x7f9fbc0a4100 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc3748700 1 -- 172.21.15.31:0/658735556 >> 172.21.15.31:0/658735556 conn(0x7f9fbc061d50 msgr2=0x7f9fbc0ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc3748700 1 -- 172.21.15.31:0/658735556 shutdown_connections 2020-11-20T13:56:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.245+0000 7f9fc3748700 1 -- 172.21.15.31:0/658735556 wait complete. 2020-11-20T13:56:05.258 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.246+0000 7f9fc3748700 1 Processor -- start 2020-11-20T13:56:05.259 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.246+0000 7f9fc3748700 1 -- start start 2020-11-20T13:56:05.259 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc3748700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fbc0a7170 0x7f9fbc09d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.259 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc3748700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0a7600 0x7f9fbc134750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.259 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc3748700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0abf70 0x7f9fbc134c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.259 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc3748700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc09e180 con 0x7f9fbc0a7600 2020-11-20T13:56:05.260 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc3748700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc125490 con 0x7f9fbc0a7170 2020-11-20T13:56:05.260 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc3748700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc125730 con 0x7f9fbc0abf70 2020-11-20T13:56:05.260 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc24e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0abf70 0x7f9fbc134c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.260 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc14e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0a7600 0x7f9fbc134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.260 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc24e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0abf70 0x7f9fbc134c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36722/0 (socket says 172.21.15.31:36722) 2020-11-20T13:56:05.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc14e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0a7600 0x7f9fbc134750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48212/0 (socket says 172.21.15.31:48212) 2020-11-20T13:56:05.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc14e4700 1 -- 172.21.15.31:0/2742549296 learned_addr learned my addr 172.21.15.31:0/2742549296 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:05.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc1ce5700 1 --2- 172.21.15.31:0/2742549296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fbc0a7170 0x7f9fbc09d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc14e4700 1 -- 172.21.15.31:0/2742549296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0abf70 msgr2=0x7f9fbc134c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.261 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc14e4700 1 --2- 172.21.15.31:0/2742549296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0abf70 0x7f9fbc134c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.263 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc14e4700 1 -- 172.21.15.31:0/2742549296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fbc0a7170 msgr2=0x7f9fbc09d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.263 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc14e4700 1 --2- 172.21.15.31:0/2742549296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fbc0a7170 0x7f9fbc09d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.264 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc14e4700 1 -- 172.21.15.31:0/2742549296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc1259d0 con 0x7f9fbc0a7600 2020-11-20T13:56:05.265 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc24e6700 1 --2- 172.21.15.31:0/2742549296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0abf70 0x7f9fbc134c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:05.265 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc14e4700 1 --2- 172.21.15.31:0/2742549296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0a7600 0x7f9fbc134750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9fac000b80 tx=0x7f9fac0079b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:05.265 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fb27fc700 1 -- 172.21.15.31:0/2742549296 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fac0072e0 con 0x7f9fbc0a7600 2020-11-20T13:56:05.266 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fb27fc700 1 -- 172.21.15.31:0/2742549296 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac007440 con 0x7f9fbc0a7600 2020-11-20T13:56:05.266 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fc3748700 1 -- 172.21.15.31:0/2742549296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc1340f0 con 0x7f9fbc0a7600 2020-11-20T13:56:05.266 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.247+0000 7f9fb27fc700 1 -- 172.21.15.31:0/2742549296 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fac0057d0 con 0x7f9fbc0a7600 2020-11-20T13:56:05.267 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.248+0000 7f9fc3748700 1 -- 172.21.15.31:0/2742549296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc09ca10 con 0x7f9fbc0a7600 2020-11-20T13:56:05.267 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.248+0000 7f9fb27fc700 1 -- 172.21.15.31:0/2742549296 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 2) v1 ==== 31561+0+0 (secure 0 0 0) 0x7f9fac010070 con 0x7f9fbc0a7600 2020-11-20T13:56:05.267 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.248+0000 7f9fb27fc700 1 -- 172.21.15.31:0/2742549296 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f9fac037e30 con 0x7f9fbc0a7600 2020-11-20T13:56:05.268 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.249+0000 7f9fc3748700 1 -- 172.21.15.31:0/2742549296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc057050 con 0x7f9fbc0a7600 2020-11-20T13:56:05.268 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.251+0000 7f9fb27fc700 1 -- 172.21.15.31:0/2742549296 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f9fac018070 con 0x7f9fbc0a7600 2020-11-20T13:56:05.341 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.340+0000 7f9fc3748700 1 -- 172.21.15.31:0/2742549296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "af7acda6-6b94-47d7-b6f8-adbc029495f1", "id": 1} v 0) v1 -- 0x7f9fbc0aabe0 con 0x7f9fbc0a7600 2020-11-20T13:56:05.345 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.344+0000 7f9fb27fc700 1 -- 172.21.15.31:0/2742549296 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af7acda6-6b94-47d7-b6f8-adbc029495f1", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9fac0360b0 con 0x7f9fbc0a7600 2020-11-20T13:56:05.345 INFO:teuthology.orchestra.run.smithi031.stdout:1 2020-11-20T13:56:05.346 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.345+0000 7f9fc3748700 1 -- 172.21.15.31:0/2742549296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0a7600 msgr2=0x7f9fbc134750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.346 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.345+0000 7f9fc3748700 1 --2- 172.21.15.31:0/2742549296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0a7600 0x7f9fbc134750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9fac000b80 tx=0x7f9fac0079b0).stop 2020-11-20T13:56:05.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.345+0000 7f9fc3748700 1 -- 172.21.15.31:0/2742549296 shutdown_connections 2020-11-20T13:56:05.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.345+0000 7f9fc3748700 1 --2- 172.21.15.31:0/2742549296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fbc0a7170 0x7f9fbc09d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.345+0000 7f9fc3748700 1 --2- 172.21.15.31:0/2742549296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9fbc0abf70 0x7f9fbc134c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.345+0000 7f9fc3748700 1 --2- 172.21.15.31:0/2742549296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0a7600 0x7f9fbc134750 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.345+0000 7f9fc3748700 1 -- 172.21.15.31:0/2742549296 >> 172.21.15.31:0/2742549296 conn(0x7f9fbc061d50 msgr2=0x7f9fbc09f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:05.348 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.345+0000 7f9fc3748700 1 -- 172.21.15.31:0/2742549296 shutdown_connections 2020-11-20T13:56:05.348 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.345+0000 7f9fc3748700 1 -- 172.21.15.31:0/2742549296 wait complete. 2020-11-20T13:56:05.356 INFO:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 2d80a994-2822-41e6-a77a-cd3f42925956 2 2020-11-20T13:56:05.471 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.467+0000 7f69629a2700 1 Processor -- start 2020-11-20T13:56:05.471 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.467+0000 7f69629a2700 1 -- start start 2020-11-20T13:56:05.472 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f69629a2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f695c1496f0 0x7f695c149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.472 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f69629a2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c150940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.472 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f69629a2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c0a8f70 con 0x7f695c025300 2020-11-20T13:56:05.472 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f69629a2700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c09e170 con 0x7f695c1496f0 2020-11-20T13:56:05.473 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f69629a2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c09e870 con 0x7f695c14a090 2020-11-20T13:56:05.473 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f6963c04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.474 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f69621a1700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f695c025300 0x7f695c0259f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37842/0 (socket says 172.21.15.31:37842) 2020-11-20T13:56:05.475 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f69621a1700 1 -- 172.21.15.31:0/494621424 learned_addr learned my addr 172.21.15.31:0/494621424 (peer_addr_for_me v1:172.21.15.31:0/0) 2020-11-20T13:56:05.475 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f69619a0700 1 --2- 172.21.15.31:0/494621424 >> v2:172.21.15.39:3300/0 conn(0x7f695c1496f0 0x7f695c149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.475 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f6963c04700 1 -- 172.21.15.31:0/494621424 >> v2:172.21.15.39:3300/0 conn(0x7f695c1496f0 msgr2=0x7f695c149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:05.475 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f6963c04700 1 --2- 172.21.15.31:0/494621424 >> v2:172.21.15.39:3300/0 conn(0x7f695c1496f0 0x7f695c149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.476 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f696119f700 1 -- 172.21.15.31:0/494621424 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312763451 0 0) 0x7f695c0a8f70 con 0x7f695c025300 2020-11-20T13:56:05.476 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.468+0000 7f6963c04700 1 -- 172.21.15.31:0/494621424 >> v1:172.21.15.31:6789/0 conn(0x7f695c025300 legacy=0x7f695c0259f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.476 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f6963c04700 1 -- 172.21.15.31:0/494621424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c09dbc0 con 0x7f695c14a090 2020-11-20T13:56:05.476 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f6963c04700 1 --2- 172.21.15.31:0/494621424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c150940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f69540032b0 tx=0x7f69540091a0).ready entity=mon.2 client_cookie=e1fcffd44a0f2939 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:05.476 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f696119f700 1 -- 172.21.15.31:0/494621424 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f695400ba50 con 0x7f695c14a090 2020-11-20T13:56:05.477 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f696119f700 1 -- 172.21.15.31:0/494621424 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695400bbb0 con 0x7f695c14a090 2020-11-20T13:56:05.477 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f696119f700 1 -- 172.21.15.31:0/494621424 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f695400bd20 con 0x7f695c14a090 2020-11-20T13:56:05.477 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f69629a2700 1 -- 172.21.15.31:0/494621424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 msgr2=0x7f695c150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.477 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f69629a2700 1 --2- 172.21.15.31:0/494621424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c150940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f69540032b0 tx=0x7f69540091a0).stop 2020-11-20T13:56:05.477 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f69629a2700 1 -- 172.21.15.31:0/494621424 shutdown_connections 2020-11-20T13:56:05.478 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f69629a2700 1 --2- 172.21.15.31:0/494621424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c150940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.478 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f69629a2700 1 --2- 172.21.15.31:0/494621424 >> v2:172.21.15.39:3300/0 conn(0x7f695c1496f0 0x7f695c149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.478 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f69629a2700 1 -- 172.21.15.31:0/494621424 >> 172.21.15.31:0/494621424 conn(0x7f695c0ac960 msgr2=0x7f695c0acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:05.478 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f69629a2700 1 -- 172.21.15.31:0/494621424 shutdown_connections 2020-11-20T13:56:05.479 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.469+0000 7f69629a2700 1 -- 172.21.15.31:0/494621424 wait complete. 2020-11-20T13:56:05.481 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.470+0000 7f69629a2700 1 Processor -- start 2020-11-20T13:56:05.482 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.470+0000 7f69629a2700 1 -- start start 2020-11-20T13:56:05.482 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f69629a2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f695c025300 0x7f695c066da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.482 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f69629a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695c1496f0 0x7f695c07ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.482 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f69629a2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c07f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.482 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f69629a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c064f10 con 0x7f695c1496f0 2020-11-20T13:56:05.483 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f69629a2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c07f5c0 con 0x7f695c025300 2020-11-20T13:56:05.483 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f69629a2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c067290 con 0x7f695c14a090 2020-11-20T13:56:05.483 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f6963c04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c07f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.483 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f69619a0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695c1496f0 0x7f695c07ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.484 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f6963c04700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c07f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36730/0 (socket says 172.21.15.31:36730) 2020-11-20T13:56:05.484 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f6963c04700 1 -- 172.21.15.31:0/336830425 learned_addr learned my addr 172.21.15.31:0/336830425 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:05.485 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f69621a1700 1 --2- 172.21.15.31:0/336830425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f695c025300 0x7f695c066da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.485 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f6963c04700 1 -- 172.21.15.31:0/336830425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f695c025300 msgr2=0x7f695c066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.486 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f6963c04700 1 --2- 172.21.15.31:0/336830425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f695c025300 0x7f695c066da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.487 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f6963c04700 1 -- 172.21.15.31:0/336830425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695c1496f0 msgr2=0x7f695c07ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.487 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f6963c04700 1 --2- 172.21.15.31:0/336830425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695c1496f0 0x7f695c07ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.487 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.471+0000 7f6963c04700 1 -- 172.21.15.31:0/336830425 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c065160 con 0x7f695c14a090 2020-11-20T13:56:05.488 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.472+0000 7f6963c04700 1 --2- 172.21.15.31:0/336830425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c07f0d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f69540032b0 tx=0x7f6954016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:05.488 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.472+0000 7f6952ffd700 1 -- 172.21.15.31:0/336830425 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69540107a0 con 0x7f695c14a090 2020-11-20T13:56:05.488 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.472+0000 7f6952ffd700 1 -- 172.21.15.31:0/336830425 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6954010900 con 0x7f695c14a090 2020-11-20T13:56:05.489 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.472+0000 7f69629a2700 1 -- 172.21.15.31:0/336830425 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c065400 con 0x7f695c14a090 2020-11-20T13:56:05.489 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.472+0000 7f6952ffd700 1 -- 172.21.15.31:0/336830425 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6954010c60 con 0x7f695c14a090 2020-11-20T13:56:05.489 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.472+0000 7f69629a2700 1 -- 172.21.15.31:0/336830425 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c0a96a0 con 0x7f695c14a090 2020-11-20T13:56:05.489 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.472+0000 7f6952ffd700 1 -- 172.21.15.31:0/336830425 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 2) v1 ==== 31561+0+0 (secure 0 0 0) 0x7f6954027030 con 0x7f695c14a090 2020-11-20T13:56:05.490 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.472+0000 7f6952ffd700 1 -- 172.21.15.31:0/336830425 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1360+0+0 (secure 0 0 0) 0x7f695403a040 con 0x7f695c14a090 2020-11-20T13:56:05.490 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.473+0000 7f69629a2700 1 -- 172.21.15.31:0/336830425 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c067d40 con 0x7f695c14a090 2020-11-20T13:56:05.490 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.475+0000 7f6952ffd700 1 -- 172.21.15.31:0/336830425 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f6954010dc0 con 0x7f695c14a090 2020-11-20T13:56:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.563+0000 7f69629a2700 1 -- 172.21.15.31:0/336830425 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d80a994-2822-41e6-a77a-cd3f42925956", "id": 2} v 0) v1 -- 0x7f695c066ab0 con 0x7f695c14a090 2020-11-20T13:56:05.568 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.567+0000 7f6952ffd700 1 -- 172.21.15.31:0/336830425 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d80a994-2822-41e6-a77a-cd3f42925956", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6954025020 con 0x7f695c14a090 2020-11-20T13:56:05.568 INFO:teuthology.orchestra.run.smithi031.stdout:2 2020-11-20T13:56:05.569 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.568+0000 7f69629a2700 1 -- 172.21.15.31:0/336830425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 msgr2=0x7f695c07f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.570 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.568+0000 7f69629a2700 1 --2- 172.21.15.31:0/336830425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c07f0d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f69540032b0 tx=0x7f6954016000).stop 2020-11-20T13:56:05.570 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.568+0000 7f69629a2700 1 -- 172.21.15.31:0/336830425 shutdown_connections 2020-11-20T13:56:05.570 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.568+0000 7f69629a2700 1 --2- 172.21.15.31:0/336830425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f695c025300 0x7f695c066da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.570 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.568+0000 7f69629a2700 1 --2- 172.21.15.31:0/336830425 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f695c14a090 0x7f695c07f0d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.570 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.568+0000 7f69629a2700 1 --2- 172.21.15.31:0/336830425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f695c1496f0 0x7f695c07ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.571 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.568+0000 7f69629a2700 1 -- 172.21.15.31:0/336830425 >> 172.21.15.31:0/336830425 conn(0x7f695c0ac960 msgr2=0x7f695c0a63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:05.571 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.568+0000 7f69629a2700 1 -- 172.21.15.31:0/336830425 shutdown_connections 2020-11-20T13:56:05.571 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.568+0000 7f69629a2700 1 -- 172.21.15.31:0/336830425 wait complete. 2020-11-20T13:56:05.579 INFO:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new bdab1d0e-f2a2-4531-a8a6-9bc20089f59b 3 2020-11-20T13:56:05.695 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.691+0000 7f716630b700 1 Processor -- start 2020-11-20T13:56:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.691+0000 7f716630b700 1 -- start start 2020-11-20T13:56:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f716630b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71600abf70 0x7f71600a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f716630b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f71600a7170 0x7f716007f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f716630b700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600a5420 con 0x7f71600a7600 2020-11-20T13:56:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f716630b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71600a3180 con 0x7f71600abf70 2020-11-20T13:56:05.697 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f716630b700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71600a4ce0 con 0x7f71600a7170 2020-11-20T13:56:05.697 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f71648a8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71600abf70 0x7f71600a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.697 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f71648a8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71600abf70 0x7f71600a4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48236/0 (socket says 172.21.15.31:48236) 2020-11-20T13:56:05.697 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f71648a8700 1 -- 172.21.15.31:0/1263473155 learned_addr learned my addr 172.21.15.31:0/1263473155 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:05.697 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f715ffff700 1 --2- 172.21.15.31:0/1263473155 >> v2:172.21.15.39:3300/0 conn(0x7f71600a7170 0x7f716007f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f71648a8700 1 -- 172.21.15.31:0/1263473155 >> v2:172.21.15.39:3300/0 conn(0x7f71600a7170 msgr2=0x7f716007f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f71648a8700 1 --2- 172.21.15.31:0/1263473155 >> v2:172.21.15.39:3300/0 conn(0x7f71600a7170 0x7f716007f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f71648a8700 1 -- 172.21.15.31:0/1263473155 >> v1:172.21.15.39:6789/0 conn(0x7f71600a7600 legacy=0x7f716007fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f71648a8700 1 -- 172.21.15.31:0/1263473155 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600a4f80 con 0x7f71600abf70 2020-11-20T13:56:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f715ffff700 1 --2- 172.21.15.31:0/1263473155 >> v2:172.21.15.39:3300/0 conn(0x7f71600a7170 0x7f716007f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.692+0000 7f71648a8700 1 --2- 172.21.15.31:0/1263473155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600abf70 0x7f71600a4100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f716005cbc0 tx=0x7f7150006e80).ready entity=mon.0 client_cookie=da4664fd9e0a9bcf server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f715f7fe700 1 -- 172.21.15.31:0/1263473155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71500097b0 con 0x7f71600abf70 2020-11-20T13:56:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f715f7fe700 1 -- 172.21.15.31:0/1263473155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7150009910 con 0x7f71600abf70 2020-11-20T13:56:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f715f7fe700 1 -- 172.21.15.31:0/1263473155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7150009a80 con 0x7f71600abf70 2020-11-20T13:56:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f716630b700 1 -- 172.21.15.31:0/1263473155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600abf70 msgr2=0x7f71600a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f716630b700 1 --2- 172.21.15.31:0/1263473155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600abf70 0x7f71600a4100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f716005cbc0 tx=0x7f7150006e80).stop 2020-11-20T13:56:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f716630b700 1 -- 172.21.15.31:0/1263473155 shutdown_connections 2020-11-20T13:56:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f716630b700 1 --2- 172.21.15.31:0/1263473155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600abf70 0x7f71600a4100 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f716630b700 1 --2- 172.21.15.31:0/1263473155 >> v2:172.21.15.39:3300/0 conn(0x7f71600a7170 0x7f716007f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f716630b700 1 -- 172.21.15.31:0/1263473155 >> 172.21.15.31:0/1263473155 conn(0x7f7160061d50 msgr2=0x7f71600ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f716630b700 1 -- 172.21.15.31:0/1263473155 shutdown_connections 2020-11-20T13:56:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.693+0000 7f716630b700 1 -- 172.21.15.31:0/1263473155 wait complete. 2020-11-20T13:56:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.694+0000 7f716630b700 1 Processor -- start 2020-11-20T13:56:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.694+0000 7f716630b700 1 -- start start 2020-11-20T13:56:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f716630b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71600a7170 0x7f71601341f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f716630b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600a7600 0x7f7160121e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f716630b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71600abf70 0x7f716009d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f716630b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7160134900 con 0x7f71600a7600 2020-11-20T13:56:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f716630b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7160134ba0 con 0x7f71600abf70 2020-11-20T13:56:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f716630b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7160134e40 con 0x7f71600a7170 2020-11-20T13:56:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f715ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600a7600 0x7f7160121e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f71648a8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71600a7170 0x7f71601341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f715ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600a7600 0x7f7160121e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48244/0 (socket says 172.21.15.31:48244) 2020-11-20T13:56:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f715ffff700 1 -- 172.21.15.31:0/218472520 learned_addr learned my addr 172.21.15.31:0/218472520 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f71650a9700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71600abf70 0x7f716009d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f71648a8700 1 -- 172.21.15.31:0/218472520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71600abf70 msgr2=0x7f716009d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f71648a8700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71600abf70 0x7f716009d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f71648a8700 1 -- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600a7600 msgr2=0x7f7160121e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f71648a8700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600a7600 0x7f7160121e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f71648a8700 1 -- 172.21.15.31:0/218472520 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160122330 con 0x7f71600a7170 2020-11-20T13:56:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f715ffff700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600a7600 0x7f7160121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f71650a9700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71600abf70 0x7f716009d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.695+0000 7f71648a8700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71600a7170 0x7f71601341f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f716005cbc0 tx=0x7f7150016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.696+0000 7f715d7fa700 1 -- 172.21.15.31:0/218472520 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7150020400 con 0x7f71600a7170 2020-11-20T13:56:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.696+0000 7f715d7fa700 1 -- 172.21.15.31:0/218472520 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7150020560 con 0x7f71600a7170 2020-11-20T13:56:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.696+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7160127940 con 0x7f71600a7170 2020-11-20T13:56:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.696+0000 7f715d7fa700 1 -- 172.21.15.31:0/218472520 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71500208c0 con 0x7f71600a7170 2020-11-20T13:56:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.696+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716009d730 con 0x7f71600a7170 2020-11-20T13:56:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.697+0000 7f715d7fa700 1 -- 172.21.15.31:0/218472520 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 3) v1 ==== 63226+0+0 (secure 0 0 0) 0x7f715001e070 con 0x7f71600a7170 2020-11-20T13:56:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.697+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7160057050 con 0x7f71600a7170 2020-11-20T13:56:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.697+0000 7f715d7fa700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7140051130 0x7f71400535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.697+0000 7f715d7fa700 1 -- 172.21.15.31:0/218472520 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1499+0+0 (secure 0 0 0) 0x7f7150068640 con 0x7f71600a7170 2020-11-20T13:56:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.697+0000 7f715ffff700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7140051130 0x7f71400535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.697+0000 7f715ffff700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7140051130 0x7f71400535f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f715400d000 tx=0x7f7154006f90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.701+0000 7f715d7fa700 1 -- 172.21.15.31:0/218472520 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f7150041c00 con 0x7f71600a7170 2020-11-20T13:56:05.881 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.878+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bdab1d0e-f2a2-4531-a8a6-9bc20089f59b", "id": 3} v 0) v1 -- 0x7f716005c980 con 0x7f71600a7170 2020-11-20T13:56:05.883 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.881+0000 7f715d7fa700 1 -- 172.21.15.31:0/218472520 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bdab1d0e-f2a2-4531-a8a6-9bc20089f59b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f716005c980 con 0x7f71600a7170 2020-11-20T13:56:05.883 INFO:teuthology.orchestra.run.smithi031.stdout:3 2020-11-20T13:56:05.885 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7140051130 msgr2=0x7f71400535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.885 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7140051130 0x7f71400535f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f715400d000 tx=0x7f7154006f90).stop 2020-11-20T13:56:05.885 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71600a7170 msgr2=0x7f71601341f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:05.885 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71600a7170 0x7f71601341f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f716005cbc0 tx=0x7f7150016000).stop 2020-11-20T13:56:05.886 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 shutdown_connections 2020-11-20T13:56:05.886 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7140051130 0x7f71400535f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.886 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71600abf70 0x7f716009d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.886 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71600a7170 0x7f71601341f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.886 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 --2- 172.21.15.31:0/218472520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71600a7600 0x7f7160121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:05.887 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 >> 172.21.15.31:0/218472520 conn(0x7f7160061d50 msgr2=0x7f71600a23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:05.887 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 shutdown_connections 2020-11-20T13:56:05.887 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:05.883+0000 7f716630b700 1 -- 172.21.15.31:0/218472520 wait complete. 2020-11-20T13:56:05.895 INFO:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 4ed27863-a55d-431c-b59d-1cb548279143 4 2020-11-20T13:56:06.017 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.007+0000 7fefcf231700 1 Processor -- start 2020-11-20T13:56:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcf231700 1 -- start start 2020-11-20T13:56:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcf231700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fefc80a7170 0x7fefc807f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcf231700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80a7600 0x7fefc807fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcf231700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc80a5420 con 0x7fefc80abf70 2020-11-20T13:56:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcf231700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc80a3180 con 0x7fefc80a7170 2020-11-20T13:56:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcf231700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc80a4ce0 con 0x7fefc80a7600 2020-11-20T13:56:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcdfcf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80a7600 0x7fefc807fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefccfcd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fefc80a7170 0x7fefc807f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcdfcf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80a7600 0x7fefc807fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36758/0 (socket says 172.21.15.31:36758) 2020-11-20T13:56:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcdfcf700 1 -- 172.21.15.31:0/602848194 learned_addr learned my addr 172.21.15.31:0/602848194 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.008+0000 7fefcd7ce700 1 --1- 172.21.15.31:0/602848194 >> v1:172.21.15.31:6789/0 conn(0x7fefc80abf70 0x7fefc80a4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37876/0 (socket says 172.21.15.31:37876) 2020-11-20T13:56:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcdfcf700 1 -- 172.21.15.31:0/602848194 >> v2:172.21.15.31:3300/0 conn(0x7fefc80a7170 msgr2=0x7fefc807f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcdfcf700 1 --2- 172.21.15.31:0/602848194 >> v2:172.21.15.31:3300/0 conn(0x7fefc80a7170 0x7fefc807f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcdfcf700 1 -- 172.21.15.31:0/602848194 >> v1:172.21.15.31:6789/0 conn(0x7fefc80abf70 legacy=0x7fefc80a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefbffff700 1 -- 172.21.15.31:0/602848194 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347811944 0 0) 0x7fefc80a5420 con 0x7fefc80abf70 2020-11-20T13:56:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcdfcf700 1 -- 172.21.15.31:0/602848194 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc80a4f80 con 0x7fefc80a7600 2020-11-20T13:56:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefccfcd700 1 --2- 172.21.15.31:0/602848194 >> v2:172.21.15.31:3300/0 conn(0x7fefc80a7170 0x7fefc807f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcdfcf700 1 --2- 172.21.15.31:0/602848194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80a7600 0x7fefc807fbb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fefc00032b0 tx=0x7fefc0009270).ready entity=mon.2 client_cookie=c0d1bd48107fe516 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefbffff700 1 -- 172.21.15.31:0/602848194 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc0009e60 con 0x7fefc80a7600 2020-11-20T13:56:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefbffff700 1 -- 172.21.15.31:0/602848194 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc000bc00 con 0x7fefc80a7600 2020-11-20T13:56:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefbffff700 1 -- 172.21.15.31:0/602848194 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc000bd70 con 0x7fefc80a7600 2020-11-20T13:56:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcf231700 1 -- 172.21.15.31:0/602848194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80a7600 msgr2=0x7fefc807fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcf231700 1 --2- 172.21.15.31:0/602848194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80a7600 0x7fefc807fbb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fefc00032b0 tx=0x7fefc0009270).stop 2020-11-20T13:56:06.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcf231700 1 -- 172.21.15.31:0/602848194 shutdown_connections 2020-11-20T13:56:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcf231700 1 --2- 172.21.15.31:0/602848194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80a7600 0x7fefc807fbb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcf231700 1 --2- 172.21.15.31:0/602848194 >> v2:172.21.15.31:3300/0 conn(0x7fefc80a7170 0x7fefc807f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.009+0000 7fefcf231700 1 -- 172.21.15.31:0/602848194 >> 172.21.15.31:0/602848194 conn(0x7fefc8061d50 msgr2=0x7fefc80ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.010+0000 7fefcf231700 1 -- 172.21.15.31:0/602848194 shutdown_connections 2020-11-20T13:56:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.010+0000 7fefcf231700 1 -- 172.21.15.31:0/602848194 wait complete. 2020-11-20T13:56:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcf231700 1 Processor -- start 2020-11-20T13:56:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcf231700 1 -- start start 2020-11-20T13:56:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcf231700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefc80a7170 0x7fefc8065490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcf231700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefc80a7600 0x7fefc81310f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcf231700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80abf70 0x7fefc81315e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcf231700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8131ad0 con 0x7fefc80a7600 2020-11-20T13:56:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcf231700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc80664f0 con 0x7fefc80a7170 2020-11-20T13:56:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcf231700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc808fcf0 con 0x7fefc80abf70 2020-11-20T13:56:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcdfcf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80abf70 0x7fefc81315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefccfcd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefc80a7600 0x7fefc81310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefccfcd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefc80a7600 0x7fefc81310f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48258/0 (socket says 172.21.15.31:48258) 2020-11-20T13:56:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefcdfcf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80abf70 0x7fefc81315e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36768/0 (socket says 172.21.15.31:36768) 2020-11-20T13:56:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.011+0000 7fefccfcd700 1 -- 172.21.15.31:0/753451632 learned_addr learned my addr 172.21.15.31:0/753451632 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefcd7ce700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefc80a7170 0x7fefc8065490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefccfcd700 1 -- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80abf70 msgr2=0x7fefc81315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefccfcd700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80abf70 0x7fefc81315e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefccfcd700 1 -- 172.21.15.31:0/753451632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefc80a7170 msgr2=0x7fefc8065490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefccfcd700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefc80a7170 0x7fefc8065490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefccfcd700 1 -- 172.21.15.31:0/753451632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc808ff90 con 0x7fefc80a7600 2020-11-20T13:56:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefcdfcf700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80abf70 0x7fefc81315e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefccfcd700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefc80a7600 0x7fefc81310f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fefb800c000 tx=0x7fefb8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefbdffb700 1 -- 172.21.15.31:0/753451632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefb800cb90 con 0x7fefc80a7600 2020-11-20T13:56:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefbdffb700 1 -- 172.21.15.31:0/753451632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb800ccf0 con 0x7fefc80a7600 2020-11-20T13:56:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc8090430 con 0x7fefc80a7600 2020-11-20T13:56:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefbdffb700 1 -- 172.21.15.31:0/753451632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefb80125e0 con 0x7fefc80a7600 2020-11-20T13:56:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.012+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc8064940 con 0x7fefc80a7600 2020-11-20T13:56:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.013+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc8090120 con 0x7fefc80a7600 2020-11-20T13:56:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.013+0000 7fefbdffb700 1 -- 172.21.15.31:0/753451632 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 3) v1 ==== 63226+0+0 (secure 0 0 0) 0x7fefb8012740 con 0x7fefc80a7600 2020-11-20T13:56:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.013+0000 7fefbdffb700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fefa8051130 0x7fefa80535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.013+0000 7fefbdffb700 1 -- 172.21.15.31:0/753451632 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1614+0+0 (secure 0 0 0) 0x7fefb80683b0 con 0x7fefc80a7600 2020-11-20T13:56:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.014+0000 7fefcd7ce700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fefa8051130 0x7fefa80535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.014+0000 7fefcd7ce700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fefa8051130 0x7fefa80535f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fefc400b000 tx=0x7fefc40070d0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:06.031 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.017+0000 7fefbdffb700 1 -- 172.21.15.31:0/753451632 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fefb8041980 con 0x7fefc80a7600 2020-11-20T13:56:06.197 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.195+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4ed27863-a55d-431c-b59d-1cb548279143", "id": 4} v 0) v1 -- 0x7fefc8057050 con 0x7fefc80a7600 2020-11-20T13:56:06.200 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.198+0000 7fefbdffb700 1 -- 172.21.15.31:0/753451632 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ed27863-a55d-431c-b59d-1cb548279143", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fefb800ce60 con 0x7fefc80a7600 2020-11-20T13:56:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:4 2020-11-20T13:56:06.202 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fefa8051130 msgr2=0x7fefa80535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.202 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fefa8051130 0x7fefa80535f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fefc400b000 tx=0x7fefc40070d0).stop 2020-11-20T13:56:06.202 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefc80a7600 msgr2=0x7fefc81310f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.203 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefc80a7600 0x7fefc81310f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fefb800c000 tx=0x7fefb8006dc0).stop 2020-11-20T13:56:06.203 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 shutdown_connections 2020-11-20T13:56:06.203 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fefa8051130 0x7fefa80535f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.204 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefc80a7170 0x7fefc8065490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.204 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fefc80abf70 0x7fefc81315e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.204 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 --2- 172.21.15.31:0/753451632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefc80a7600 0x7fefc81310f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.204 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.200+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 >> 172.21.15.31:0/753451632 conn(0x7fefc8061d50 msgr2=0x7fefc805ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:06.204 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.201+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 shutdown_connections 2020-11-20T13:56:06.205 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.201+0000 7fefcf231700 1 -- 172.21.15.31:0/753451632 wait complete. 2020-11-20T13:56:06.213 INFO:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 2acfbfc2-ad2e-4c66-a3da-67d806e4c69b 5 2020-11-20T13:56:06.330 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.325+0000 7f6146646700 1 Processor -- start 2020-11-20T13:56:06.330 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.325+0000 7f6146646700 1 -- start start 2020-11-20T13:56:06.330 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.326+0000 7f6146646700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61400abf70 0x7f61400a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.331 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.326+0000 7f6146646700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400a7170 0x7f614007f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.331 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.326+0000 7f6146646700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61400a5420 con 0x7f61400a75d0 2020-11-20T13:56:06.331 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.326+0000 7f6146646700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61400a3180 con 0x7f61400abf70 2020-11-20T13:56:06.331 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.326+0000 7f6146646700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61400a4ce0 con 0x7f61400a7170 2020-11-20T13:56:06.332 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.326+0000 7f6144be3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61400abf70 0x7f61400a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.332 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.326+0000 7f61453e4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f61400a75d0 0x7f614007fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37892/0 (socket says 172.21.15.31:37892) 2020-11-20T13:56:06.332 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.326+0000 7f613ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400a7170 0x7f614007f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.332 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.326+0000 7f61453e4700 1 -- 172.21.15.31:0/479305040 learned_addr learned my addr 172.21.15.31:0/479305040 (peer_addr_for_me v1:172.21.15.31:0/0) 2020-11-20T13:56:06.332 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f613ffff700 1 -- 172.21.15.31:0/479305040 >> v2:172.21.15.31:3300/0 conn(0x7f61400abf70 msgr2=0x7f61400a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:06.333 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f613ffff700 1 --2- 172.21.15.31:0/479305040 >> v2:172.21.15.31:3300/0 conn(0x7f61400abf70 0x7f61400a4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.333 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f613ffff700 1 -- 172.21.15.31:0/479305040 >> v1:172.21.15.31:6789/0 conn(0x7f61400a75d0 legacy=0x7f614007fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.333 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f613ffff700 1 -- 172.21.15.31:0/479305040 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400a4f80 con 0x7f61400a7170 2020-11-20T13:56:06.333 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f6144be3700 1 --2- 172.21.15.31:0/479305040 >> v2:172.21.15.31:3300/0 conn(0x7f61400abf70 0x7f61400a4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:06.333 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f613ffff700 1 --2- 172.21.15.31:0/479305040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400a7170 0x7f614007f6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f6134002f30 tx=0x7f6134006dc0).ready entity=mon.2 client_cookie=9eb73f4fa660ab79 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:06.334 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f613f7fe700 1 -- 172.21.15.31:0/479305040 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6134009760 con 0x7f61400a7170 2020-11-20T13:56:06.334 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f613f7fe700 1 -- 172.21.15.31:0/479305040 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61340098c0 con 0x7f61400a7170 2020-11-20T13:56:06.334 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f613f7fe700 1 -- 172.21.15.31:0/479305040 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6134009c20 con 0x7f61400a7170 2020-11-20T13:56:06.334 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f6146646700 1 -- 172.21.15.31:0/479305040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400a7170 msgr2=0x7f614007f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.336 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f6146646700 1 --2- 172.21.15.31:0/479305040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400a7170 0x7f614007f6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f6134002f30 tx=0x7f6134006dc0).stop 2020-11-20T13:56:06.336 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f6146646700 1 -- 172.21.15.31:0/479305040 shutdown_connections 2020-11-20T13:56:06.337 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f6146646700 1 --2- 172.21.15.31:0/479305040 >> v2:172.21.15.31:3300/0 conn(0x7f61400abf70 0x7f61400a4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.337 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f6146646700 1 --2- 172.21.15.31:0/479305040 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400a7170 0x7f614007f6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.337 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f6146646700 1 -- 172.21.15.31:0/479305040 >> 172.21.15.31:0/479305040 conn(0x7f6140061d50 msgr2=0x7f61400ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:06.337 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f6146646700 1 -- 172.21.15.31:0/479305040 shutdown_connections 2020-11-20T13:56:06.337 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.327+0000 7f6146646700 1 -- 172.21.15.31:0/479305040 wait complete. 2020-11-20T13:56:06.338 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f6146646700 1 Processor -- start 2020-11-20T13:56:06.338 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f6146646700 1 -- start start 2020-11-20T13:56:06.341 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f6146646700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61400a7170 0x7f6140135340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.341 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f6146646700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61400a75d0 0x7f6140124490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.341 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f6146646700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400abf70 0x7f6140124980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.341 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f6146646700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61401257f0 con 0x7f61400a75d0 2020-11-20T13:56:06.342 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f6146646700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6140138c20 con 0x7f61400a7170 2020-11-20T13:56:06.342 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f6146646700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6140138ec0 con 0x7f61400abf70 2020-11-20T13:56:06.342 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f613ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61400a75d0 0x7f6140124490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.342 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f61453e4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400abf70 0x7f6140124980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.343 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f613ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61400a75d0 0x7f6140124490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48270/0 (socket says 172.21.15.31:48270) 2020-11-20T13:56:06.343 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.329+0000 7f613ffff700 1 -- 172.21.15.31:0/1086115697 learned_addr learned my addr 172.21.15.31:0/1086115697 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:06.343 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f6144be3700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61400a7170 0x7f6140135340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.343 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f613ffff700 1 -- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400abf70 msgr2=0x7f6140124980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.343 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f613ffff700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400abf70 0x7f6140124980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f613ffff700 1 -- 172.21.15.31:0/1086115697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61400a7170 msgr2=0x7f6140135340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f613ffff700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61400a7170 0x7f6140135340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f613ffff700 1 -- 172.21.15.31:0/1086115697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140139160 con 0x7f61400a75d0 2020-11-20T13:56:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f6144be3700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61400a7170 0x7f6140135340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f613ffff700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61400a75d0 0x7f6140124490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6134002f30 tx=0x7f6134015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f613d7fa700 1 -- 172.21.15.31:0/1086115697 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6134011d00 con 0x7f61400a75d0 2020-11-20T13:56:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f613d7fa700 1 -- 172.21.15.31:0/1086115697 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134011e60 con 0x7f61400a75d0 2020-11-20T13:56:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6140138910 con 0x7f61400a75d0 2020-11-20T13:56:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f613d7fa700 1 -- 172.21.15.31:0/1086115697 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f613401d630 con 0x7f61400a75d0 2020-11-20T13:56:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.330+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6140128b80 con 0x7f61400a75d0 2020-11-20T13:56:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.331+0000 7f613d7fa700 1 -- 172.21.15.31:0/1086115697 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 3) v1 ==== 63226+0+0 (secure 0 0 0) 0x7f6134024030 con 0x7f61400a75d0 2020-11-20T13:56:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.331+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61401392f0 con 0x7f61400a75d0 2020-11-20T13:56:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.331+0000 7f613d7fa700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f6120051250 0x7f6120053710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.331+0000 7f613d7fa700 1 -- 172.21.15.31:0/1086115697 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1729+0+0 (secure 0 0 0) 0x7f6134068d30 con 0x7f61400a75d0 2020-11-20T13:56:06.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.331+0000 7f6144be3700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f6120051250 0x7f6120053710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.332+0000 7f6144be3700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f6120051250 0x7f6120053710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f613000b000 tx=0x7f6130008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:06.347 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.335+0000 7f613d7fa700 1 -- 172.21.15.31:0/1086115697 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f613406e020 con 0x7f61400a75d0 2020-11-20T13:56:06.513 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.512+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2acfbfc2-ad2e-4c66-a3da-67d806e4c69b", "id": 5} v 0) v1 -- 0x7f6140057050 con 0x7f61400a75d0 2020-11-20T13:56:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.516+0000 7f613d7fa700 1 -- 172.21.15.31:0/1086115697 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2acfbfc2-ad2e-4c66-a3da-67d806e4c69b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6134022020 con 0x7f61400a75d0 2020-11-20T13:56:06.517 INFO:teuthology.orchestra.run.smithi031.stdout:5 2020-11-20T13:56:06.519 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f6120051250 msgr2=0x7f6120053710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.520 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f6120051250 0x7f6120053710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f613000b000 tx=0x7f6130008040).stop 2020-11-20T13:56:06.520 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61400a75d0 msgr2=0x7f6140124490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.520 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61400a75d0 0x7f6140124490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6134002f30 tx=0x7f6134015000).stop 2020-11-20T13:56:06.520 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 shutdown_connections 2020-11-20T13:56:06.520 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f6120051250 0x7f6120053710 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.521 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61400a7170 0x7f6140135340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.521 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61400abf70 0x7f6140124980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.521 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 --2- 172.21.15.31:0/1086115697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61400a75d0 0x7f6140124490 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.521 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 >> 172.21.15.31:0/1086115697 conn(0x7f6140061d50 msgr2=0x7f614009f770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:06.521 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 shutdown_connections 2020-11-20T13:56:06.522 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.518+0000 7f6146646700 1 -- 172.21.15.31:0/1086115697 wait complete. 2020-11-20T13:56:06.529 INFO:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 952daddd-927b-4859-a149-d0128b4106f0 6 2020-11-20T13:56:06.644 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.640+0000 7f4a58a89700 1 Processor -- start 2020-11-20T13:56:06.645 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.640+0000 7f4a58a89700 1 -- start start 2020-11-20T13:56:06.645 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a58a89700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a540a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.646 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a58a89700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4a540a7170 0x7f4a5407f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.646 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a58a89700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a540a5420 con 0x7f4a540a75f0 2020-11-20T13:56:06.646 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a58a89700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a540a3180 con 0x7f4a540a7170 2020-11-20T13:56:06.646 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a58a89700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540a4ce0 con 0x7f4a540abf70 2020-11-20T13:56:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a52d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a540a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a52d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a540a4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36784/0 (socket says 172.21.15.31:36784) 2020-11-20T13:56:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a52d9d700 1 -- 172.21.15.31:0/3726173648 learned_addr learned my addr 172.21.15.31:0/3726173648 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a5259c700 1 --2- 172.21.15.31:0/3726173648 >> v2:172.21.15.39:3300/0 conn(0x7f4a540a7170 0x7f4a5407f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.648 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a52d9d700 1 -- 172.21.15.31:0/3726173648 >> v2:172.21.15.39:3300/0 conn(0x7f4a540a7170 msgr2=0x7f4a5407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:06.648 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a52d9d700 1 --2- 172.21.15.31:0/3726173648 >> v2:172.21.15.39:3300/0 conn(0x7f4a540a7170 0x7f4a5407f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.648 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a52d9d700 1 -- 172.21.15.31:0/3726173648 >> v1:172.21.15.39:6789/0 conn(0x7f4a540a75f0 legacy=0x7f4a5407fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:06.649 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.641+0000 7f4a52d9d700 1 -- 172.21.15.31:0/3726173648 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540a4f80 con 0x7f4a540abf70 2020-11-20T13:56:06.649 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a5259c700 1 --2- 172.21.15.31:0/3726173648 >> v2:172.21.15.39:3300/0 conn(0x7f4a540a7170 0x7f4a5407f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:06.649 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a52d9d700 1 --2- 172.21.15.31:0/3726173648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a540a4100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f4a5405cbc0 tx=0x7f4a44006e80).ready entity=mon.2 client_cookie=8b52ad6414a2a55c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:06.649 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a51d9b700 1 -- 172.21.15.31:0/3726173648 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a440097b0 con 0x7f4a540abf70 2020-11-20T13:56:06.650 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a51d9b700 1 -- 172.21.15.31:0/3726173648 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a44009910 con 0x7f4a540abf70 2020-11-20T13:56:06.650 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a51d9b700 1 -- 172.21.15.31:0/3726173648 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a44009ac0 con 0x7f4a540abf70 2020-11-20T13:56:06.650 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a58a89700 1 -- 172.21.15.31:0/3726173648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 msgr2=0x7f4a540a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.650 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a58a89700 1 --2- 172.21.15.31:0/3726173648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a540a4100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f4a5405cbc0 tx=0x7f4a44006e80).stop 2020-11-20T13:56:06.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a58a89700 1 -- 172.21.15.31:0/3726173648 shutdown_connections 2020-11-20T13:56:06.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a58a89700 1 --2- 172.21.15.31:0/3726173648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a540a4100 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a58a89700 1 --2- 172.21.15.31:0/3726173648 >> v2:172.21.15.39:3300/0 conn(0x7f4a540a7170 0x7f4a5407f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a58a89700 1 -- 172.21.15.31:0/3726173648 >> 172.21.15.31:0/3726173648 conn(0x7f4a54061d50 msgr2=0x7f4a540ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:06.651 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a58a89700 1 -- 172.21.15.31:0/3726173648 shutdown_connections 2020-11-20T13:56:06.652 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.642+0000 7f4a58a89700 1 -- 172.21.15.31:0/3726173648 wait complete. 2020-11-20T13:56:06.652 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.643+0000 7f4a58a89700 1 Processor -- start 2020-11-20T13:56:06.652 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a58a89700 1 -- start start 2020-11-20T13:56:06.655 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a58a89700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a540a7170 0x7f4a54067060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.655 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a58a89700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a540a75f0 0x7f4a541264d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.655 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a58a89700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a541269c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.656 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a58a89700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54127f60 con 0x7f4a540a75f0 2020-11-20T13:56:06.656 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a58a89700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54067550 con 0x7f4a540a7170 2020-11-20T13:56:06.656 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a58a89700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54127330 con 0x7f4a540abf70 2020-11-20T13:56:06.657 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a5259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a540a75f0 0x7f4a541264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.657 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a5359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a541269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.657 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a5259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a540a75f0 0x7f4a541264d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48282/0 (socket says 172.21.15.31:48282) 2020-11-20T13:56:06.657 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a5259c700 1 -- 172.21.15.31:0/1636376473 learned_addr learned my addr 172.21.15.31:0/1636376473 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:06.658 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a52d9d700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a540a7170 0x7f4a54067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.658 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a5259c700 1 -- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 msgr2=0x7f4a541269c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.658 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a5259c700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a541269c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.658 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a5259c700 1 -- 172.21.15.31:0/1636376473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a540a7170 msgr2=0x7f4a54067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.658 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.644+0000 7f4a5259c700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a540a7170 0x7f4a54067060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.659 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.645+0000 7f4a5259c700 1 -- 172.21.15.31:0/1636376473 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54127580 con 0x7f4a540a75f0 2020-11-20T13:56:06.659 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.645+0000 7f4a5359e700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a541269c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:06.659 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.645+0000 7f4a5259c700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a540a75f0 0x7f4a541264d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4a54067690 tx=0x7f4a48008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:06.660 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.645+0000 7f4a437fe700 1 -- 172.21.15.31:0/1636376473 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a48010580 con 0x7f4a540a75f0 2020-11-20T13:56:06.660 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.645+0000 7f4a437fe700 1 -- 172.21.15.31:0/1636376473 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a480106e0 con 0x7f4a540a75f0 2020-11-20T13:56:06.660 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.645+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a54127820 con 0x7f4a540a75f0 2020-11-20T13:56:06.660 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.645+0000 7f4a437fe700 1 -- 172.21.15.31:0/1636376473 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a48010a40 con 0x7f4a540a75f0 2020-11-20T13:56:06.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.645+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5409d650 con 0x7f4a540a75f0 2020-11-20T13:56:06.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.646+0000 7f4a437fe700 1 -- 172.21.15.31:0/1636376473 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 3) v1 ==== 63226+0+0 (secure 0 0 0) 0x7f4a48010ba0 con 0x7f4a540a75f0 2020-11-20T13:56:06.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.646+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a54057050 con 0x7f4a540a75f0 2020-11-20T13:56:06.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.646+0000 7f4a437fe700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a380511c0 0x7f4a38053680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:06.661 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.646+0000 7f4a437fe700 1 -- 172.21.15.31:0/1636376473 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1844+0+0 (secure 0 0 0) 0x7f4a48067e10 con 0x7f4a540a75f0 2020-11-20T13:56:06.662 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.646+0000 7f4a52d9d700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a380511c0 0x7f4a38053680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:06.662 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.646+0000 7f4a52d9d700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a380511c0 0x7f4a38053680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4a4401c000 tx=0x7f4a44016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:06.662 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.650+0000 7f4a437fe700 1 -- 172.21.15.31:0/1636376473 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f4a48041290 con 0x7f4a540a75f0 2020-11-20T13:56:06.818 INFO:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T13:56:06.820 INFO:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T13:56:06.829 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.828+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "952daddd-927b-4859-a149-d0128b4106f0", "id": 6} v 0) v1 -- 0x7f4a541279b0 con 0x7f4a540a75f0 2020-11-20T13:56:06.837 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.836+0000 7f4a437fe700 1 -- 172.21.15.31:0/1636376473 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "952daddd-927b-4859-a149-d0128b4106f0", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4a480448b0 con 0x7f4a540a75f0 2020-11-20T13:56:06.837 INFO:teuthology.orchestra.run.smithi031.stdout:6 2020-11-20T13:56:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a380511c0 msgr2=0x7f4a38053680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a380511c0 0x7f4a38053680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4a4401c000 tx=0x7f4a44016000).stop 2020-11-20T13:56:06.841 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a540a75f0 msgr2=0x7f4a541264d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:06.841 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a540a75f0 0x7f4a541264d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4a54067690 tx=0x7f4a48008040).stop 2020-11-20T13:56:06.841 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 shutdown_connections 2020-11-20T13:56:06.841 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a380511c0 0x7f4a38053680 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.842 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a540a7170 0x7f4a54067060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.842 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a540abf70 0x7f4a541269c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.842 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 --2- 172.21.15.31:0/1636376473 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a540a75f0 0x7f4a541264d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.838+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 >> 172.21.15.31:0/1636376473 conn(0x7f4a54061d50 msgr2=0x7f4a540aae40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.839+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 shutdown_connections 2020-11-20T13:56:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:06.839+0000 7f4a58a89700 1 -- 172.21.15.31:0/1636376473 wait complete. 2020-11-20T13:56:06.850 INFO:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 2bf29e2c-70b0-44b6-8414-e8efcd0a43e4 7 2020-11-20T13:56:07.006 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.000+0000 7fcce4e16700 1 Processor -- start 2020-11-20T13:56:07.006 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.000+0000 7fcce4e16700 1 -- start start 2020-11-20T13:56:07.006 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.001+0000 7fcce4e16700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcce00a7170 0x7fcce007f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:07.007 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.001+0000 7fcce4e16700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00a5420 con 0x7fcce00a7600 2020-11-20T13:56:07.007 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.001+0000 7fcce4e16700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00a4ce0 con 0x7fcce00abf70 2020-11-20T13:56:07.007 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.001+0000 7fcce4e16700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce00a3180 con 0x7fcce00a7170 2020-11-20T13:56:07.007 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.001+0000 7fccdf59e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcce00a7600 0x7fcce007fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37914/0 (socket says 172.21.15.31:37914) 2020-11-20T13:56:07.007 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.001+0000 7fccdf59e700 1 -- 172.21.15.31:0/1234196180 learned_addr learned my addr 172.21.15.31:0/1234196180 (peer_addr_for_me v1:172.21.15.31:0/0) 2020-11-20T13:56:07.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454230465 0 0) 0x7fcce00a5420 con 0x7fcce00a7600 2020-11-20T13:56:07.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc8003230 con 0x7fcce00a7600 2020-11-20T13:56:07.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccde59c700 1 --2- 172.21.15.31:0/1234196180 >> v2:172.21.15.39:3300/0 conn(0x7fcce00a7170 0x7fcce007f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:07.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3766110347 0 0) 0x7fccc8003230 con 0x7fcce00a7600 2020-11-20T13:56:07.008 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 >> v2:172.21.15.39:3300/0 conn(0x7fcce00a7170 msgr2=0x7fcce007f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:07.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 --2- 172.21.15.31:0/1234196180 >> v2:172.21.15.39:3300/0 conn(0x7fcce00a7170 0x7fcce007f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 >> v1:172.21.15.39:6789/0 conn(0x7fcce00abf70 legacy=0x7fcce00a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:07.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00a4f80 con 0x7fcce00a7600 2020-11-20T13:56:07.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7fccd8001a50 con 0x7fcce00a7600 2020-11-20T13:56:07.009 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 >> v1:172.21.15.31:6789/0 conn(0x7fcce00a7600 legacy=0x7fcce007fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:07.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc8003720 0x7fccc8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:07.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccc80044d0 0x7fccc8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:07.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8004e40 0x7fccc800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:07.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00a3180 con 0x7fccc8003720 2020-11-20T13:56:07.010 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8004310 con 0x7fccc8004e40 2020-11-20T13:56:07.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc804fc70 con 0x7fccc80044d0 2020-11-20T13:56:07.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccded9d700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc8003720 0x7fccc8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:07.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccde59c700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccc80044d0 0x7fccc8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:07.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccdf59e700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8004e40 0x7fccc800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:07.011 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccded9d700 1 -- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccc80044d0 msgr2=0x7fccc8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:07.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccded9d700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccc80044d0 0x7fccc8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccded9d700 1 -- 172.21.15.31:0/1234196180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8004e40 msgr2=0x7fccc800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:07.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccded9d700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8004e40 0x7fccc800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccded9d700 1 -- 172.21.15.31:0/1234196180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8003230 con 0x7fccc8003720 2020-11-20T13:56:07.012 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccdf59e700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8004e40 0x7fccc800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccdf59e700 1 -- 172.21.15.31:0/1234196180 reap_dead start 2020-11-20T13:56:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.002+0000 7fccded9d700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc8003720 0x7fccc8003b40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fccc80054a0 tx=0x7fccd0007ad0).ready entity=mon.0 client_cookie=72e439467f495ff9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd000c680 con 0x7fccc8003720 2020-11-20T13:56:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd000c7e0 con 0x7fccc8003720 2020-11-20T13:56:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fccddd9b700 1 -- 172.21.15.31:0/1234196180 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd000cb40 con 0x7fccc8003720 2020-11-20T13:56:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fcce4e16700 1 -- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc8003720 msgr2=0x7fccc8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fcce4e16700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc8003720 0x7fccc8003b40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fccc80054a0 tx=0x7fccd0007ad0).stop 2020-11-20T13:56:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fcce4e16700 1 -- 172.21.15.31:0/1234196180 shutdown_connections 2020-11-20T13:56:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fcce4e16700 1 --2- 172.21.15.31:0/1234196180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc8003720 0x7fccc8003b40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fcce4e16700 1 -- 172.21.15.31:0/1234196180 >> 172.21.15.31:0/1234196180 conn(0x7fcce0061d50 msgr2=0x7fcce00ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fcce4e16700 1 -- 172.21.15.31:0/1234196180 shutdown_connections 2020-11-20T13:56:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.003+0000 7fcce4e16700 1 -- 172.21.15.31:0/1234196180 wait complete. 2020-11-20T13:56:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.004+0000 7fcce4e16700 1 Processor -- start 2020-11-20T13:56:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.004+0000 7fcce4e16700 1 -- start start 2020-11-20T13:56:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fcce4e16700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8003720 0x7fcce00a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fcce4e16700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcce0066ed0 0x7fcce00a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fcce4e16700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcce00a98d0 0x7fcce00a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fcce4e16700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00a1fa0 con 0x7fcce0066ed0 2020-11-20T13:56:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fcce4e16700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00aa270 con 0x7fccc8003720 2020-11-20T13:56:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fcce4e16700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce009f0d0 con 0x7fcce00a98d0 2020-11-20T13:56:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccde59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcce0066ed0 0x7fcce00a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:07.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccdf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcce00a98d0 0x7fcce00a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:07.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccde59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcce0066ed0 0x7fcce00a93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48298/0 (socket says 172.21.15.31:48298) 2020-11-20T13:56:07.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccde59c700 1 -- 172.21.15.31:0/3832208231 learned_addr learned my addr 172.21.15.31:0/3832208231 (peer_addr_for_me v2:172.21.15.31:0/0) 2020-11-20T13:56:07.020 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccdf59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcce00a98d0 0x7fcce00a9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36808/0 (socket says 172.21.15.31:36808) 2020-11-20T13:56:07.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccded9d700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8003720 0x7fcce00a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:07.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccde59c700 1 -- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcce00a98d0 msgr2=0x7fcce00a9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:07.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccde59c700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcce00a98d0 0x7fcce00a9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccde59c700 1 -- 172.21.15.31:0/3832208231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8003720 msgr2=0x7fcce00a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:07.021 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccde59c700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8003720 0x7fcce00a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccde59c700 1 -- 172.21.15.31:0/3832208231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce009d240 con 0x7fcce0066ed0 2020-11-20T13:56:07.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.005+0000 7fccdf59e700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcce00a98d0 0x7fcce00a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:07.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.006+0000 7fccde59c700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcce0066ed0 0x7fcce00a93e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fccd4006750 tx=0x7fccd4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:07.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.006+0000 7fcccf7fe700 1 -- 172.21.15.31:0/3832208231 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd400fa90 con 0x7fcce0066ed0 2020-11-20T13:56:07.022 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.006+0000 7fcccf7fe700 1 -- 172.21.15.31:0/3832208231 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd400fbf0 con 0x7fcce0066ed0 2020-11-20T13:56:07.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.006+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce009d4e0 con 0x7fcce0066ed0 2020-11-20T13:56:07.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.006+0000 7fcccf7fe700 1 -- 172.21.15.31:0/3832208231 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd400fd60 con 0x7fcce0066ed0 2020-11-20T13:56:07.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.006+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce009d980 con 0x7fcce0066ed0 2020-11-20T13:56:07.023 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.007+0000 7fcccf7fe700 1 -- 172.21.15.31:0/3832208231 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 3) v1 ==== 63226+0+0 (secure 0 0 0) 0x7fccd4024070 con 0x7fcce0066ed0 2020-11-20T13:56:07.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.007+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce00a27d0 con 0x7fcce0066ed0 2020-11-20T13:56:07.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.007+0000 7fcccf7fe700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccc40512e0 0x7fccc40537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:07.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.007+0000 7fcccf7fe700 1 -- 172.21.15.31:0/3832208231 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1959+0+0 (secure 0 0 0) 0x7fccd40686d0 con 0x7fcce0066ed0 2020-11-20T13:56:07.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.007+0000 7fccded9d700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccc40512e0 0x7fccc40537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:07.024 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.008+0000 7fccded9d700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccc40512e0 0x7fccc40537a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fccd0019000 tx=0x7fccd0017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:07.025 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.011+0000 7fcccf7fe700 1 -- 172.21.15.31:0/3832208231 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fccd4041ae0 con 0x7fcce0066ed0 2020-11-20T13:56:07.190 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.189+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2bf29e2c-70b0-44b6-8414-e8efcd0a43e4", "id": 7} v 0) v1 -- 0x7fcce009d670 con 0x7fcce0066ed0 2020-11-20T13:56:07.198 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.197+0000 7fcccf7fe700 1 -- 172.21.15.31:0/3832208231 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2bf29e2c-70b0-44b6-8414-e8efcd0a43e4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fccd4045100 con 0x7fcce0066ed0 2020-11-20T13:56:07.199 INFO:teuthology.orchestra.run.smithi031.stdout:7 2020-11-20T13:56:07.200 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccc40512e0 msgr2=0x7fccc40537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:07.200 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccc40512e0 0x7fccc40537a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fccd0019000 tx=0x7fccd0017000).stop 2020-11-20T13:56:07.201 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcce0066ed0 msgr2=0x7fcce00a93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:07.201 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcce0066ed0 0x7fcce00a93e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fccd4006750 tx=0x7fccd4008040).stop 2020-11-20T13:56:07.201 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 shutdown_connections 2020-11-20T13:56:07.201 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccc40512e0 0x7fccc40537a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.202 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccc8003720 0x7fcce00a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.202 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcce00a98d0 0x7fcce00a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.202 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 --2- 172.21.15.31:0/3832208231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcce0066ed0 0x7fcce00a93e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:07.202 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 >> 172.21.15.31:0/3832208231 conn(0x7fcce0061d50 msgr2=0x7fcce00a7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:07.202 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 shutdown_connections 2020-11-20T13:56:07.203 INFO:teuthology.orchestra.run.smithi031.stderr:2020-11-20T13:56:07.199+0000 7fcce4e16700 1 -- 172.21.15.31:0/3832208231 wait complete. 2020-11-20T13:56:07.211 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-20T13:56:07.211 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-20T13:56:07.214 INFO:tasks.ceph.osd.0:Started 2020-11-20T13:56:07.214 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-20T13:56:07.215 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-20T13:56:07.221 INFO:tasks.ceph.osd.1:Started 2020-11-20T13:56:07.221 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-20T13:56:07.222 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-20T13:56:07.224 INFO:tasks.ceph.osd.2:Started 2020-11-20T13:56:07.224 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-20T13:56:07.224 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-20T13:56:07.228 INFO:tasks.ceph.osd.3:Started 2020-11-20T13:56:07.229 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-20T13:56:07.229 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-20T13:56:07.234 INFO:tasks.ceph.osd.4:Started 2020-11-20T13:56:07.235 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-20T13:56:07.235 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-20T13:56:07.238 INFO:tasks.ceph.osd.5:Started 2020-11-20T13:56:07.238 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-20T13:56:07.238 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-20T13:56:07.241 INFO:tasks.ceph.osd.6:Started 2020-11-20T13:56:07.242 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-20T13:56:07.242 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-20T13:56:07.244 INFO:tasks.ceph.osd.7:Started 2020-11-20T13:56:07.245 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-20T13:56:07.320 INFO:tasks.ceph.osd.4.smithi031.stderr:2020-11-20T13:56:07.318+0000 7ff318ed9ec0 -1 Falling back to public interface 2020-11-20T13:56:07.325 INFO:tasks.ceph.osd.6.smithi031.stderr:2020-11-20T13:56:07.324+0000 7f2a58fb8ec0 -1 Falling back to public interface 2020-11-20T13:56:07.331 INFO:tasks.ceph.osd.0.smithi039.stderr:2020-11-20T13:56:07.331+0000 7f2df1e04ec0 -1 Falling back to public interface 2020-11-20T13:56:07.332 INFO:tasks.ceph.osd.4.smithi031.stderr:2020-11-20T13:56:07.331+0000 7ff318ed9ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:56:07.333 INFO:tasks.ceph.osd.4.smithi031.stderr:2020-11-20T13:56:07.331+0000 7ff318ed9ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.333 INFO:tasks.ceph.osd.4.smithi031.stderr:2020-11-20T13:56:07.331+0000 7ff318ed9ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.333 INFO:tasks.ceph.osd.2.smithi039.stderr:2020-11-20T13:56:07.332+0000 7fdbc719bec0 -1 Falling back to public interface 2020-11-20T13:56:07.337 INFO:tasks.ceph.osd.1.smithi039.stderr:2020-11-20T13:56:07.337+0000 7f96e8e7aec0 -1 Falling back to public interface 2020-11-20T13:56:07.338 INFO:tasks.ceph.osd.4.smithi031.stderr:2020-11-20T13:56:07.337+0000 7ff318ed9ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-11-20T13:56:07.340 INFO:tasks.ceph.osd.6.smithi031.stderr:2020-11-20T13:56:07.339+0000 7f2a58fb8ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:56:07.340 INFO:tasks.ceph.osd.6.smithi031.stderr:2020-11-20T13:56:07.339+0000 7f2a58fb8ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.340 INFO:tasks.ceph.osd.6.smithi031.stderr:2020-11-20T13:56:07.339+0000 7f2a58fb8ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.346 INFO:tasks.ceph.osd.6.smithi031.stderr:2020-11-20T13:56:07.345+0000 7f2a58fb8ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-11-20T13:56:07.348 INFO:tasks.ceph.osd.0.smithi039.stderr:2020-11-20T13:56:07.347+0000 7f2df1e04ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:56:07.348 INFO:tasks.ceph.osd.0.smithi039.stderr:2020-11-20T13:56:07.347+0000 7f2df1e04ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.348 INFO:tasks.ceph.osd.0.smithi039.stderr:2020-11-20T13:56:07.347+0000 7f2df1e04ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.349 INFO:tasks.ceph.osd.3.smithi039.stderr:2020-11-20T13:56:07.347+0000 7f63b0e20ec0 -1 Falling back to public interface 2020-11-20T13:56:07.350 INFO:tasks.ceph.osd.5.smithi031.stderr:2020-11-20T13:56:07.349+0000 7fb371449ec0 -1 Falling back to public interface 2020-11-20T13:56:07.351 INFO:tasks.ceph.osd.2.smithi039.stderr:2020-11-20T13:56:07.350+0000 7fdbc719bec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:56:07.351 INFO:tasks.ceph.osd.2.smithi039.stderr:2020-11-20T13:56:07.350+0000 7fdbc719bec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.351 INFO:tasks.ceph.osd.2.smithi039.stderr:2020-11-20T13:56:07.350+0000 7fdbc719bec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.354 INFO:tasks.ceph.osd.0.smithi039.stderr:2020-11-20T13:56:07.354+0000 7f2df1e04ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-11-20T13:56:07.357 INFO:tasks.ceph.osd.7.smithi031.stderr:2020-11-20T13:56:07.356+0000 7fb6ce775ec0 -1 Falling back to public interface 2020-11-20T13:56:07.358 INFO:tasks.ceph.osd.2.smithi039.stderr:2020-11-20T13:56:07.357+0000 7fdbc719bec0 -1 osd.2 0 log_to_monitors {default=true} 2020-11-20T13:56:07.359 INFO:tasks.ceph.osd.1.smithi039.stderr:2020-11-20T13:56:07.358+0000 7f96e8e7aec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:56:07.360 INFO:tasks.ceph.osd.1.smithi039.stderr:2020-11-20T13:56:07.359+0000 7f96e8e7aec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.360 INFO:tasks.ceph.osd.1.smithi039.stderr:2020-11-20T13:56:07.359+0000 7f96e8e7aec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.364 INFO:tasks.ceph.osd.1.smithi039.stderr:2020-11-20T13:56:07.364+0000 7f96e8e7aec0 -1 osd.1 0 log_to_monitors {default=true} 2020-11-20T13:56:07.366 INFO:tasks.ceph.osd.5.smithi031.stderr:2020-11-20T13:56:07.365+0000 7fb371449ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:56:07.366 INFO:tasks.ceph.osd.5.smithi031.stderr:2020-11-20T13:56:07.365+0000 7fb371449ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.366 INFO:tasks.ceph.osd.5.smithi031.stderr:2020-11-20T13:56:07.365+0000 7fb371449ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.368 INFO:tasks.ceph.osd.3.smithi039.stderr:2020-11-20T13:56:07.368+0000 7f63b0e20ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:56:07.368 INFO:tasks.ceph.osd.3.smithi039.stderr:2020-11-20T13:56:07.368+0000 7f63b0e20ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.369 INFO:tasks.ceph.osd.3.smithi039.stderr:2020-11-20T13:56:07.368+0000 7f63b0e20ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.371 INFO:tasks.ceph.osd.5.smithi031.stderr:2020-11-20T13:56:07.370+0000 7fb371449ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-11-20T13:56:07.373 INFO:tasks.ceph.osd.7.smithi031.stderr:2020-11-20T13:56:07.372+0000 7fb6ce775ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T13:56:07.373 INFO:tasks.ceph.osd.7.smithi031.stderr:2020-11-20T13:56:07.372+0000 7fb6ce775ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.374 INFO:tasks.ceph.osd.7.smithi031.stderr:2020-11-20T13:56:07.372+0000 7fb6ce775ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T13:56:07.374 INFO:tasks.ceph.osd.3.smithi039.stderr:2020-11-20T13:56:07.373+0000 7f63b0e20ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-11-20T13:56:07.378 INFO:tasks.ceph.osd.7.smithi031.stderr:2020-11-20T13:56:07.378+0000 7fb6ce775ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-11-20T13:56:08.053 INFO:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T13:56:08.164 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.159+0000 7f5561d63700 1 Processor -- start 2020-11-20T13:56:08.164 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.159+0000 7f5561d63700 1 -- start start 2020-11-20T13:56:08.165 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.159+0000 7f5561d63700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c0a4740 0x7f555c07f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:08.165 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.159+0000 7f5561d63700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c0a5b50 con 0x7f555c0a7bd0 2020-11-20T13:56:08.165 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.159+0000 7f5561d63700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c0a4b20 con 0x7f555c05cad0 2020-11-20T13:56:08.165 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.159+0000 7f5561d63700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0a30b0 con 0x7f555c0a4740 2020-11-20T13:56:08.166 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.159+0000 7f5560b01700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f555c05cad0 0x7f555c150e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34880/0 (socket says 172.21.15.39:34880) 2020-11-20T13:56:08.166 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.159+0000 7f5560b01700 1 -- 172.21.15.39:0/2323768567 learned_addr learned my addr 172.21.15.39:0/2323768567 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:08.166 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555bfff700 1 --2- 172.21.15.39:0/2323768567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c0a4740 0x7f555c07f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:08.166 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555b7fe700 1 -- 172.21.15.39:0/2323768567 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193068356 0 0) 0x7f555c0a4b20 con 0x7f555c05cad0 2020-11-20T13:56:08.166 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555b7fe700 1 -- 172.21.15.39:0/2323768567 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5548003230 con 0x7f555c05cad0 2020-11-20T13:56:08.167 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555b7fe700 1 -- 172.21.15.39:0/2323768567 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808116500 0 0) 0x7f55440010d0 con 0x7f555c0a7bd0 2020-11-20T13:56:08.167 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555bfff700 1 -- 172.21.15.39:0/2323768567 >> v1:172.21.15.39:6789/0 conn(0x7f555c05cad0 legacy=0x7f555c150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:08.167 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555bfff700 1 -- 172.21.15.39:0/2323768567 >> v1:172.21.15.31:6789/0 conn(0x7f555c0a7bd0 legacy=0x7f555c07fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:08.167 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555bfff700 1 -- 172.21.15.39:0/2323768567 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c0a3c80 con 0x7f555c0a4740 2020-11-20T13:56:08.167 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555bfff700 1 --2- 172.21.15.39:0/2323768567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c0a4740 0x7f555c07f6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f554c002f30 tx=0x7f554c006dc0).ready entity=mon.2 client_cookie=7a47cbf3162012ea server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:08.168 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555b7fe700 1 -- 172.21.15.39:0/2323768567 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f554c0097b0 con 0x7f555c0a4740 2020-11-20T13:56:08.168 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555b7fe700 1 -- 172.21.15.39:0/2323768567 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c009910 con 0x7f555c0a4740 2020-11-20T13:56:08.168 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f555b7fe700 1 -- 172.21.15.39:0/2323768567 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f554c009c70 con 0x7f555c0a4740 2020-11-20T13:56:08.168 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f5561d63700 1 -- 172.21.15.39:0/2323768567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c0a4740 msgr2=0x7f555c07f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:08.168 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.160+0000 7f5561d63700 1 --2- 172.21.15.39:0/2323768567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c0a4740 0x7f555c07f6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f554c002f30 tx=0x7f554c006dc0).stop 2020-11-20T13:56:08.169 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.161+0000 7f5561d63700 1 -- 172.21.15.39:0/2323768567 shutdown_connections 2020-11-20T13:56:08.169 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.161+0000 7f5561d63700 1 --2- 172.21.15.39:0/2323768567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c0a4740 0x7f555c07f6c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:08.169 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.161+0000 7f5561d63700 1 -- 172.21.15.39:0/2323768567 >> 172.21.15.39:0/2323768567 conn(0x7f555c0ab6f0 msgr2=0x7f555c0abb00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:08.169 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.161+0000 7f5561d63700 1 -- 172.21.15.39:0/2323768567 shutdown_connections 2020-11-20T13:56:08.169 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.161+0000 7f5561d63700 1 -- 172.21.15.39:0/2323768567 wait complete. 2020-11-20T13:56:08.170 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.162+0000 7f5561d63700 1 Processor -- start 2020-11-20T13:56:08.170 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.162+0000 7f5561d63700 1 -- start start 2020-11-20T13:56:08.170 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.162+0000 7f5561d63700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c05cad0 0x7f555c1244c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:08.170 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.162+0000 7f5561d63700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f555c0a4740 0x7f555c07eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:08.170 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.162+0000 7f5561d63700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0a7bd0 0x7f555c07f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:08.170 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.162+0000 7f5561d63700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c07f550 con 0x7f555c0a7bd0 2020-11-20T13:56:08.171 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.162+0000 7f5561d63700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c124100 con 0x7f555c0a4740 2020-11-20T13:56:08.171 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.162+0000 7f5561d63700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c1230e0 con 0x7f555c05cad0 2020-11-20T13:56:08.172 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5553fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f555c0a4740 0x7f555c07eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:08.172 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5553fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f555c0a4740 0x7f555c07eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44714/0 (socket says 172.21.15.39:44714) 2020-11-20T13:56:08.172 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5553fff700 1 -- 172.21.15.39:0/3190062064 learned_addr learned my addr 172.21.15.39:0/3190062064 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:08.173 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f555bfff700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c05cad0 0x7f555c1244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:08.173 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5560b01700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0a7bd0 0x7f555c07f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:08.173 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5553fff700 1 -- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c05cad0 msgr2=0x7f555c1244c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:08.173 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5553fff700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c05cad0 0x7f555c1244c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:08.174 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5553fff700 1 -- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0a7bd0 msgr2=0x7f555c07f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:08.174 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5553fff700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0a7bd0 0x7f555c07f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:08.174 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5553fff700 1 -- 172.21.15.39:0/3190062064 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c122e40 con 0x7f555c0a4740 2020-11-20T13:56:08.174 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5560b01700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0a7bd0 0x7f555c07f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:08.175 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5553fff700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f555c0a4740 0x7f555c07eb70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5544000e90 tx=0x7f5544001800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:08.175 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f55597fa700 1 -- 172.21.15.39:0/3190062064 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5544010510 con 0x7f555c0a4740 2020-11-20T13:56:08.175 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f55597fa700 1 -- 172.21.15.39:0/3190062064 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544010670 con 0x7f555c0a4740 2020-11-20T13:56:08.175 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c0a6c40 con 0x7f555c0a4740 2020-11-20T13:56:08.175 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f55597fa700 1 -- 172.21.15.39:0/3190062064 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55440107e0 con 0x7f555c0a4740 2020-11-20T13:56:08.176 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.163+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c0678b0 con 0x7f555c0a4740 2020-11-20T13:56:08.177 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.164+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c057050 con 0x7f555c0a4740 2020-11-20T13:56:08.177 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.165+0000 7f55597fa700 1 -- 172.21.15.39:0/3190062064 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f5544010070 con 0x7f555c0a4740 2020-11-20T13:56:08.177 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.165+0000 7f55597fa700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5540051260 0x7f5540053720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:08.177 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.165+0000 7f55597fa700 1 -- 172.21.15.39:0/3190062064 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2074+0+0 (secure 0 0 0) 0x7f55440674e0 con 0x7f555c0a4740 2020-11-20T13:56:08.178 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.165+0000 7f555bfff700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5540051260 0x7f5540053720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:08.178 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.165+0000 7f555bfff700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5540051260 0x7f5540053720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f554c018000 tx=0x7f554c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:08.178 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.169+0000 7f55597fa700 1 -- 172.21.15.39:0/3190062064 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f5544040840 con 0x7f555c0a4740 2020-11-20T13:56:08.330 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.329+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f555c0a5b50 con 0x7f555c0a4740 2020-11-20T13:56:08.331 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.330+0000 7f55597fa700 1 -- 172.21.15.39:0/3190062064 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8274 (secure 0 0 0) 0x7f555c0a5b50 con 0x7f555c0a4740 2020-11-20T13:56:08.331 INFO:teuthology.misc.health.smithi039.stdout: 2020-11-20T13:56:08.331 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":11,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:08.194833+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"5","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:08.332 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5540051260 msgr2=0x7f5540053720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:08.333 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5540051260 0x7f5540053720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f554c018000 tx=0x7f554c015000).stop 2020-11-20T13:56:08.333 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f555c0a4740 msgr2=0x7f555c07eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:08.333 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f555c0a4740 0x7f555c07eb70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5544000e90 tx=0x7f5544001800).stop 2020-11-20T13:56:08.333 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 shutdown_connections 2020-11-20T13:56:08.334 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5540051260 0x7f5540053720 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:08.334 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0a7bd0 0x7f555c07f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:08.334 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c05cad0 0x7f555c1244c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:08.334 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 --2- 172.21.15.39:0/3190062064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f555c0a4740 0x7f555c07eb70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:08.334 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 >> 172.21.15.39:0/3190062064 conn(0x7f555c0ab6f0 msgr2=0x7f555c0aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:08.335 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 shutdown_connections 2020-11-20T13:56:08.335 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:08.331+0000 7f5561d63700 1 -- 172.21.15.39:0/3190062064 wait complete. 2020-11-20T13:56:08.342 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-11-20T13:56:09.206 INFO:tasks.ceph.osd.1.smithi039.stderr:2020-11-20T13:56:09.205+0000 7f96cb9d0700 -1 osd.1 0 waiting for initial osdmap 2020-11-20T13:56:09.212 INFO:tasks.ceph.osd.3.smithi039.stderr:2020-11-20T13:56:09.211+0000 7f6393976700 -1 osd.3 0 waiting for initial osdmap 2020-11-20T13:56:09.212 INFO:tasks.ceph.osd.5.smithi031.stderr:2020-11-20T13:56:09.211+0000 7fb353f9f700 -1 osd.5 0 waiting for initial osdmap 2020-11-20T13:56:09.213 INFO:tasks.ceph.osd.2.smithi039.stderr:2020-11-20T13:56:09.212+0000 7fdba9cf1700 -1 osd.2 0 waiting for initial osdmap 2020-11-20T13:56:09.214 INFO:tasks.ceph.osd.0.smithi039.stderr:2020-11-20T13:56:09.212+0000 7f2dd495a700 -1 osd.0 0 waiting for initial osdmap 2020-11-20T13:56:09.214 INFO:tasks.ceph.osd.4.smithi031.stderr:2020-11-20T13:56:09.212+0000 7ff2fba2f700 -1 osd.4 0 waiting for initial osdmap 2020-11-20T13:56:09.214 INFO:tasks.ceph.osd.6.smithi031.stderr:2020-11-20T13:56:09.212+0000 7f2a3bb0e700 -1 osd.6 0 waiting for initial osdmap 2020-11-20T13:56:09.214 INFO:tasks.ceph.osd.7.smithi031.stderr:2020-11-20T13:56:09.212+0000 7fb6b12cb700 -1 osd.7 0 waiting for initial osdmap 2020-11-20T13:56:15.153 INFO:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T13:56:15.267 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.264+0000 7f1069e5a700 1 Processor -- start 2020-11-20T13:56:15.268 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.264+0000 7f1069e5a700 1 -- start start 2020-11-20T13:56:15.268 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.264+0000 7f1069e5a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f106407fdd0 0x7f1064151e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.268 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.264+0000 7f1069e5a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10640a5b50 con 0x7f10640a4740 2020-11-20T13:56:15.268 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.264+0000 7f1069e5a700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10640a4b20 con 0x7f10640a7bd0 2020-11-20T13:56:15.268 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.264+0000 7f1069e5a700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10640a30b0 con 0x7f106407fdd0 2020-11-20T13:56:15.269 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f1068bf8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f106407fdd0 0x7f1064151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.269 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f105bfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f10640a7bd0 0x7f106405cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35082/0 (socket says 172.21.15.39:35082) 2020-11-20T13:56:15.269 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f105bfff700 1 -- 172.21.15.39:0/1764298899 learned_addr learned my addr 172.21.15.39:0/1764298899 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:15.269 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f1068bf8700 1 -- 172.21.15.39:0/1764298899 >> v1:172.21.15.39:6789/0 conn(0x7f10640a7bd0 legacy=0x7f106405cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.269 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f1068bf8700 1 -- 172.21.15.39:0/1764298899 >> v1:172.21.15.31:6789/0 conn(0x7f10640a4740 legacy=0x7f106407f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.270 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f10637fe700 1 -- 172.21.15.39:0/1764298899 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254488875 0 0) 0x7f10640a4b20 con 0x7f10640a7bd0 2020-11-20T13:56:15.270 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f1068bf8700 1 -- 172.21.15.39:0/1764298899 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10640a3c80 con 0x7f106407fdd0 2020-11-20T13:56:15.270 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f1068bf8700 1 --2- 172.21.15.39:0/1764298899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 0x7f1064151e70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f105c0032b0 tx=0x7f105c0091a0).ready entity=mon.1 client_cookie=eab4712c2e15fd9a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:15.270 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f10637fe700 1 -- 172.21.15.39:0/1764298899 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f105c00ba50 con 0x7f106407fdd0 2020-11-20T13:56:15.270 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f10637fe700 1 -- 172.21.15.39:0/1764298899 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c00bbb0 con 0x7f106407fdd0 2020-11-20T13:56:15.271 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f10637fe700 1 -- 172.21.15.39:0/1764298899 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f105c00bd20 con 0x7f106407fdd0 2020-11-20T13:56:15.271 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f1069e5a700 1 -- 172.21.15.39:0/1764298899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 msgr2=0x7f1064151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.271 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.265+0000 7f1069e5a700 1 --2- 172.21.15.39:0/1764298899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 0x7f1064151e70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f105c0032b0 tx=0x7f105c0091a0).stop 2020-11-20T13:56:15.271 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.266+0000 7f1069e5a700 1 -- 172.21.15.39:0/1764298899 shutdown_connections 2020-11-20T13:56:15.271 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.266+0000 7f1069e5a700 1 --2- 172.21.15.39:0/1764298899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 0x7f1064151e70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.272 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.266+0000 7f1069e5a700 1 -- 172.21.15.39:0/1764298899 >> 172.21.15.39:0/1764298899 conn(0x7f10640ab6f0 msgr2=0x7f10640abb00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:15.272 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.266+0000 7f1069e5a700 1 -- 172.21.15.39:0/1764298899 shutdown_connections 2020-11-20T13:56:15.272 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.266+0000 7f1069e5a700 1 -- 172.21.15.39:0/1764298899 wait complete. 2020-11-20T13:56:15.275 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.267+0000 7f1069e5a700 1 Processor -- start 2020-11-20T13:56:15.275 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.267+0000 7f1069e5a700 1 -- start start 2020-11-20T13:56:15.275 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1069e5a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 0x7f10640a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.275 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1069e5a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10640a4740 0x7f106407ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.276 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1069e5a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10640a7bd0 0x7f106407ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.276 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1069e5a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10640a6cf0 con 0x7f10640a4740 2020-11-20T13:56:15.276 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1069e5a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10640a04e0 con 0x7f106407fdd0 2020-11-20T13:56:15.276 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1069e5a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106409fb90 con 0x7f10640a7bd0 2020-11-20T13:56:15.276 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1063fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 0x7f10640a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.277 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1063fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 0x7f10640a09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44916/0 (socket says 172.21.15.39:44916) 2020-11-20T13:56:15.277 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1063fff700 1 -- 172.21.15.39:0/3846701674 learned_addr learned my addr 172.21.15.39:0/3846701674 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:15.277 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f105bfff700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10640a4740 0x7f106407ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.278 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1068bf8700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10640a7bd0 0x7f106407ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.278 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1063fff700 1 -- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10640a7bd0 msgr2=0x7f106407ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.278 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1063fff700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10640a7bd0 0x7f106407ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.279 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1063fff700 1 -- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10640a4740 msgr2=0x7f106407ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.279 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1063fff700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10640a4740 0x7f106407ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.279 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1063fff700 1 -- 172.21.15.39:0/3846701674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10641281d0 con 0x7f106407fdd0 2020-11-20T13:56:15.279 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f105bfff700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10640a4740 0x7f106407ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:15.280 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1063fff700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 0x7f10640a09e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1064068620 tx=0x7f1054007b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:15.280 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f10617fa700 1 -- 172.21.15.39:0/3846701674 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1054007030 con 0x7f106407fdd0 2020-11-20T13:56:15.280 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f10617fa700 1 -- 172.21.15.39:0/3846701674 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1054007190 con 0x7f106407fdd0 2020-11-20T13:56:15.280 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.268+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10640a0240 con 0x7f106407fdd0 2020-11-20T13:56:15.281 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.269+0000 7f10617fa700 1 -- 172.21.15.39:0/3846701674 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10540064e0 con 0x7f106407fdd0 2020-11-20T13:56:15.281 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.269+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106407f470 con 0x7f106407fdd0 2020-11-20T13:56:15.281 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.269+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10640a0720 con 0x7f106407fdd0 2020-11-20T13:56:15.281 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.270+0000 7f10617fa700 1 -- 172.21.15.39:0/3846701674 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f1054010070 con 0x7f106407fdd0 2020-11-20T13:56:15.281 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.270+0000 7f10617fa700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f1048051260 0x7f1048053720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.282 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.270+0000 7f10617fa700 1 -- 172.21.15.39:0/3846701674 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f1054068140 con 0x7f106407fdd0 2020-11-20T13:56:15.282 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.270+0000 7f105bfff700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f1048051260 0x7f1048053720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.282 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.270+0000 7f105bfff700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f1048051260 0x7f1048053720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f104c008000 tx=0x7f104c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:15.282 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.273+0000 7f10617fa700 1 -- 172.21.15.39:0/3846701674 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f10640a0720 con 0x7f106407fdd0 2020-11-20T13:56:15.434 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.434+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f106409fa00 con 0x7f106407fdd0 2020-11-20T13:56:15.435 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.435+0000 7f10617fa700 1 -- 172.21.15.39:0/3846701674 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11805 (secure 0 0 0) 0x7f10540443c0 con 0x7f106407fdd0 2020-11-20T13:56:15.436 INFO:teuthology.misc.health.smithi039.stdout: 2020-11-20T13:56:15.436 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":15,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:12.270280+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:15.437 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f1048051260 msgr2=0x7f1048053720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.437 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f1048051260 0x7f1048053720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f104c008000 tx=0x7f104c009040).stop 2020-11-20T13:56:15.438 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 msgr2=0x7f10640a09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.438 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 0x7f10640a09e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1064068620 tx=0x7f1054007b50).stop 2020-11-20T13:56:15.438 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 shutdown_connections 2020-11-20T13:56:15.438 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f1048051260 0x7f1048053720 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.439 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f106407fdd0 0x7f10640a09e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.439 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10640a7bd0 0x7f106407ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.439 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 --2- 172.21.15.39:0/3846701674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10640a4740 0x7f106407ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.439 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 >> 172.21.15.39:0/3846701674 conn(0x7f10640ab6f0 msgr2=0x7f10640aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:15.439 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 shutdown_connections 2020-11-20T13:56:15.440 INFO:teuthology.misc.health.smithi039.stderr:2020-11-20T13:56:15.436+0000 7f1069e5a700 1 -- 172.21.15.39:0/3846701674 wait complete. 2020-11-20T13:56:15.446 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-11-20T13:56:15.447 INFO:tasks.ceph:Creating RBD pool 2020-11-20T13:56:15.447 INFO:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-20T13:56:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.559+0000 7f44bce41700 1 Processor -- start 2020-11-20T13:56:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.559+0000 7f44bce41700 1 -- start start 2020-11-20T13:56:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.560+0000 7f44bce41700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f44b80a7170 0x7f44b807f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.560+0000 7f44bce41700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80a5420 con 0x7f44b80a7600 2020-11-20T13:56:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.560+0000 7f44bce41700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80a4ce0 con 0x7f44b80abf70 2020-11-20T13:56:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.560+0000 7f44bce41700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80a3180 con 0x7f44b80a7170 2020-11-20T13:56:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.560+0000 7f44b659c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f44b80a7170 0x7f44b807f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.560+0000 7f44b6d9d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f44b80abf70 0x7f44b80a4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35096/0 (socket says 172.21.15.39:35096) 2020-11-20T13:56:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.560+0000 7f44b6d9d700 1 -- 172.21.15.39:0/1028538218 learned_addr learned my addr 172.21.15.39:0/1028538218 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44b659c700 1 -- 172.21.15.39:0/1028538218 >> v1:172.21.15.39:6789/0 conn(0x7f44b80abf70 legacy=0x7f44b80a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.566 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44b659c700 1 -- 172.21.15.39:0/1028538218 >> v1:172.21.15.31:6789/0 conn(0x7f44b80a7600 legacy=0x7f44b807fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.566 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44b5d9b700 1 -- 172.21.15.39:0/1028538218 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182262481 0 0) 0x7f44b80a4ce0 con 0x7f44b80abf70 2020-11-20T13:56:15.566 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44b659c700 1 -- 172.21.15.39:0/1028538218 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80a4f80 con 0x7f44b80a7170 2020-11-20T13:56:15.566 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44b659c700 1 --2- 172.21.15.39:0/1028538218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 0x7f44b807f6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f44ac002f30 tx=0x7f44ac006dc0).ready entity=mon.1 client_cookie=419ca0831d6ab8c4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:15.566 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44b5d9b700 1 -- 172.21.15.39:0/1028538218 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ac0097f0 con 0x7f44b80a7170 2020-11-20T13:56:15.567 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44b5d9b700 1 -- 172.21.15.39:0/1028538218 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac009950 con 0x7f44b80a7170 2020-11-20T13:56:15.567 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44b5d9b700 1 -- 172.21.15.39:0/1028538218 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ac009cb0 con 0x7f44b80a7170 2020-11-20T13:56:15.567 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44bce41700 1 -- 172.21.15.39:0/1028538218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 msgr2=0x7f44b807f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.567 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.561+0000 7f44bce41700 1 --2- 172.21.15.39:0/1028538218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 0x7f44b807f6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f44ac002f30 tx=0x7f44ac006dc0).stop 2020-11-20T13:56:15.567 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.562+0000 7f44bce41700 1 -- 172.21.15.39:0/1028538218 shutdown_connections 2020-11-20T13:56:15.568 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.562+0000 7f44bce41700 1 --2- 172.21.15.39:0/1028538218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 0x7f44b807f6c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.569 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.562+0000 7f44bce41700 1 -- 172.21.15.39:0/1028538218 >> 172.21.15.39:0/1028538218 conn(0x7f44b8061d50 msgr2=0x7f44b80ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:15.569 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.562+0000 7f44bce41700 1 -- 172.21.15.39:0/1028538218 shutdown_connections 2020-11-20T13:56:15.569 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.562+0000 7f44bce41700 1 -- 172.21.15.39:0/1028538218 wait complete. 2020-11-20T13:56:15.569 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44bce41700 1 Processor -- start 2020-11-20T13:56:15.570 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44bce41700 1 -- start start 2020-11-20T13:56:15.574 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44bce41700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 0x7f44b81351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.574 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44bce41700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b80a7600 0x7f44b808f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.574 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44bce41700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80abf70 0x7f44b8066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.575 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44bce41700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8066fb0 con 0x7f44b80abf70 2020-11-20T13:56:15.575 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44bce41700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80907a0 con 0x7f44b80a7170 2020-11-20T13:56:15.575 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44bce41700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8066670 con 0x7f44b80a7600 2020-11-20T13:56:15.575 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44b6d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 0x7f44b81351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.575 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44b6d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 0x7f44b81351e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44928/0 (socket says 172.21.15.39:44928) 2020-11-20T13:56:15.576 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44b6d9d700 1 -- 172.21.15.39:0/2818697003 learned_addr learned my addr 172.21.15.39:0/2818697003 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:15.576 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44b659c700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b80a7600 0x7f44b808f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.576 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.563+0000 7f44b759e700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80abf70 0x7f44b8066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.576 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44b6d9d700 1 -- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b80a7600 msgr2=0x7f44b808f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.576 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44b6d9d700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b80a7600 0x7f44b808f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.577 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44b6d9d700 1 -- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80abf70 msgr2=0x7f44b8066ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:15.577 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44b6d9d700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80abf70 0x7f44b8066ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:15.577 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44b6d9d700 1 -- 172.21.15.39:0/2818697003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80674c0 con 0x7f44b80a7170 2020-11-20T13:56:15.577 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44b6d9d700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 0x7f44b81351e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f44b8090b90 tx=0x7f44a80079b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:15.577 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44a77fe700 1 -- 172.21.15.39:0/2818697003 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44a80072e0 con 0x7f44b80a7170 2020-11-20T13:56:15.578 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b8091260 con 0x7f44b80a7170 2020-11-20T13:56:15.586 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b80a5f90 con 0x7f44b80a7170 2020-11-20T13:56:15.586 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44a77fe700 1 -- 172.21.15.39:0/2818697003 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8007440 con 0x7f44b80a7170 2020-11-20T13:56:15.586 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.564+0000 7f44a77fe700 1 -- 172.21.15.39:0/2818697003 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44a8005560 con 0x7f44b80a7170 2020-11-20T13:56:15.587 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.565+0000 7f44a77fe700 1 -- 172.21.15.39:0/2818697003 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f44a8010070 con 0x7f44b80a7170 2020-11-20T13:56:15.587 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.565+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b8057050 con 0x7f44b80a7170 2020-11-20T13:56:15.587 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.565+0000 7f44a77fe700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f449c0511d0 0x7f449c053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:15.587 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.565+0000 7f44a77fe700 1 -- 172.21.15.39:0/2818697003 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f44a8067f90 con 0x7f44b80a7170 2020-11-20T13:56:15.587 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.565+0000 7f44b659c700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f449c0511d0 0x7f449c053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:15.588 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.566+0000 7f44b659c700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f449c0511d0 0x7f449c053690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f44ac01b000 tx=0x7f44ac015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:15.588 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.569+0000 7f44a77fe700 1 -- 172.21.15.39:0/2818697003 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f44a80406e0 con 0x7f44b80a7170 2020-11-20T13:56:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:15.730+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f44b80a7cf0 con 0x7f44b80a7170 2020-11-20T13:56:16.292 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.288+0000 7f44a77fe700 1 -- 172.21.15.39:0/2818697003 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f44a8043d00 con 0x7f44b80a7170 2020-11-20T13:56:16.292 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f449c0511d0 msgr2=0x7f449c053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:16.292 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f449c0511d0 0x7f449c053690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f44ac01b000 tx=0x7f44ac015000).stop 2020-11-20T13:56:16.293 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 msgr2=0x7f44b81351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:16.293 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 0x7f44b81351e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f44b8090b90 tx=0x7f44a80079b0).stop 2020-11-20T13:56:16.293 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 shutdown_connections 2020-11-20T13:56:16.293 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f449c0511d0 0x7f449c053690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:16.294 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b80a7170 0x7f44b81351e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:16.294 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44b80abf70 0x7f44b8066ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:16.294 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 --2- 172.21.15.39:0/2818697003 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f44b80a7600 0x7f44b808f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:16.294 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 >> 172.21.15.39:0/2818697003 conn(0x7f44b8061d50 msgr2=0x7f44b80a1820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:16.294 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 shutdown_connections 2020-11-20T13:56:16.295 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.291+0000 7f44bce41700 1 -- 172.21.15.39:0/2818697003 wait complete. 2020-11-20T13:56:16.295 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'rbd' created 2020-11-20T13:56:16.305 INFO:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-20T13:56:16.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.423+0000 7f14fd64d700 1 Processor -- start 2020-11-20T13:56:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.423+0000 7f14fd64d700 1 -- start start 2020-11-20T13:56:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.423+0000 7f14fd64d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14f80a28c0 0x7f14f8149c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.423+0000 7f14fd64d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a6f50 0x7f14f814a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.423+0000 7f14fd64d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f80a3a20 con 0x7f14f80a8590 2020-11-20T13:56:16.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.423+0000 7f14fd64d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f80a4240 con 0x7f14f80a28c0 2020-11-20T13:56:16.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.423+0000 7f14fd64d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f80a44e0 con 0x7f14f80a6f50 2020-11-20T13:56:16.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a6f50 0x7f14f814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:16.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a6f50 0x7f14f814a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.39:55398/0 (socket says 172.21.15.39:55398) 2020-11-20T13:56:16.429 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f7fff700 1 -- 172.21.15.39:0/2076988218 learned_addr learned my addr 172.21.15.39:0/2076988218 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:16.429 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f6ffd700 1 --2- 172.21.15.39:0/2076988218 >> v2:172.21.15.31:3300/0 conn(0x7f14f80a28c0 0x7f14f8149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:16.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f7fff700 1 -- 172.21.15.39:0/2076988218 >> v2:172.21.15.31:3300/0 conn(0x7f14f80a28c0 msgr2=0x7f14f8149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:16.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f7fff700 1 --2- 172.21.15.39:0/2076988218 >> v2:172.21.15.31:3300/0 conn(0x7f14f80a28c0 0x7f14f8149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:16.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f7fff700 1 -- 172.21.15.39:0/2076988218 >> v1:172.21.15.31:6789/0 conn(0x7f14f80a8590 legacy=0x7f14f80a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:16.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f7fff700 1 -- 172.21.15.39:0/2076988218 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f80a8970 con 0x7f14f80a6f50 2020-11-20T13:56:16.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f7fff700 1 --2- 172.21.15.39:0/2076988218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a6f50 0x7f14f814a170 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f14f00032b0 tx=0x7f14f0009270).ready entity=mon.2 client_cookie=59c0d1939cfcb372 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:16.432 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f67fc700 1 -- 172.21.15.39:0/2076988218 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f0009e60 con 0x7f14f80a6f50 2020-11-20T13:56:16.432 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f67fc700 1 -- 172.21.15.39:0/2076988218 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f000bc00 con 0x7f14f80a6f50 2020-11-20T13:56:16.432 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14f67fc700 1 -- 172.21.15.39:0/2076988218 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14f000bd70 con 0x7f14f80a6f50 2020-11-20T13:56:16.433 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.424+0000 7f14fd64d700 1 -- 172.21.15.39:0/2076988218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a6f50 msgr2=0x7f14f814a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:16.433 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.425+0000 7f14fd64d700 1 --2- 172.21.15.39:0/2076988218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a6f50 0x7f14f814a170 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f14f00032b0 tx=0x7f14f0009270).stop 2020-11-20T13:56:16.433 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.425+0000 7f14fd64d700 1 -- 172.21.15.39:0/2076988218 shutdown_connections 2020-11-20T13:56:16.433 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.425+0000 7f14fd64d700 1 --2- 172.21.15.39:0/2076988218 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a6f50 0x7f14f814a170 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:16.434 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.425+0000 7f14fd64d700 1 --2- 172.21.15.39:0/2076988218 >> v2:172.21.15.31:3300/0 conn(0x7f14f80a28c0 0x7f14f8149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:16.434 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.425+0000 7f14fd64d700 1 -- 172.21.15.39:0/2076988218 >> 172.21.15.39:0/2076988218 conn(0x7f14f805f740 msgr2=0x7f14f8061d50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:16.434 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.425+0000 7f14fd64d700 1 -- 172.21.15.39:0/2076988218 shutdown_connections 2020-11-20T13:56:16.434 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.425+0000 7f14fd64d700 1 -- 172.21.15.39:0/2076988218 wait complete. 2020-11-20T13:56:16.438 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.426+0000 7f14fd64d700 1 Processor -- start 2020-11-20T13:56:16.438 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.426+0000 7f14fd64d700 1 -- start start 2020-11-20T13:56:16.439 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14fd64d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f80a28c0 0x7f14f80a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14fd64d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14f80a6f50 0x7f14f8133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14fd64d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a8590 0x7f14f81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14fd64d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f81383d0 con 0x7f14f80a28c0 2020-11-20T13:56:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14fd64d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f80a0800 con 0x7f14f80a6f50 2020-11-20T13:56:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14fd64d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f81379f0 con 0x7f14f80a8590 2020-11-20T13:56:16.441 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14f80a6f50 0x7f14f8133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:16.441 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14f80a6f50 0x7f14f8133ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44946/0 (socket says 172.21.15.39:44946) 2020-11-20T13:56:16.441 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f6ffd700 1 -- 172.21.15.39:0/2316497927 learned_addr learned my addr 172.21.15.39:0/2316497927 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:16.441 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f7fff700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a8590 0x7f14f81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:16.442 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f77fe700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f80a28c0 0x7f14f80a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:16.442 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f6ffd700 1 -- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a8590 msgr2=0x7f14f81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:16.442 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f6ffd700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a8590 0x7f14f81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:16.442 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f6ffd700 1 -- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f80a28c0 msgr2=0x7f14f80a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:16.442 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f6ffd700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f80a28c0 0x7f14f80a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:16.443 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.427+0000 7f14f6ffd700 1 -- 172.21.15.39:0/2316497927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8137c90 con 0x7f14f80a6f50 2020-11-20T13:56:16.443 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.428+0000 7f14f6ffd700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14f80a6f50 0x7f14f8133ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f14f81242f0 tx=0x7f14ec006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:16.443 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.428+0000 7f14dffff700 1 -- 172.21.15.39:0/2316497927 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14ec00ca10 con 0x7f14f80a6f50 2020-11-20T13:56:16.443 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.428+0000 7f14dffff700 1 -- 172.21.15.39:0/2316497927 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec00cb70 con 0x7f14f80a6f50 2020-11-20T13:56:16.443 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.428+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f8137f90 con 0x7f14f80a6f50 2020-11-20T13:56:16.443 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.428+0000 7f14dffff700 1 -- 172.21.15.39:0/2316497927 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14ec00eeb0 con 0x7f14f80a6f50 2020-11-20T13:56:16.444 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.428+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f81374b0 con 0x7f14f80a6f50 2020-11-20T13:56:16.444 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.429+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f8057050 con 0x7f14f80a6f50 2020-11-20T13:56:16.444 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.429+0000 7f14dffff700 1 -- 172.21.15.39:0/2316497927 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f14ec01c460 con 0x7f14f80a6f50 2020-11-20T13:56:16.444 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.429+0000 7f14dffff700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f14d8051310 0x7f14d80537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:16.444 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.429+0000 7f14dffff700 1 -- 172.21.15.39:0/2316497927 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f14ec068ef0 con 0x7f14f80a6f50 2020-11-20T13:56:16.446 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.429+0000 7f14f77fe700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f14d8051310 0x7f14d80537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:16.446 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.430+0000 7f14f77fe700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f14d8051310 0x7f14d80537d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f14e800d000 tx=0x7f14e8007ad0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.433+0000 7f14dffff700 1 -- 172.21.15.39:0/2316497927 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f14ec041590 con 0x7f14f80a6f50 2020-11-20T13:56:16.601 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:16.599+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f14f809c520 con 0x7f14f80a6f50 2020-11-20T13:56:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.300+0000 7f14dffff700 1 -- 172.21.15.39:0/2316497927 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f14f809c520 con 0x7f14f80a6f50 2020-11-20T13:56:17.305 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.304+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f14d8051310 msgr2=0x7f14d80537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.306 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.304+0000 7f14fd64d700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f14d8051310 0x7f14d80537d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f14e800d000 tx=0x7f14e8007ad0).stop 2020-11-20T13:56:17.306 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.304+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14f80a6f50 msgr2=0x7f14f8133ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.306 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.304+0000 7f14fd64d700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14f80a6f50 0x7f14f8133ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f14f81242f0 tx=0x7f14ec006dc0).stop 2020-11-20T13:56:17.306 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.305+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 shutdown_connections 2020-11-20T13:56:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.305+0000 7f14fd64d700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f14d8051310 0x7f14d80537d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.305+0000 7f14fd64d700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14f80a8590 0x7f14f81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.305+0000 7f14fd64d700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14f80a28c0 0x7f14f80a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.305+0000 7f14fd64d700 1 --2- 172.21.15.39:0/2316497927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14f80a6f50 0x7f14f8133ec0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.305+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 >> 172.21.15.39:0/2316497927 conn(0x7f14f805f740 msgr2=0x7f14f8069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:17.308 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.305+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 shutdown_connections 2020-11-20T13:56:17.308 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.305+0000 7f14fd64d700 1 -- 172.21.15.39:0/2316497927 wait complete. 2020-11-20T13:56:17.309 INFO:teuthology.orchestra.run.smithi039.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-20T13:56:17.318 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-20T13:56:17.319 INFO:tasks.ceph.mds.a:Restarting daemon 2020-11-20T13:56:17.319 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-11-20T13:56:17.321 INFO:tasks.ceph.mds.a:Started 2020-11-20T13:56:17.322 INFO:tasks.ceph.mds.b:Restarting daemon 2020-11-20T13:56:17.322 INFO:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-11-20T13:56:17.325 INFO:tasks.ceph.mds.b:Started 2020-11-20T13:56:17.325 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-11-20T13:56:17.326 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-20T13:56:17.412 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2020-11-20T13:56:17.416 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2020-11-20T13:56:17.451 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.451+0000 7ff30bde9700 1 Processor -- start 2020-11-20T13:56:17.452 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.451+0000 7ff30bde9700 1 -- start start 2020-11-20T13:56:17.458 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.451+0000 7ff30bde9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff304067040 0x7ff3040674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.458 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.451+0000 7ff30bde9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3040a67a0 con 0x7ff30405c520 2020-11-20T13:56:17.458 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.451+0000 7ff30bde9700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3040a50d0 con 0x7ff3040679e0 2020-11-20T13:56:17.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.451+0000 7ff30bde9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3040a73c0 con 0x7ff304067040 2020-11-20T13:56:17.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff30a386700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff3040679e0 0x7ff304141da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35136/0 (socket says 172.21.15.39:35136) 2020-11-20T13:56:17.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff30a386700 1 -- 172.21.15.39:0/1054390637 learned_addr learned my addr 172.21.15.39:0/1054390637 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:17.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff309384700 1 --2- 172.21.15.39:0/1054390637 >> v2:172.21.15.31:3300/0 conn(0x7ff304067040 0x7ff3040674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.460 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513234483 0 0) 0x7ff3040a50d0 con 0x7ff3040679e0 2020-11-20T13:56:17.460 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ec003230 con 0x7ff3040679e0 2020-11-20T13:56:17.460 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1153035476 0 0) 0x7ff2ec003230 con 0x7ff3040679e0 2020-11-20T13:56:17.460 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 >> v2:172.21.15.31:3300/0 conn(0x7ff304067040 msgr2=0x7ff3040674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:17.460 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 --2- 172.21.15.39:0/1054390637 >> v2:172.21.15.31:3300/0 conn(0x7ff304067040 0x7ff3040674f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 >> v1:172.21.15.31:6789/0 conn(0x7ff30405c520 legacy=0x7ff3040a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040a5300 con 0x7ff3040679e0 2020-11-20T13:56:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7ff2fc001a50 con 0x7ff3040679e0 2020-11-20T13:56:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 >> v1:172.21.15.39:6789/0 conn(0x7ff3040679e0 legacy=0x7ff304141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff2ec003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0044d0 0x7ff2ec004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ec004e40 0x7ff2ec00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040a73c0 con 0x7ff2ec004e40 2020-11-20T13:56:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec004340 con 0x7ff2ec003720 2020-11-20T13:56:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec00bc40 con 0x7ff2ec0044d0 2020-11-20T13:56:17.463 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff309b85700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff2ec003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.463 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff30a386700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ec004e40 0x7ff2ec00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.463 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.452+0000 7ff309384700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0044d0 0x7ff2ec004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.463 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff309b85700 1 -- 172.21.15.39:0/1054390637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0044d0 msgr2=0x7ff2ec004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:17.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff309b85700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff2ec0044d0 0x7ff2ec004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff309b85700 1 -- 172.21.15.39:0/1054390637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ec004e40 msgr2=0x7ff2ec00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:17.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff309b85700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2ec004e40 0x7ff2ec00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff309b85700 1 -- 172.21.15.39:0/1054390637 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec003230 con 0x7ff2ec003720 2020-11-20T13:56:17.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff30a386700 1 -- 172.21.15.39:0/1054390637 reap_dead start 2020-11-20T13:56:17.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff309b85700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff2ec003b40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff3040a61b0 tx=0x7ff300007ad0).ready entity=mon.1 client_cookie=141b7c4260884900 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:17.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff30000c5a0 con 0x7ff2ec003720 2020-11-20T13:56:17.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30000c700 con 0x7ff2ec003720 2020-11-20T13:56:17.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff308b83700 1 -- 172.21.15.39:0/1054390637 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff30000ca60 con 0x7ff2ec003720 2020-11-20T13:56:17.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff30bde9700 1 -- 172.21.15.39:0/1054390637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 msgr2=0x7ff2ec003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.466 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff30bde9700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff2ec003b40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff3040a61b0 tx=0x7ff300007ad0).stop 2020-11-20T13:56:17.466 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff30bde9700 1 -- 172.21.15.39:0/1054390637 shutdown_connections 2020-11-20T13:56:17.467 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff30bde9700 1 --2- 172.21.15.39:0/1054390637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff2ec003b40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.467 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff30bde9700 1 -- 172.21.15.39:0/1054390637 >> 172.21.15.39:0/1054390637 conn(0x7ff30405ccb0 msgr2=0x7ff30405ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:17.467 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff30bde9700 1 -- 172.21.15.39:0/1054390637 shutdown_connections 2020-11-20T13:56:17.467 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.453+0000 7ff30bde9700 1 -- 172.21.15.39:0/1054390637 wait complete. 2020-11-20T13:56:17.467 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.454+0000 7ff30bde9700 1 Processor -- start 2020-11-20T13:56:17.468 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.454+0000 7ff30bde9700 1 -- start start 2020-11-20T13:56:17.468 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff30bde9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff30409ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.468 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff30bde9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff30409e570 0x7ff30409f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.468 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff30bde9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040a0d90 0x7ff3040607e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.469 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff30bde9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30409f740 con 0x7ff3040a0d90 2020-11-20T13:56:17.469 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff30bde9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30413e9f0 con 0x7ff2ec003720 2020-11-20T13:56:17.469 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff30bde9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff304062520 con 0x7ff30409e570 2020-11-20T13:56:17.469 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309b85700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff30409ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.469 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309b85700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff30409ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44976/0 (socket says 172.21.15.39:44976) 2020-11-20T13:56:17.470 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309b85700 1 -- 172.21.15.39:0/2499480167 learned_addr learned my addr 172.21.15.39:0/2499480167 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:17.470 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309384700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff30409e570 0x7ff30409f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.470 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff30a386700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040a0d90 0x7ff3040607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.470 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309b85700 1 -- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff30409e570 msgr2=0x7ff30409f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.470 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309b85700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff30409e570 0x7ff30409f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.471 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309b85700 1 -- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040a0d90 msgr2=0x7ff3040607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.471 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309b85700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040a0d90 0x7ff3040607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.471 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309b85700 1 -- 172.21.15.39:0/2499480167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040658c0 con 0x7ff2ec003720 2020-11-20T13:56:17.471 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff309b85700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff30409ed60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff30409e970 tx=0x7ff300016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:17.471 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff2f6ffd700 1 -- 172.21.15.39:0/2499480167 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff300013610 con 0x7ff2ec003720 2020-11-20T13:56:17.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.455+0000 7ff2f6ffd700 1 -- 172.21.15.39:0/2499480167 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff300013770 con 0x7ff2ec003720 2020-11-20T13:56:17.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.456+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff304065b60 con 0x7ff2ec003720 2020-11-20T13:56:17.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.456+0000 7ff2f6ffd700 1 -- 172.21.15.39:0/2499480167 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff300013ad0 con 0x7ff2ec003720 2020-11-20T13:56:17.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.456+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3040619d0 con 0x7ff2ec003720 2020-11-20T13:56:17.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.457+0000 7ff2f6ffd700 1 -- 172.21.15.39:0/2499480167 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7ff300025030 con 0x7ff2ec003720 2020-11-20T13:56:17.473 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.457+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30409eac0 con 0x7ff2ec003720 2020-11-20T13:56:17.473 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.457+0000 7ff2f6ffd700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff2e4051390 0x7ff2e4053850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.473 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.457+0000 7ff2f6ffd700 1 -- 172.21.15.39:0/2499480167 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff300069cb0 con 0x7ff2ec003720 2020-11-20T13:56:17.473 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.457+0000 7ff309384700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff2e4051390 0x7ff2e4053850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.474 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.457+0000 7ff309384700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff2e4051390 0x7ff2e4053850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff2f8008000 tx=0x7ff2f8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:17.474 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.460+0000 7ff2f6ffd700 1 -- 172.21.15.39:0/2499480167 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7ff30409eac0 con 0x7ff2ec003720 2020-11-20T13:56:17.621 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.620+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff30409eac0 con 0x7ff2ec003720 2020-11-20T13:56:17.621 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.621+0000 7ff2f6ffd700 1 -- 172.21.15.39:0/2499480167 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13191 (secure 0 0 0) 0x7ff30409eac0 con 0x7ff2ec003720 2020-11-20T13:56:17.622 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:17.622 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":17,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:17.285606+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T13:56:15.768689+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:17.623 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff2e4051390 msgr2=0x7ff2e4053850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff2e4051390 0x7ff2e4053850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff2f8008000 tx=0x7ff2f8008040).stop 2020-11-20T13:56:17.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 msgr2=0x7ff30409ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff30409ed60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff30409e970 tx=0x7ff300016000).stop 2020-11-20T13:56:17.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 shutdown_connections 2020-11-20T13:56:17.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff2e4051390 0x7ff2e4053850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.625 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2ec003720 0x7ff30409ed60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.625 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040a0d90 0x7ff3040607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.626 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 --2- 172.21.15.39:0/2499480167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff30409e570 0x7ff30409f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.626 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 >> 172.21.15.39:0/2499480167 conn(0x7ff30405ccb0 msgr2=0x7ff304069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:17.626 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 shutdown_connections 2020-11-20T13:56:17.626 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.622+0000 7ff30bde9700 1 -- 172.21.15.39:0/2499480167 wait complete. 2020-11-20T13:56:17.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T13:56:05.147084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T13:56:15.768689+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-20T13:56:17.635 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-11-20T13:56:17.752 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.751+0000 7fbd957ed700 1 Processor -- start 2020-11-20T13:56:17.752 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.751+0000 7fbd957ed700 1 -- start start 2020-11-20T13:56:17.758 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd957ed700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbd9013bf60 0x7fbd9013e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd957ed700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd900a3fa0 con 0x7fbd900a8a80 2020-11-20T13:56:17.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd957ed700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd900a41d0 con 0x7fbd9013e840 2020-11-20T13:56:17.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd957ed700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd900a02b0 con 0x7fbd9013bf60 2020-11-20T13:56:17.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd8e7fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbd9013bf60 0x7fbd9013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd8f7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbd9013e840 0x7fbd90140c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35156/0 (socket says 172.21.15.39:35156) 2020-11-20T13:56:17.760 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd8f7fe700 1 -- 172.21.15.39:0/1909436840 learned_addr learned my addr 172.21.15.39:0/1909436840 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:17.760 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd8e7fc700 1 -- 172.21.15.39:0/1909436840 >> v1:172.21.15.39:6789/0 conn(0x7fbd9013e840 legacy=0x7fbd90140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.760 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd8e7fc700 1 -- 172.21.15.39:0/1909436840 >> v1:172.21.15.31:6789/0 conn(0x7fbd900a8a80 legacy=0x7fbd900a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.760 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd8e7fc700 1 -- 172.21.15.39:0/1909436840 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900a59b0 con 0x7fbd9013bf60 2020-11-20T13:56:17.760 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd8dffb700 1 -- 172.21.15.39:0/1909436840 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847499791 0 0) 0x7fbd900a41d0 con 0x7fbd9013e840 2020-11-20T13:56:17.761 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.752+0000 7fbd8e7fc700 1 --2- 172.21.15.39:0/1909436840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 0x7fbd9013e350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fbd80002f30 tx=0x7fbd80006dc0).ready entity=mon.1 client_cookie=2e0812d36ff85e27 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:17.761 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd8dffb700 1 -- 172.21.15.39:0/1909436840 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd800097f0 con 0x7fbd9013bf60 2020-11-20T13:56:17.761 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd8dffb700 1 -- 172.21.15.39:0/1909436840 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80009950 con 0x7fbd9013bf60 2020-11-20T13:56:17.761 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd8dffb700 1 -- 172.21.15.39:0/1909436840 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd80009cb0 con 0x7fbd9013bf60 2020-11-20T13:56:17.761 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd957ed700 1 -- 172.21.15.39:0/1909436840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 msgr2=0x7fbd9013e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.762 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd957ed700 1 --2- 172.21.15.39:0/1909436840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 0x7fbd9013e350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fbd80002f30 tx=0x7fbd80006dc0).stop 2020-11-20T13:56:17.762 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd957ed700 1 -- 172.21.15.39:0/1909436840 shutdown_connections 2020-11-20T13:56:17.763 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd957ed700 1 --2- 172.21.15.39:0/1909436840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 0x7fbd9013e350 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.763 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd957ed700 1 -- 172.21.15.39:0/1909436840 >> 172.21.15.39:0/1909436840 conn(0x7fbd900ac1e0 msgr2=0x7fbd900a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:17.763 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd957ed700 1 -- 172.21.15.39:0/1909436840 shutdown_connections 2020-11-20T13:56:17.763 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.753+0000 7fbd957ed700 1 -- 172.21.15.39:0/1909436840 wait complete. 2020-11-20T13:56:17.763 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.754+0000 7fbd957ed700 1 Processor -- start 2020-11-20T13:56:17.764 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.754+0000 7fbd957ed700 1 -- start start 2020-11-20T13:56:17.764 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd957ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd900a8a80 0x7fbd90064010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.764 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd957ed700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 0x7fbd9013a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.764 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd957ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd9013e840 0x7fbd9013a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.764 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd957ed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd90064fd0 con 0x7fbd9013e840 2020-11-20T13:56:17.765 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd957ed700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd90064500 con 0x7fbd9013bf60 2020-11-20T13:56:17.765 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd957ed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9009ae70 con 0x7fbd900a8a80 2020-11-20T13:56:17.766 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 0x7fbd9013a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.766 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 0x7fbd9013a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44990/0 (socket says 172.21.15.39:44990) 2020-11-20T13:56:17.766 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8e7fc700 1 -- 172.21.15.39:0/1420604384 learned_addr learned my addr 172.21.15.39:0/1420604384 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:17.766 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8f7fe700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd9013e840 0x7fbd9013a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.766 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8effd700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd900a8a80 0x7fbd90064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.767 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8e7fc700 1 -- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd900a8a80 msgr2=0x7fbd90064010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.767 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8e7fc700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd900a8a80 0x7fbd90064010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.767 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8e7fc700 1 -- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd9013e840 msgr2=0x7fbd9013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.767 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8e7fc700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd9013e840 0x7fbd9013a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.767 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8e7fc700 1 -- 172.21.15.39:0/1420604384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd90065200 con 0x7fbd9013bf60 2020-11-20T13:56:17.768 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8f7fe700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd9013e840 0x7fbd9013a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:17.768 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd8e7fc700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 0x7fbd9013a480 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fbd90066000 tx=0x7fbd80015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:17.768 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd7ffff700 1 -- 172.21.15.39:0/1420604384 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd80021070 con 0x7fbd9013bf60 2020-11-20T13:56:17.768 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd7ffff700 1 -- 172.21.15.39:0/1420604384 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8001d450 con 0x7fbd9013bf60 2020-11-20T13:56:17.769 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd900654a0 con 0x7fbd9013bf60 2020-11-20T13:56:17.769 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd7ffff700 1 -- 172.21.15.39:0/1420604384 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd8001d7b0 con 0x7fbd9013bf60 2020-11-20T13:56:17.769 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.755+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9013e5b0 con 0x7fbd9013bf60 2020-11-20T13:56:17.769 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.756+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd90065630 con 0x7fbd9013bf60 2020-11-20T13:56:17.769 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.757+0000 7fbd7ffff700 1 -- 172.21.15.39:0/1420604384 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fbd8000f070 con 0x7fbd9013bf60 2020-11-20T13:56:17.770 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.757+0000 7fbd7ffff700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbd6c0511d0 0x7fbd6c053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:17.770 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.757+0000 7fbd7ffff700 1 -- 172.21.15.39:0/1420604384 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbd8006a570 con 0x7fbd9013bf60 2020-11-20T13:56:17.770 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.757+0000 7fbd8effd700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbd6c0511d0 0x7fbd6c053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:17.770 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.757+0000 7fbd8effd700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbd6c0511d0 0x7fbd6c053690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbd8400b000 tx=0x7fbd84009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:17.771 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.760+0000 7fbd7ffff700 1 -- 172.21.15.39:0/1420604384 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fbd80042c00 con 0x7fbd9013bf60 2020-11-20T13:56:17.921 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.919+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbd90066b70 con 0x7fbd9013bf60 2020-11-20T13:56:17.921 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.920+0000 7fbd7ffff700 1 -- 172.21.15.39:0/1420604384 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbd80046220 con 0x7fbd9013bf60 2020-11-20T13:56:17.921 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2020-11-20T13:56:17.922 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbd6c0511d0 msgr2=0x7fbd6c053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.923 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbd6c0511d0 0x7fbd6c053690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbd8400b000 tx=0x7fbd84009040).stop 2020-11-20T13:56:17.923 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 msgr2=0x7fbd9013a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:17.923 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 0x7fbd9013a480 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fbd90066000 tx=0x7fbd80015000).stop 2020-11-20T13:56:17.924 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 shutdown_connections 2020-11-20T13:56:17.924 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbd6c0511d0 0x7fbd6c053690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.924 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd9013e840 0x7fbd9013a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.924 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd900a8a80 0x7fbd90064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.925 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 --2- 172.21.15.39:0/1420604384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd9013bf60 0x7fbd9013a480 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:17.925 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 >> 172.21.15.39:0/1420604384 conn(0x7fbd900ac1e0 msgr2=0x7fbd900a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:17.925 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 shutdown_connections 2020-11-20T13:56:17.925 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:17.921+0000 7fbd957ed700 1 -- 172.21.15.39:0/1420604384 wait complete. 2020-11-20T13:56:17.932 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-11-20T13:56:18.049 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.048+0000 7f4ed20a5700 1 Processor -- start 2020-11-20T13:56:18.049 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.048+0000 7f4ed20a5700 1 -- start start 2020-11-20T13:56:18.051 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ed20a5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc0ac9b0 0x7f4ecc1399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.052 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ed20a5700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ecc139ea0 0x7f4ecc13a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.052 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ed20a5700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc0abd40 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.052 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ed20a5700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc0aaf60 con 0x7f4ecc139ea0 2020-11-20T13:56:18.052 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ed20a5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc13a7d0 con 0x7f4ecc0ac9b0 2020-11-20T13:56:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecbfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ecc139ea0 0x7f4ecc13a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecbfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ecc139ea0 0x7f4ecc13a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45002/0 (socket says 172.21.15.39:45002) 2020-11-20T13:56:18.053 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecb7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4ecc0a9c60 0x7f4ecc0ab630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35170/0 (socket says 172.21.15.39:35170) 2020-11-20T13:56:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecbfff700 1 -- 172.21.15.39:0/1201686114 learned_addr learned my addr 172.21.15.39:0/1201686114 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecaffd700 1 --2- 172.21.15.39:0/1201686114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc0ac9b0 0x7f4ecc1399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecbfff700 1 -- 172.21.15.39:0/1201686114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc0ac9b0 msgr2=0x7f4ecc1399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecbfff700 1 --2- 172.21.15.39:0/1201686114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc0ac9b0 0x7f4ecc1399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecbfff700 1 -- 172.21.15.39:0/1201686114 >> v1:172.21.15.39:6789/0 conn(0x7f4ecc0a9c60 legacy=0x7f4ecc0ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecbfff700 1 -- 172.21.15.39:0/1201686114 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0a7f10 con 0x7f4ecc139ea0 2020-11-20T13:56:18.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4eca7fc700 1 -- 172.21.15.39:0/1201686114 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804046687 0 0) 0x7f4ecc0abd40 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecaffd700 1 --2- 172.21.15.39:0/1201686114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc0ac9b0 0x7f4ecc1399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ecbfff700 1 --2- 172.21.15.39:0/1201686114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc139ea0 0x7f4ecc13a2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ec40032b0 tx=0x7f4ec4009270).ready entity=mon.1 client_cookie=6f57351ccf64ebd6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4eca7fc700 1 -- 172.21.15.39:0/1201686114 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ec400bc00 con 0x7f4ecc139ea0 2020-11-20T13:56:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4eca7fc700 1 -- 172.21.15.39:0/1201686114 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec400bd60 con 0x7f4ecc139ea0 2020-11-20T13:56:18.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4eca7fc700 1 -- 172.21.15.39:0/1201686114 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ec4011400 con 0x7f4ecc139ea0 2020-11-20T13:56:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1201686114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc139ea0 msgr2=0x7f4ecc13a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.049+0000 7f4ed20a5700 1 --2- 172.21.15.39:0/1201686114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc139ea0 0x7f4ecc13a2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ec40032b0 tx=0x7f4ec4009270).stop 2020-11-20T13:56:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.050+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1201686114 shutdown_connections 2020-11-20T13:56:18.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.050+0000 7f4ed20a5700 1 --2- 172.21.15.39:0/1201686114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc139ea0 0x7f4ecc13a2e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.050+0000 7f4ed20a5700 1 --2- 172.21.15.39:0/1201686114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc0ac9b0 0x7f4ecc1399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.050+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1201686114 >> 172.21.15.39:0/1201686114 conn(0x7f4ecc05f360 msgr2=0x7f4ecc05f770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:18.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.050+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1201686114 shutdown_connections 2020-11-20T13:56:18.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.050+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1201686114 wait complete. 2020-11-20T13:56:18.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.051+0000 7f4ed20a5700 1 Processor -- start 2020-11-20T13:56:18.060 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.051+0000 7f4ed20a5700 1 -- start start 2020-11-20T13:56:18.063 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ed20a5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc0a9c60 0x7f4ecc09e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.063 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ed20a5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ecc0ac9b0 0x7f4ecc0a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ed20a5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc139ea0 0x7f4ecc09fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ed20a5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0a0820 con 0x7f4ecc0ac9b0 2020-11-20T13:56:18.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ed20a5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0af610 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ed20a5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc09dab0 con 0x7f4ecc139ea0 2020-11-20T13:56:18.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc0a9c60 0x7f4ecc09e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc0a9c60 0x7f4ecc09e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45004/0 (socket says 172.21.15.39:45004) 2020-11-20T13:56:18.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecb7fe700 1 -- 172.21.15.39:0/1745121452 learned_addr learned my addr 172.21.15.39:0/1745121452 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:18.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecbfff700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc139ea0 0x7f4ecc09fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecaffd700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ecc0ac9b0 0x7f4ecc0a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecb7fe700 1 -- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc139ea0 msgr2=0x7f4ecc09fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecb7fe700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc139ea0 0x7f4ecc09fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.067 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecb7fe700 1 -- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ecc0ac9b0 msgr2=0x7f4ecc0a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.067 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecb7fe700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ecc0ac9b0 0x7f4ecc0a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.067 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecb7fe700 1 -- 172.21.15.39:0/1745121452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0a29f0 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.067 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecbfff700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc139ea0 0x7f4ecc09fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:18.068 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecaffd700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ecc0ac9b0 0x7f4ecc0a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:18.068 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ecb7fe700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc0a9c60 0x7f4ecc09e520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4ebc000e90 tx=0x7f4ebc007a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:18.068 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ec8ff9700 1 -- 172.21.15.39:0/1745121452 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ebc007320 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.068 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ec8ff9700 1 -- 172.21.15.39:0/1745121452 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc005520 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.069 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc09f830 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.069 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ec8ff9700 1 -- 172.21.15.39:0/1745121452 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ebc005880 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.069 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.052+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc0a2150 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.069 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.053+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc09f9c0 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.069 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.053+0000 7f4ec8ff9700 1 -- 172.21.15.39:0/1745121452 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f4ebc010030 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.070 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.054+0000 7f4ec8ff9700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4eac051200 0x7f4eac0536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.070 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.054+0000 7f4ec8ff9700 1 -- 172.21.15.39:0/1745121452 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4ebc068950 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.070 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.054+0000 7f4ecaffd700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4eac051200 0x7f4eac0536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.070 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.054+0000 7f4ecaffd700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4eac051200 0x7f4eac0536c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4ec0008000 tx=0x7f4ec0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:18.071 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.057+0000 7f4ec8ff9700 1 -- 172.21.15.39:0/1745121452 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f4ebc041040 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.219 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.218+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ecc057050 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.219 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.218+0000 7f4ec8ff9700 1 -- 172.21.15.39:0/1745121452 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4ebc044660 con 0x7f4ecc0a9c60 2020-11-20T13:56:18.220 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:18.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4eac051200 msgr2=0x7f4eac0536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4eac051200 0x7f4eac0536c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4ec0008000 tx=0x7f4ec0008040).stop 2020-11-20T13:56:18.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc0a9c60 msgr2=0x7f4ecc09e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc0a9c60 0x7f4ecc09e520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4ebc000e90 tx=0x7f4ebc007a00).stop 2020-11-20T13:56:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 shutdown_connections 2020-11-20T13:56:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4eac051200 0x7f4eac0536c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc0a9c60 0x7f4ecc09e520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ecc139ea0 0x7f4ecc09fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 --2- 172.21.15.39:0/1745121452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ecc0ac9b0 0x7f4ecc0a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 >> 172.21.15.39:0/1745121452 conn(0x7f4ecc05f360 msgr2=0x7f4ecc0ae4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:18.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 shutdown_connections 2020-11-20T13:56:18.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.220+0000 7f4ed20a5700 1 -- 172.21.15.39:0/1745121452 wait complete. 2020-11-20T13:56:18.232 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-11-20T13:56:18.350 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.347+0000 7f47b5e7c700 1 Processor -- start 2020-11-20T13:56:18.350 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.347+0000 7f47b5e7c700 1 -- start start 2020-11-20T13:56:18.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47b5e7c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f47b013bf60 0x7f47b013e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47b5e7c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47b013e840 0x7f47b0140c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47b5e7c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00a3fa0 con 0x7f47b00a8a80 2020-11-20T13:56:18.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47b5e7c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b00a0270 con 0x7f47b013bf60 2020-11-20T13:56:18.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47b5e7c700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b00a59b0 con 0x7f47b013e840 2020-11-20T13:56:18.352 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47affff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47b013e840 0x7f47b0140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.352 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47affff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47b013e840 0x7f47b0140c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45012/0 (socket says 172.21.15.39:45012) 2020-11-20T13:56:18.352 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47affff700 1 -- 172.21.15.39:0/2329782761 learned_addr learned my addr 172.21.15.39:0/2329782761 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:18.352 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47aeffd700 1 --2- 172.21.15.39:0/2329782761 >> v2:172.21.15.31:3300/0 conn(0x7f47b013bf60 0x7f47b013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47affff700 1 -- 172.21.15.39:0/2329782761 >> v2:172.21.15.31:3300/0 conn(0x7f47b013bf60 msgr2=0x7f47b013e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:18.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47affff700 1 --2- 172.21.15.39:0/2329782761 >> v2:172.21.15.31:3300/0 conn(0x7f47b013bf60 0x7f47b013e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47affff700 1 -- 172.21.15.39:0/2329782761 >> v1:172.21.15.31:6789/0 conn(0x7f47b00a8a80 legacy=0x7f47b00a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47affff700 1 -- 172.21.15.39:0/2329782761 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00a41d0 con 0x7f47b013e840 2020-11-20T13:56:18.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47aeffd700 1 --2- 172.21.15.39:0/2329782761 >> v2:172.21.15.31:3300/0 conn(0x7f47b013bf60 0x7f47b013e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:18.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.348+0000 7f47affff700 1 --2- 172.21.15.39:0/2329782761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 0x7f47b0140c30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f47a80032b0 tx=0x7f47a8009270).ready entity=mon.1 client_cookie=9c7f8a6d00b63694 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:18.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47ae7fc700 1 -- 172.21.15.39:0/2329782761 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a800bc00 con 0x7f47b013e840 2020-11-20T13:56:18.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47ae7fc700 1 -- 172.21.15.39:0/2329782761 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a800bd60 con 0x7f47b013e840 2020-11-20T13:56:18.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47ae7fc700 1 -- 172.21.15.39:0/2329782761 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a8011400 con 0x7f47b013e840 2020-11-20T13:56:18.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47b5e7c700 1 -- 172.21.15.39:0/2329782761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 msgr2=0x7f47b0140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47b5e7c700 1 --2- 172.21.15.39:0/2329782761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 0x7f47b0140c30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f47a80032b0 tx=0x7f47a8009270).stop 2020-11-20T13:56:18.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47b5e7c700 1 -- 172.21.15.39:0/2329782761 shutdown_connections 2020-11-20T13:56:18.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47b5e7c700 1 --2- 172.21.15.39:0/2329782761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 0x7f47b0140c30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47b5e7c700 1 --2- 172.21.15.39:0/2329782761 >> v2:172.21.15.31:3300/0 conn(0x7f47b013bf60 0x7f47b013e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47b5e7c700 1 -- 172.21.15.39:0/2329782761 >> 172.21.15.39:0/2329782761 conn(0x7f47b00ac1e0 msgr2=0x7f47b00a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:18.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47b5e7c700 1 -- 172.21.15.39:0/2329782761 shutdown_connections 2020-11-20T13:56:18.357 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.349+0000 7f47b5e7c700 1 -- 172.21.15.39:0/2329782761 wait complete. 2020-11-20T13:56:18.361 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.350+0000 7f47b5e7c700 1 Processor -- start 2020-11-20T13:56:18.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.350+0000 7f47b5e7c700 1 -- start start 2020-11-20T13:56:18.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47b5e7c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47b00a8a80 0x7f47b009dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47b5e7c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47b013bf60 0x7f47b0144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47b5e7c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 0x7f47b0145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47b5e7c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b013de30 con 0x7f47b00a8a80 2020-11-20T13:56:18.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47b5e7c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0145870 con 0x7f47b013e840 2020-11-20T13:56:18.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47b5e7c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b009b630 con 0x7f47b013bf60 2020-11-20T13:56:18.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47affff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 0x7f47b0145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47affff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 0x7f47b0145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45022/0 (socket says 172.21.15.39:45022) 2020-11-20T13:56:18.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47affff700 1 -- 172.21.15.39:0/1769935208 learned_addr learned my addr 172.21.15.39:0/1769935208 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:18.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47af7fe700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47b00a8a80 0x7f47b009dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47aeffd700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47b013bf60 0x7f47b0144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47affff700 1 -- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47b013bf60 msgr2=0x7f47b0144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47affff700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47b013bf60 0x7f47b0144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47affff700 1 -- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47b00a8a80 msgr2=0x7f47b009dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47affff700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47b00a8a80 0x7f47b009dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47affff700 1 -- 172.21.15.39:0/1769935208 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0135e60 con 0x7f47b013e840 2020-11-20T13:56:18.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47affff700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 0x7f47b0145380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f47a80032b0 tx=0x7f47a8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:18.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.351+0000 7f47acff9700 1 -- 172.21.15.39:0/1769935208 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a801d5e0 con 0x7f47b013e840 2020-11-20T13:56:18.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.352+0000 7f47acff9700 1 -- 172.21.15.39:0/1769935208 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8021070 con 0x7f47b013e840 2020-11-20T13:56:18.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.352+0000 7f47acff9700 1 -- 172.21.15.39:0/1769935208 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a801d930 con 0x7f47b013e840 2020-11-20T13:56:18.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.352+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b013c340 con 0x7f47b013e840 2020-11-20T13:56:18.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.352+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b013c880 con 0x7f47b013e840 2020-11-20T13:56:18.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.353+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b0057050 con 0x7f47b013e840 2020-11-20T13:56:18.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.353+0000 7f47acff9700 1 -- 172.21.15.39:0/1769935208 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f47a800f070 con 0x7f47b013e840 2020-11-20T13:56:18.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.353+0000 7f47acff9700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f47900511d0 0x7f4790053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.368 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.353+0000 7f47acff9700 1 -- 172.21.15.39:0/1769935208 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f47a806bc90 con 0x7f47b013e840 2020-11-20T13:56:18.368 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.353+0000 7f47af7fe700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f47900511d0 0x7f4790053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.369 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.354+0000 7f47af7fe700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f47900511d0 0x7f4790053690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f47a000d000 tx=0x7f47a0000b80).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:18.369 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.357+0000 7f47acff9700 1 -- 172.21.15.39:0/1769935208 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f47a80442e0 con 0x7f47b013e840 2020-11-20T13:56:18.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.518+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f47b006a5c0 con 0x7f47b013e840 2020-11-20T13:56:18.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.519+0000 7f47acff9700 1 -- 172.21.15.39:0/1769935208 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f47a8015030 con 0x7f47b013e840 2020-11-20T13:56:18.520 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:18.520 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2020-11-20T13:56:18.521 INFO:teuthology.orchestra.run.smithi039.stdout: { 2020-11-20T13:56:18.521 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2020-11-20T13:56:18.521 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": "device_health_metrics" 2020-11-20T13:56:18.521 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2020-11-20T13:56:18.521 INFO:teuthology.orchestra.run.smithi039.stdout: { 2020-11-20T13:56:18.522 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 2, 2020-11-20T13:56:18.522 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": "rbd" 2020-11-20T13:56:18.522 INFO:teuthology.orchestra.run.smithi039.stdout: } 2020-11-20T13:56:18.522 INFO:teuthology.orchestra.run.smithi039.stdout:] 2020-11-20T13:56:18.523 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f47900511d0 msgr2=0x7f4790053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.523 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f47900511d0 0x7f4790053690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f47a000d000 tx=0x7f47a0000b80).stop 2020-11-20T13:56:18.524 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 msgr2=0x7f47b0145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.524 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 0x7f47b0145380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f47a80032b0 tx=0x7f47a8016000).stop 2020-11-20T13:56:18.524 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 shutdown_connections 2020-11-20T13:56:18.524 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f47900511d0 0x7f4790053690 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.525 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b013e840 0x7f47b0145380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.525 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47b00a8a80 0x7f47b009dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.525 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 --2- 172.21.15.39:0/1769935208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47b013bf60 0x7f47b0144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.525 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 >> 172.21.15.39:0/1769935208 conn(0x7f47b00ac1e0 msgr2=0x7f47b00a3040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:18.526 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 shutdown_connections 2020-11-20T13:56:18.526 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.520+0000 7f47b5e7c700 1 -- 172.21.15.39:0/1769935208 wait complete. 2020-11-20T13:56:18.531 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-11-20T13:56:18.532 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-11-20T13:56:18.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.648+0000 7f92d7fac700 1 Processor -- start 2020-11-20T13:56:18.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.648+0000 7f92d7fac700 1 -- start start 2020-11-20T13:56:18.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.649+0000 7f92d7fac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d013a0c0 0x7f92d0145080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.649+0000 7f92d7fac700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d00abd40 con 0x7f92d00ac9b0 2020-11-20T13:56:18.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.649+0000 7f92d7fac700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d00a7f10 con 0x7f92d00a9c60 2020-11-20T13:56:18.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.649+0000 7f92d7fac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d00aaf60 con 0x7f92d013a0c0 2020-11-20T13:56:18.653 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.649+0000 7f92d5d48700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f92d00a9c60 0x7f92d00ab630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35198/0 (socket says 172.21.15.39:35198) 2020-11-20T13:56:18.653 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.649+0000 7f92d5d48700 1 -- 172.21.15.39:0/551160578 learned_addr learned my addr 172.21.15.39:0/551160578 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:18.653 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.649+0000 7f92d6549700 1 --2- 172.21.15.39:0/551160578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d013a0c0 0x7f92d0145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.653 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.649+0000 7f92d4d46700 1 -- 172.21.15.39:0/551160578 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418235658 0 0) 0x7f92d00a7f10 con 0x7f92d00a9c60 2020-11-20T13:56:18.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.649+0000 7f92d4d46700 1 -- 172.21.15.39:0/551160578 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92b8003230 con 0x7f92d00a9c60 2020-11-20T13:56:18.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d4d46700 1 -- 172.21.15.39:0/551160578 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067308221 0 0) 0x7f92d00abd40 con 0x7f92d00ac9b0 2020-11-20T13:56:18.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d4d46700 1 -- 172.21.15.39:0/551160578 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d00a7f10 con 0x7f92d00ac9b0 2020-11-20T13:56:18.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d6549700 1 -- 172.21.15.39:0/551160578 >> v1:172.21.15.39:6789/0 conn(0x7f92d00a9c60 legacy=0x7f92d00ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d6549700 1 -- 172.21.15.39:0/551160578 >> v1:172.21.15.31:6789/0 conn(0x7f92d00ac9b0 legacy=0x7f92d01399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d6549700 1 -- 172.21.15.39:0/551160578 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d00a81b0 con 0x7f92d013a0c0 2020-11-20T13:56:18.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d6549700 1 --2- 172.21.15.39:0/551160578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d013a0c0 0x7f92d0145080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f92c8002f30 tx=0x7f92c8006dc0).ready entity=mon.2 client_cookie=476a9e2b33c30948 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:18.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d4d46700 1 -- 172.21.15.39:0/551160578 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92c8009730 con 0x7f92d013a0c0 2020-11-20T13:56:18.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d4d46700 1 -- 172.21.15.39:0/551160578 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8009890 con 0x7f92d013a0c0 2020-11-20T13:56:18.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d4d46700 1 -- 172.21.15.39:0/551160578 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92c8009bf0 con 0x7f92d013a0c0 2020-11-20T13:56:18.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d7fac700 1 -- 172.21.15.39:0/551160578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d013a0c0 msgr2=0x7f92d0145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d7fac700 1 --2- 172.21.15.39:0/551160578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d013a0c0 0x7f92d0145080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f92c8002f30 tx=0x7f92c8006dc0).stop 2020-11-20T13:56:18.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d7fac700 1 -- 172.21.15.39:0/551160578 shutdown_connections 2020-11-20T13:56:18.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d7fac700 1 --2- 172.21.15.39:0/551160578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d013a0c0 0x7f92d0145080 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d7fac700 1 -- 172.21.15.39:0/551160578 >> 172.21.15.39:0/551160578 conn(0x7f92d005f360 msgr2=0x7f92d005f770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:18.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.650+0000 7f92d7fac700 1 -- 172.21.15.39:0/551160578 shutdown_connections 2020-11-20T13:56:18.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.651+0000 7f92d7fac700 1 -- 172.21.15.39:0/551160578 wait complete. 2020-11-20T13:56:18.662 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.651+0000 7f92d7fac700 1 Processor -- start 2020-11-20T13:56:18.662 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.651+0000 7f92d7fac700 1 -- start start 2020-11-20T13:56:18.662 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d7fac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92d00a9c60 0x7f92d01480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d7fac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d00ac9b0 0x7f92d00a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d7fac700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92d013a0c0 0x7f92d00a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d7fac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d00a29a0 con 0x7f92d00a9c60 2020-11-20T13:56:18.664 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d7fac700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d013d1f0 con 0x7f92d013a0c0 2020-11-20T13:56:18.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d7fac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d013c110 con 0x7f92d00ac9b0 2020-11-20T13:56:18.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d6549700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92d013a0c0 0x7f92d00a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d6549700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92d013a0c0 0x7f92d00a24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45034/0 (socket says 172.21.15.39:45034) 2020-11-20T13:56:18.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d6549700 1 -- 172.21.15.39:0/3105304175 learned_addr learned my addr 172.21.15.39:0/3105304175 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:18.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d5d48700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92d00a9c60 0x7f92d01480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d5547700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d00ac9b0 0x7f92d00a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.667 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d6549700 1 -- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d00ac9b0 msgr2=0x7f92d00a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.667 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d6549700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d00ac9b0 0x7f92d00a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.667 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d6549700 1 -- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92d00a9c60 msgr2=0x7f92d01480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:18.667 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d6549700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92d00a9c60 0x7f92d01480e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:18.668 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d6549700 1 -- 172.21.15.39:0/3105304175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d013c3b0 con 0x7f92d013a0c0 2020-11-20T13:56:18.668 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.652+0000 7f92d6549700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92d013a0c0 0x7f92d00a24b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f92c8002f30 tx=0x7f92c8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:18.668 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.653+0000 7f92beffd700 1 -- 172.21.15.39:0/3105304175 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92c8011b00 con 0x7f92d013a0c0 2020-11-20T13:56:18.668 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.653+0000 7f92beffd700 1 -- 172.21.15.39:0/3105304175 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8011c60 con 0x7f92d013a0c0 2020-11-20T13:56:18.668 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.653+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d013c650 con 0x7f92d013a0c0 2020-11-20T13:56:18.669 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.653+0000 7f92beffd700 1 -- 172.21.15.39:0/3105304175 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92c801d450 con 0x7f92d013a0c0 2020-11-20T13:56:18.669 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.653+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d01485d0 con 0x7f92d013a0c0 2020-11-20T13:56:18.669 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.654+0000 7f92beffd700 1 -- 172.21.15.39:0/3105304175 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f92c800f070 con 0x7f92d013a0c0 2020-11-20T13:56:18.669 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.654+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d013c7e0 con 0x7f92d013a0c0 2020-11-20T13:56:18.669 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.654+0000 7f92beffd700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f92b0051390 0x7f92b0053850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:18.670 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.654+0000 7f92beffd700 1 -- 172.21.15.39:0/3105304175 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f92c8069810 con 0x7f92d013a0c0 2020-11-20T13:56:18.670 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.654+0000 7f92d5d48700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f92b0051390 0x7f92b0053850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:18.670 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.654+0000 7f92d5d48700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f92b0051390 0x7f92b0053850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f92c000d000 tx=0x7f92c0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:18.670 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.657+0000 7f92beffd700 1 -- 172.21.15.39:0/3105304175 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f92c8041f40 con 0x7f92d013a0c0 2020-11-20T13:56:18.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:18.817+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f92d0057050 con 0x7f92d013a0c0 2020-11-20T13:56:19.313 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.312+0000 7f92beffd700 1 -- 172.21.15.39:0/3105304175 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f92c8022070 con 0x7f92d013a0c0 2020-11-20T13:56:19.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f92b0051390 msgr2=0x7f92b0053850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:19.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f92b0051390 0x7f92b0053850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f92c000d000 tx=0x7f92c0009040).stop 2020-11-20T13:56:19.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92d013a0c0 msgr2=0x7f92d00a24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:19.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92d013a0c0 0x7f92d00a24b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f92c8002f30 tx=0x7f92c8015000).stop 2020-11-20T13:56:19.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 shutdown_connections 2020-11-20T13:56:19.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f92b0051390 0x7f92b0053850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:19.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92d013a0c0 0x7f92d00a24b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:19.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92d00a9c60 0x7f92d01480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:19.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 --2- 172.21.15.39:0/3105304175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92d00ac9b0 0x7f92d00a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:19.319 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 >> 172.21.15.39:0/3105304175 conn(0x7f92d005f360 msgr2=0x7f92d0138ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:19.319 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 shutdown_connections 2020-11-20T13:56:19.319 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.316+0000 7f92d7fac700 1 -- 172.21.15.39:0/3105304175 wait complete. 2020-11-20T13:56:19.320 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2020-11-20T13:56:19.328 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-11-20T13:56:19.448 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.448+0000 7f9d0344f700 1 Processor -- start 2020-11-20T13:56:19.449 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.448+0000 7f9d0344f700 1 -- start start 2020-11-20T13:56:19.451 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.448+0000 7f9d0344f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9cfc05ce20 0x7f9cfc0a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:19.451 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.448+0000 7f9d0344f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc13df70 0x7f9cfc140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:19.451 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.448+0000 7f9d0344f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0a2d10 con 0x7f9cfc09f5f0 2020-11-20T13:56:19.451 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.448+0000 7f9d0344f700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc0a5090 con 0x7f9cfc05ce20 2020-11-20T13:56:19.452 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.448+0000 7f9d0344f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0a5330 con 0x7f9cfc13df70 2020-11-20T13:56:19.452 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.448+0000 7f9d011eb700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9cfc05ce20 0x7f9cfc0a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:19.452 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d011eb700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9cfc05ce20 0x7f9cfc0a3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45040/0 (socket says 172.21.15.39:45040) 2020-11-20T13:56:19.452 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d011eb700 1 -- 172.21.15.39:0/2505938906 learned_addr learned my addr 172.21.15.39:0/2505938906 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:19.453 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d019ec700 1 --2- 172.21.15.39:0/2505938906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc13df70 0x7f9cfc140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:19.453 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d011eb700 1 -- 172.21.15.39:0/2505938906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc13df70 msgr2=0x7f9cfc140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:19.453 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d011eb700 1 --2- 172.21.15.39:0/2505938906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc13df70 0x7f9cfc140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:19.453 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d011eb700 1 -- 172.21.15.39:0/2505938906 >> v1:172.21.15.31:6789/0 conn(0x7f9cfc09f5f0 legacy=0x7f9cfc0a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:19.454 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d011eb700 1 -- 172.21.15.39:0/2505938906 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0a2f40 con 0x7f9cfc05ce20 2020-11-20T13:56:19.454 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d019ec700 1 --2- 172.21.15.39:0/2505938906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc13df70 0x7f9cfc140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:19.454 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d011eb700 1 --2- 172.21.15.39:0/2505938906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 0x7f9cfc0a3df0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9cfc060a40 tx=0x7f9cec006e80).ready entity=mon.1 client_cookie=850bbf2d783bdfab server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:19.454 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9cebfff700 1 -- 172.21.15.39:0/2505938906 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec0097b0 con 0x7f9cfc05ce20 2020-11-20T13:56:19.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9cebfff700 1 -- 172.21.15.39:0/2505938906 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec009910 con 0x7f9cfc05ce20 2020-11-20T13:56:19.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9cebfff700 1 -- 172.21.15.39:0/2505938906 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec009ac0 con 0x7f9cfc05ce20 2020-11-20T13:56:19.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d0344f700 1 -- 172.21.15.39:0/2505938906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 msgr2=0x7f9cfc0a3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:19.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.449+0000 7f9d0344f700 1 --2- 172.21.15.39:0/2505938906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 0x7f9cfc0a3df0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9cfc060a40 tx=0x7f9cec006e80).stop 2020-11-20T13:56:19.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.450+0000 7f9d0344f700 1 -- 172.21.15.39:0/2505938906 shutdown_connections 2020-11-20T13:56:19.456 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.450+0000 7f9d0344f700 1 --2- 172.21.15.39:0/2505938906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc13df70 0x7f9cfc140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:19.456 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.450+0000 7f9d0344f700 1 --2- 172.21.15.39:0/2505938906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 0x7f9cfc0a3df0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:19.456 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.450+0000 7f9d0344f700 1 -- 172.21.15.39:0/2505938906 >> 172.21.15.39:0/2505938906 conn(0x7f9cfc0ac1e0 msgr2=0x7f9cfc0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:19.456 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.450+0000 7f9d0344f700 1 -- 172.21.15.39:0/2505938906 shutdown_connections 2020-11-20T13:56:19.456 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.450+0000 7f9d0344f700 1 -- 172.21.15.39:0/2505938906 wait complete. 2020-11-20T13:56:19.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d0344f700 1 Processor -- start 2020-11-20T13:56:19.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d0344f700 1 -- start start 2020-11-20T13:56:19.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d0344f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 0x7f9cfc0655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:19.460 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d0344f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc09f5f0 0x7f9cfc062b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:19.460 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d0344f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cfc13df70 0x7f9cfc063080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:19.460 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d0344f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc067990 con 0x7f9cfc13df70 2020-11-20T13:56:19.460 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d0344f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc065aa0 con 0x7f9cfc05ce20 2020-11-20T13:56:19.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d0344f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc149f30 con 0x7f9cfc09f5f0 2020-11-20T13:56:19.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d011eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 0x7f9cfc0655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:19.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d011eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 0x7f9cfc0655b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45046/0 (socket says 172.21.15.39:45046) 2020-11-20T13:56:19.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d011eb700 1 -- 172.21.15.39:0/3058782320 learned_addr learned my addr 172.21.15.39:0/3058782320 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:19.461 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d009ea700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc09f5f0 0x7f9cfc062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:19.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.451+0000 7f9d019ec700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cfc13df70 0x7f9cfc063080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:19.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9d011eb700 1 -- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc09f5f0 msgr2=0x7f9cfc062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:19.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9d011eb700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc09f5f0 0x7f9cfc062b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:19.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9d011eb700 1 -- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cfc13df70 msgr2=0x7f9cfc063080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:19.462 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9d011eb700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cfc13df70 0x7f9cfc063080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:19.463 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9d011eb700 1 -- 172.21.15.39:0/3058782320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc14a1d0 con 0x7f9cfc05ce20 2020-11-20T13:56:19.463 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9d019ec700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cfc13df70 0x7f9cfc063080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:19.463 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9d011eb700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 0x7f9cfc0655b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9cfc060a40 tx=0x7f9cec016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:19.463 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9cea7fc700 1 -- 172.21.15.39:0/3058782320 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec021440 con 0x7f9cfc05ce20 2020-11-20T13:56:19.463 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9cea7fc700 1 -- 172.21.15.39:0/3058782320 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec0215a0 con 0x7f9cfc05ce20 2020-11-20T13:56:19.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc0a0860 con 0x7f9cfc05ce20 2020-11-20T13:56:19.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9cea7fc700 1 -- 172.21.15.39:0/3058782320 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec021900 con 0x7f9cfc05ce20 2020-11-20T13:56:19.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.452+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc09af00 con 0x7f9cfc05ce20 2020-11-20T13:56:19.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.453+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc057050 con 0x7f9cfc05ce20 2020-11-20T13:56:19.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.453+0000 7f9cea7fc700 1 -- 172.21.15.39:0/3058782320 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f9cec027020 con 0x7f9cfc05ce20 2020-11-20T13:56:19.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.453+0000 7f9cea7fc700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9cdc051200 0x7f9cdc0536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:19.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.453+0000 7f9cea7fc700 1 -- 172.21.15.39:0/3058782320 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f9cec069eb0 con 0x7f9cfc05ce20 2020-11-20T13:56:19.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.454+0000 7f9d009ea700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9cdc051200 0x7f9cdc0536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:19.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.454+0000 7f9d009ea700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9cdc051200 0x7f9cdc0536c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9cf800d000 tx=0x7f9cf8007b40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:19.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.457+0000 7f9cea7fc700 1 -- 172.21.15.39:0/3058782320 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f9cec042440 con 0x7f9cfc05ce20 2020-11-20T13:56:19.617 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:19.616+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f9cfc065010 con 0x7f9cfc05ce20 2020-11-20T13:56:20.331 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.330+0000 7f9cea7fc700 1 -- 172.21.15.39:0/3058782320 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v20) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9cec0150a0 con 0x7f9cfc05ce20 2020-11-20T13:56:20.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9cdc051200 msgr2=0x7f9cdc0536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9cdc051200 0x7f9cdc0536c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9cf800d000 tx=0x7f9cf8007b40).stop 2020-11-20T13:56:20.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 msgr2=0x7f9cfc0655b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 0x7f9cfc0655b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9cfc060a40 tx=0x7f9cec016000).stop 2020-11-20T13:56:20.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 shutdown_connections 2020-11-20T13:56:20.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9cdc051200 0x7f9cdc0536c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cfc05ce20 0x7f9cfc0655b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cfc13df70 0x7f9cfc063080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 --2- 172.21.15.39:0/3058782320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9cfc09f5f0 0x7f9cfc062b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.339 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 >> 172.21.15.39:0/3058782320 conn(0x7f9cfc0ac1e0 msgr2=0x7f9cfc0aacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:20.339 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 shutdown_connections 2020-11-20T13:56:20.339 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.336+0000 7f9d0344f700 1 -- 172.21.15.39:0/3058782320 wait complete. 2020-11-20T13:56:20.340 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2020-11-20T13:56:20.349 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-11-20T13:56:20.474 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.474+0000 7fa7d52c1700 1 Processor -- start 2020-11-20T13:56:20.475 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.474+0000 7fa7d52c1700 1 -- start start 2020-11-20T13:56:20.477 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.474+0000 7fa7d52c1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa7d013bf60 0x7fa7d013e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.477 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.474+0000 7fa7d52c1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7d013e840 0x7fa7d0140c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.477 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.474+0000 7fa7d52c1700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d00a3fa0 con 0x7fa7d00a8a80 2020-11-20T13:56:20.477 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.474+0000 7fa7d52c1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00a0270 con 0x7fa7d013e840 2020-11-20T13:56:20.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.474+0000 7fa7d52c1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00a59b0 con 0x7fa7d013bf60 2020-11-20T13:56:20.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7ce7fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa7d013bf60 0x7fa7d013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7ceffd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa7d00a8a80 0x7fa7d00a4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35226/0 (socket says 172.21.15.39:35226) 2020-11-20T13:56:20.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7ceffd700 1 -- 172.21.15.39:0/2796850481 learned_addr learned my addr 172.21.15.39:0/2796850481 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:20.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7cf7fe700 1 --2- 172.21.15.39:0/2796850481 >> v2:172.21.15.31:3300/0 conn(0x7fa7d013e840 0x7fa7d0140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7ce7fc700 1 -- 172.21.15.39:0/2796850481 >> v2:172.21.15.31:3300/0 conn(0x7fa7d013e840 msgr2=0x7fa7d0140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:20.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7ce7fc700 1 --2- 172.21.15.39:0/2796850481 >> v2:172.21.15.31:3300/0 conn(0x7fa7d013e840 0x7fa7d0140c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7ce7fc700 1 -- 172.21.15.39:0/2796850481 >> v1:172.21.15.39:6789/0 conn(0x7fa7d00a8a80 legacy=0x7fa7d00a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7cdffb700 1 -- 172.21.15.39:0/2796850481 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477375932 0 0) 0x7fa7d00a3fa0 con 0x7fa7d00a8a80 2020-11-20T13:56:20.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7ce7fc700 1 -- 172.21.15.39:0/2796850481 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00a41d0 con 0x7fa7d013bf60 2020-11-20T13:56:20.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7ce7fc700 1 --2- 172.21.15.39:0/2796850481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 0x7fa7d013e350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa7c4002f30 tx=0x7fa7c4006dc0).ready entity=mon.1 client_cookie=d2247155e48b2ce7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:20.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7cdffb700 1 -- 172.21.15.39:0/2796850481 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c40097f0 con 0x7fa7d013bf60 2020-11-20T13:56:20.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7cdffb700 1 -- 172.21.15.39:0/2796850481 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4009950 con 0x7fa7d013bf60 2020-11-20T13:56:20.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7cdffb700 1 -- 172.21.15.39:0/2796850481 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c4009cb0 con 0x7fa7d013bf60 2020-11-20T13:56:20.481 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7d52c1700 1 -- 172.21.15.39:0/2796850481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 msgr2=0x7fa7d013e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.481 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.475+0000 7fa7d52c1700 1 --2- 172.21.15.39:0/2796850481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 0x7fa7d013e350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa7c4002f30 tx=0x7fa7c4006dc0).stop 2020-11-20T13:56:20.481 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.476+0000 7fa7d52c1700 1 -- 172.21.15.39:0/2796850481 shutdown_connections 2020-11-20T13:56:20.481 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.476+0000 7fa7d52c1700 1 --2- 172.21.15.39:0/2796850481 >> v2:172.21.15.31:3300/0 conn(0x7fa7d013e840 0x7fa7d0140c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.481 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.476+0000 7fa7d52c1700 1 --2- 172.21.15.39:0/2796850481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 0x7fa7d013e350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.482 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.476+0000 7fa7d52c1700 1 -- 172.21.15.39:0/2796850481 >> 172.21.15.39:0/2796850481 conn(0x7fa7d00ac1e0 msgr2=0x7fa7d00a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:20.482 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.476+0000 7fa7d52c1700 1 -- 172.21.15.39:0/2796850481 shutdown_connections 2020-11-20T13:56:20.482 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.476+0000 7fa7d52c1700 1 -- 172.21.15.39:0/2796850481 wait complete. 2020-11-20T13:56:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.477+0000 7fa7d52c1700 1 Processor -- start 2020-11-20T13:56:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.477+0000 7fa7d52c1700 1 -- start start 2020-11-20T13:56:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.477+0000 7fa7d52c1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d00a8a80 0x7fa7d009e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.477+0000 7fa7d52c1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 0x7fa7d0063a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.485 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.477+0000 7fa7d52c1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d013e840 0x7fa7d013b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.477+0000 7fa7d52c1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0065530 con 0x7fa7d013e840 2020-11-20T13:56:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.477+0000 7fa7d52c1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0065e70 con 0x7fa7d013bf60 2020-11-20T13:56:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.477+0000 7fa7d52c1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d009b630 con 0x7fa7d00a8a80 2020-11-20T13:56:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ce7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 0x7fa7d0063a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.486 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ce7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 0x7fa7d0063a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45062/0 (socket says 172.21.15.39:45062) 2020-11-20T13:56:20.487 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ce7fc700 1 -- 172.21.15.39:0/1628920808 learned_addr learned my addr 172.21.15.39:0/1628920808 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:20.487 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ceffd700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d00a8a80 0x7fa7d009e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.487 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7cf7fe700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d013e840 0x7fa7d013b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.487 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ce7fc700 1 -- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d00a8a80 msgr2=0x7fa7d009e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.488 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ce7fc700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d00a8a80 0x7fa7d009e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.488 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ce7fc700 1 -- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d013e840 msgr2=0x7fa7d013b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.488 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ce7fc700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d013e840 0x7fa7d013b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.488 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ce7fc700 1 -- 172.21.15.39:0/1628920808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0063f60 con 0x7fa7d013bf60 2020-11-20T13:56:20.488 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7ce7fc700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 0x7fa7d0063a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa7c4002f30 tx=0x7fa7c4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:20.488 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7bffff700 1 -- 172.21.15.39:0/1628920808 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c4011c10 con 0x7fa7d013bf60 2020-11-20T13:56:20.489 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7bffff700 1 -- 172.21.15.39:0/1628920808 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4011d70 con 0x7fa7d013bf60 2020-11-20T13:56:20.489 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d0062ca0 con 0x7fa7d013bf60 2020-11-20T13:56:20.489 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7bffff700 1 -- 172.21.15.39:0/1628920808 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c401d640 con 0x7fa7d013bf60 2020-11-20T13:56:20.489 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.478+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d00660a0 con 0x7fa7d013bf60 2020-11-20T13:56:20.489 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.479+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0057050 con 0x7fa7d013bf60 2020-11-20T13:56:20.490 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.479+0000 7fa7bffff700 1 -- 172.21.15.39:0/1628920808 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fa7c400f070 con 0x7fa7d013bf60 2020-11-20T13:56:20.490 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.480+0000 7fa7bffff700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fa7ac0512f0 0x7fa7ac0537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.490 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.480+0000 7fa7bffff700 1 -- 172.21.15.39:0/1628920808 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fa7c4069c60 con 0x7fa7d013bf60 2020-11-20T13:56:20.490 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.480+0000 7fa7ceffd700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fa7ac0512f0 0x7fa7ac0537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.490 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.480+0000 7fa7ceffd700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fa7ac0512f0 0x7fa7ac0537b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa7c800d000 tx=0x7fa7c8007cb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:20.491 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.483+0000 7fa7bffff700 1 -- 172.21.15.39:0/1628920808 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fa7c4042090 con 0x7fa7d013bf60 2020-11-20T13:56:20.720 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.719+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fa7d006a5c0 con 0x7fa7d013bf60 2020-11-20T13:56:20.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.726+0000 7fa7bffff700 1 -- 172.21.15.39:0/1628920808 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 187+0+0 (secure 0 0 0) 0x7fa7c4022070 con 0x7fa7d013bf60 2020-11-20T13:56:20.734 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.730+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fa7ac0512f0 msgr2=0x7fa7ac0537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.735 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.730+0000 7fa7d52c1700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fa7ac0512f0 0x7fa7ac0537b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa7c800d000 tx=0x7fa7c8007cb0).stop 2020-11-20T13:56:20.735 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.730+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 msgr2=0x7fa7d0063a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.735 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.730+0000 7fa7d52c1700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 0x7fa7d0063a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa7c4002f30 tx=0x7fa7c4015000).stop 2020-11-20T13:56:20.735 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.732+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 shutdown_connections 2020-11-20T13:56:20.735 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.732+0000 7fa7d52c1700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fa7ac0512f0 0x7fa7ac0537b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.736 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.732+0000 7fa7d52c1700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7d013e840 0x7fa7d013b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.736 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.732+0000 7fa7d52c1700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa7d00a8a80 0x7fa7d009e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.736 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.732+0000 7fa7d52c1700 1 --2- 172.21.15.39:0/1628920808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7d013bf60 0x7fa7d0063a70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.736 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.732+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 >> 172.21.15.39:0/1628920808 conn(0x7fa7d00ac1e0 msgr2=0x7fa7d00a2850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:20.736 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.733+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 shutdown_connections 2020-11-20T13:56:20.737 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.733+0000 7fa7d52c1700 1 -- 172.21.15.39:0/1628920808 wait complete. 2020-11-20T13:56:20.740 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 3 and data pool 4 2020-11-20T13:56:20.750 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-20T13:56:20.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.864+0000 7f39e8f26700 1 Processor -- start 2020-11-20T13:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.864+0000 7f39e8f26700 1 -- start start 2020-11-20T13:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e8f26700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39e40a8a80 0x7f39e40a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e8f26700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39e40a4870 0x7f39e40a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e8f26700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e40a3fa0 con 0x7f39e40a2f70 2020-11-20T13:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e8f26700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e40a0270 con 0x7f39e40a8a80 2020-11-20T13:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e8f26700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e40a59b0 con 0x7f39e40a4870 2020-11-20T13:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e1d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39e40a4870 0x7f39e40a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e1d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39e40a4870 0x7f39e40a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45078/0 (socket says 172.21.15.39:45078) 2020-11-20T13:56:20.872 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e1d9b700 1 -- 172.21.15.39:0/1583649178 learned_addr learned my addr 172.21.15.39:0/1583649178 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e2d9d700 1 --1- 172.21.15.39:0/1583649178 >> v1:172.21.15.39:6789/0 conn(0x7f39e40a2f70 0x7f39e40a33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35254/0 (socket says 172.21.15.39:35254) 2020-11-20T13:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e259c700 1 --2- 172.21.15.39:0/1583649178 >> v2:172.21.15.31:3300/0 conn(0x7f39e40a8a80 0x7f39e40a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.873 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e1d9b700 1 -- 172.21.15.39:0/1583649178 >> v2:172.21.15.31:3300/0 conn(0x7f39e40a8a80 msgr2=0x7f39e40a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:20.874 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e1d9b700 1 --2- 172.21.15.39:0/1583649178 >> v2:172.21.15.31:3300/0 conn(0x7f39e40a8a80 0x7f39e40a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.874 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e1d9b700 1 -- 172.21.15.39:0/1583649178 >> v1:172.21.15.39:6789/0 conn(0x7f39e40a2f70 legacy=0x7f39e40a33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.874 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e1d9b700 1 -- 172.21.15.39:0/1583649178 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e40a41d0 con 0x7f39e40a4870 2020-11-20T13:56:20.875 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e259c700 1 --2- 172.21.15.39:0/1583649178 >> v2:172.21.15.31:3300/0 conn(0x7f39e40a8a80 0x7f39e40a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:20.875 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e159a700 1 -- 172.21.15.39:0/1583649178 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637129797 0 0) 0x7f39e40a3fa0 con 0x7f39e40a2f70 2020-11-20T13:56:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e1d9b700 1 --2- 172.21.15.39:0/1583649178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 0x7f39e40a2a80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f39d4002f30 tx=0x7f39d4006e80).ready entity=mon.1 client_cookie=8f2e8cdcb58beba6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.865+0000 7f39e159a700 1 -- 172.21.15.39:0/1583649178 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39d40097f0 con 0x7f39e40a4870 2020-11-20T13:56:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e159a700 1 -- 172.21.15.39:0/1583649178 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d4009950 con 0x7f39e40a4870 2020-11-20T13:56:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e159a700 1 -- 172.21.15.39:0/1583649178 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39d4009cb0 con 0x7f39e40a4870 2020-11-20T13:56:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e8f26700 1 -- 172.21.15.39:0/1583649178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 msgr2=0x7f39e40a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e8f26700 1 --2- 172.21.15.39:0/1583649178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 0x7f39e40a2a80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f39d4002f30 tx=0x7f39d4006e80).stop 2020-11-20T13:56:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e8f26700 1 -- 172.21.15.39:0/1583649178 shutdown_connections 2020-11-20T13:56:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e8f26700 1 --2- 172.21.15.39:0/1583649178 >> v2:172.21.15.31:3300/0 conn(0x7f39e40a8a80 0x7f39e40a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e8f26700 1 --2- 172.21.15.39:0/1583649178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 0x7f39e40a2a80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e8f26700 1 -- 172.21.15.39:0/1583649178 >> 172.21.15.39:0/1583649178 conn(0x7f39e40ac1e0 msgr2=0x7f39e40a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e8f26700 1 -- 172.21.15.39:0/1583649178 shutdown_connections 2020-11-20T13:56:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.866+0000 7f39e8f26700 1 -- 172.21.15.39:0/1583649178 wait complete. 2020-11-20T13:56:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.867+0000 7f39e8f26700 1 Processor -- start 2020-11-20T13:56:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.867+0000 7f39e8f26700 1 -- start start 2020-11-20T13:56:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e8f26700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39e40a2f70 0x7f39e4061e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.879 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e8f26700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 0x7f39e4136160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e8f26700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39e40a8a80 0x7f39e4135490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e8f26700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e409b630 con 0x7f39e40a8a80 2020-11-20T13:56:20.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e8f26700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40622f0 con 0x7f39e40a4870 2020-11-20T13:56:20.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e8f26700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4137400 con 0x7f39e40a2f70 2020-11-20T13:56:20.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 0x7f39e4136160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 0x7f39e4136160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45086/0 (socket says 172.21.15.39:45086) 2020-11-20T13:56:20.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e1d9b700 1 -- 172.21.15.39:0/257211765 learned_addr learned my addr 172.21.15.39:0/257211765 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:20.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e259c700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39e40a2f70 0x7f39e4061e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e2d9d700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39e40a8a80 0x7f39e4135490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e1d9b700 1 -- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39e40a2f70 msgr2=0x7f39e4061e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e1d9b700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39e40a2f70 0x7f39e4061e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e1d9b700 1 -- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39e40a8a80 msgr2=0x7f39e4135490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:20.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e1d9b700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39e40a8a80 0x7f39e4135490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:20.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e1d9b700 1 -- 172.21.15.39:0/257211765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e41376a0 con 0x7f39e40a4870 2020-11-20T13:56:20.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e2d9d700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39e40a8a80 0x7f39e4135490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:20.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e1d9b700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 0x7f39e4136160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f39d4002f30 tx=0x7f39d4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:20.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39d37fe700 1 -- 172.21.15.39:0/257211765 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39d4009e60 con 0x7f39e40a4870 2020-11-20T13:56:20.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39d37fe700 1 -- 172.21.15.39:0/257211765 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d4009c50 con 0x7f39e40a4870 2020-11-20T13:56:20.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e409cd80 con 0x7f39e40a4870 2020-11-20T13:56:20.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39d37fe700 1 -- 172.21.15.39:0/257211765 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39d401e650 con 0x7f39e40a4870 2020-11-20T13:56:20.884 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.868+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e4136650 con 0x7f39e40a4870 2020-11-20T13:56:20.884 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.869+0000 7f39d37fe700 1 -- 172.21.15.39:0/257211765 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f39d4025030 con 0x7f39e40a4870 2020-11-20T13:56:20.885 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.869+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e4057050 con 0x7f39e40a4870 2020-11-20T13:56:20.885 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.870+0000 7f39d37fe700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39c00511d0 0x7f39c0053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:20.885 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.870+0000 7f39d37fe700 1 -- 172.21.15.39:0/257211765 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f39d406a2e0 con 0x7f39e40a4870 2020-11-20T13:56:20.885 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.870+0000 7f39e259c700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39c00511d0 0x7f39c0053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:20.885 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.870+0000 7f39e259c700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39c00511d0 0x7f39c0053690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f39d800c000 tx=0x7f39d8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:20.886 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:20.873+0000 7f39d37fe700 1 -- 172.21.15.39:0/257211765 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f39d40426e0 con 0x7f39e40a4870 2020-11-20T13:56:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.033+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39e40a8e60 con 0x7f39e40a4870 2020-11-20T13:56:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.034+0000 7f39d37fe700 1 -- 172.21.15.39:0/257211765 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f39d4023020 con 0x7f39e40a4870 2020-11-20T13:56:21.035 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:21.035 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":21,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:20.721052+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T13:56:15.768689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T13:56:18.856235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T13:56:19.656250+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39c00511d0 msgr2=0x7f39c0053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39c00511d0 0x7f39c0053690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f39d800c000 tx=0x7f39d8008040).stop 2020-11-20T13:56:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 msgr2=0x7f39e4136160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 0x7f39e4136160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f39d4002f30 tx=0x7f39d4015000).stop 2020-11-20T13:56:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 shutdown_connections 2020-11-20T13:56:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39c00511d0 0x7f39c0053690 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39e40a8a80 0x7f39e4135490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39e40a2f70 0x7f39e4061e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 --2- 172.21.15.39:0/257211765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e40a4870 0x7f39e4136160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 >> 172.21.15.39:0/257211765 conn(0x7f39e40ac1e0 msgr2=0x7f39e40a69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 shutdown_connections 2020-11-20T13:56:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.035+0000 7f39e8f26700 1 -- 172.21.15.39:0/257211765 wait complete. 2020-11-20T13:56:21.047 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-20T13:56:21.168 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.161+0000 7f7bcbcd9700 1 Processor -- start 2020-11-20T13:56:21.168 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.161+0000 7f7bcbcd9700 1 -- start start 2020-11-20T13:56:21.169 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bcbcd9700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7bc40a8a80 0x7f7bc40a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.169 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bcbcd9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a4870 0x7f7bc40a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.169 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bcbcd9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7bc40a2f70 0x7f7bc40a3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.170 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bcbcd9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40a3fa0 con 0x7f7bc40a2f70 2020-11-20T13:56:21.170 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bcbcd9700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40a41d0 con 0x7f7bc40a8a80 2020-11-20T13:56:21.171 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bcbcd9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40a0270 con 0x7f7bc40a4870 2020-11-20T13:56:21.171 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bc9a75700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7bc40a8a80 0x7f7bc40a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.171 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bc9a75700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7bc40a8a80 0x7f7bc40a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45092/0 (socket says 172.21.15.39:45092) 2020-11-20T13:56:21.171 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bc9a75700 1 -- 172.21.15.39:0/2184138604 learned_addr learned my addr 172.21.15.39:0/2184138604 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:21.172 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bca276700 1 --2- 172.21.15.39:0/2184138604 >> v2:172.21.15.31:3300/0 conn(0x7f7bc40a2f70 0x7f7bc40a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.172 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.162+0000 7f7bc9274700 1 --2- 172.21.15.39:0/2184138604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a4870 0x7f7bc40a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.172 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bc9a75700 1 -- 172.21.15.39:0/2184138604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a4870 msgr2=0x7f7bc40a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:21.172 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bc9a75700 1 --2- 172.21.15.39:0/2184138604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a4870 0x7f7bc40a2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.172 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bc9a75700 1 -- 172.21.15.39:0/2184138604 >> v2:172.21.15.31:3300/0 conn(0x7f7bc40a2f70 msgr2=0x7f7bc40a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:21.173 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bc9a75700 1 --2- 172.21.15.39:0/2184138604 >> v2:172.21.15.31:3300/0 conn(0x7f7bc40a2f70 0x7f7bc40a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.173 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bc9a75700 1 -- 172.21.15.39:0/2184138604 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40a59b0 con 0x7f7bc40a8a80 2020-11-20T13:56:21.173 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bca276700 1 --2- 172.21.15.39:0/2184138604 >> v2:172.21.15.31:3300/0 conn(0x7f7bc40a2f70 0x7f7bc40a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:21.173 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bc9a75700 1 --2- 172.21.15.39:0/2184138604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a8a80 0x7f7bc40a4380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7bb8002f30 tx=0x7f7bb8006e80).ready entity=mon.1 client_cookie=7a6f1d904041431a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:21.174 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bc8a73700 1 -- 172.21.15.39:0/2184138604 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb80099e0 con 0x7f7bc40a8a80 2020-11-20T13:56:21.174 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bc8a73700 1 -- 172.21.15.39:0/2184138604 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb8009b40 con 0x7f7bc40a8a80 2020-11-20T13:56:21.174 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bc8a73700 1 -- 172.21.15.39:0/2184138604 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb8009ea0 con 0x7f7bc40a8a80 2020-11-20T13:56:21.174 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/2184138604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a8a80 msgr2=0x7f7bc40a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.174 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/2184138604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a8a80 0x7f7bc40a4380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7bb8002f30 tx=0x7f7bb8006e80).stop 2020-11-20T13:56:21.175 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/2184138604 shutdown_connections 2020-11-20T13:56:21.175 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/2184138604 >> v2:172.21.15.31:3300/0 conn(0x7f7bc40a2f70 0x7f7bc40a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.175 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/2184138604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a8a80 0x7f7bc40a4380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.175 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/2184138604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a4870 0x7f7bc40a2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.175 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/2184138604 >> 172.21.15.39:0/2184138604 conn(0x7f7bc40ac1e0 msgr2=0x7f7bc40a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:21.176 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/2184138604 shutdown_connections 2020-11-20T13:56:21.176 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.163+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/2184138604 wait complete. 2020-11-20T13:56:21.176 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.164+0000 7f7bcbcd9700 1 Processor -- start 2020-11-20T13:56:21.176 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.164+0000 7f7bcbcd9700 1 -- start start 2020-11-20T13:56:21.176 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bcbcd9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a2f70 0x7f7bc4143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.177 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bcbcd9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bc40a4870 0x7f7bc4063040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.177 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bcbcd9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a8a80 0x7f7bc4063530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.177 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bcbcd9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc409dd00 con 0x7f7bc40a4870 2020-11-20T13:56:21.177 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bcbcd9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc41443b0 con 0x7f7bc40a2f70 2020-11-20T13:56:21.177 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bcbcd9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4144650 con 0x7f7bc40a8a80 2020-11-20T13:56:21.178 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9a75700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a2f70 0x7f7bc4143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.178 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9a75700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a2f70 0x7f7bc4143d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45098/0 (socket says 172.21.15.39:45098) 2020-11-20T13:56:21.178 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9a75700 1 -- 172.21.15.39:0/702686979 learned_addr learned my addr 172.21.15.39:0/702686979 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:21.178 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9274700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bc40a4870 0x7f7bc4063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.179 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bca276700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a8a80 0x7f7bc4063530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.179 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9a75700 1 -- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a8a80 msgr2=0x7f7bc4063530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.179 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9a75700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a8a80 0x7f7bc4063530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.179 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9a75700 1 -- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bc40a4870 msgr2=0x7f7bc4063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9a75700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bc40a4870 0x7f7bc4063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9a75700 1 -- 172.21.15.39:0/702686979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc41448f0 con 0x7f7bc40a2f70 2020-11-20T13:56:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9274700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bc40a4870 0x7f7bc4063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.165+0000 7f7bc9a75700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a2f70 0x7f7bc4143d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7bb8002f30 tx=0x7f7bb8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:21.187 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.166+0000 7f7bb6ffd700 1 -- 172.21.15.39:0/702686979 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb8020070 con 0x7f7bc40a2f70 2020-11-20T13:56:21.187 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.166+0000 7f7bb6ffd700 1 -- 172.21.15.39:0/702686979 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb8010e90 con 0x7f7bc40a2f70 2020-11-20T13:56:21.187 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.166+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc413bca0 con 0x7f7bc40a2f70 2020-11-20T13:56:21.187 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.166+0000 7f7bb6ffd700 1 -- 172.21.15.39:0/702686979 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb801a670 con 0x7f7bc40a2f70 2020-11-20T13:56:21.188 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.166+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc4065340 con 0x7f7bc40a2f70 2020-11-20T13:56:21.188 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.167+0000 7f7bb6ffd700 1 -- 172.21.15.39:0/702686979 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f7bb801a7d0 con 0x7f7bc40a2f70 2020-11-20T13:56:21.188 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.167+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc4144200 con 0x7f7bc40a2f70 2020-11-20T13:56:21.188 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.167+0000 7f7bb6ffd700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7ba4051270 0x7f7ba4053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.188 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.167+0000 7f7bb6ffd700 1 -- 172.21.15.39:0/702686979 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7bb806c260 con 0x7f7bc40a2f70 2020-11-20T13:56:21.189 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.168+0000 7f7bc9274700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7ba4051270 0x7f7ba4053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.189 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.168+0000 7f7bc9274700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7ba4051270 0x7f7ba4053730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7bc000c000 tx=0x7f7bc0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:21.190 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.171+0000 7f7bb6ffd700 1 -- 172.21.15.39:0/702686979 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f7bb8044620 con 0x7f7bc40a2f70 2020-11-20T13:56:21.334 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.332+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bc4057050 con 0x7f7bc40a2f70 2020-11-20T13:56:21.334 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.332+0000 7f7bb6ffd700 1 -- 172.21.15.39:0/702686979 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f7bb8047c40 con 0x7f7bc40a2f70 2020-11-20T13:56:21.335 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:21.335 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":21,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:20.721052+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T13:56:15.768689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T13:56:18.856235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T13:56:19.656250+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:21.336 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7ba4051270 msgr2=0x7f7ba4053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.336 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7ba4051270 0x7f7ba4053730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7bc000c000 tx=0x7f7bc0008040).stop 2020-11-20T13:56:21.336 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a2f70 msgr2=0x7f7bc4143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a2f70 0x7f7bc4143d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7bb8002f30 tx=0x7f7bb8017000).stop 2020-11-20T13:56:21.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 shutdown_connections 2020-11-20T13:56:21.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7ba4051270 0x7f7ba4053730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc40a2f70 0x7f7bc4143d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.338 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7bc40a8a80 0x7f7bc4063530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.339 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 --2- 172.21.15.39:0/702686979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7bc40a4870 0x7f7bc4063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.340 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 >> 172.21.15.39:0/702686979 conn(0x7f7bc40ac1e0 msgr2=0x7f7bc40a3370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:21.340 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 shutdown_connections 2020-11-20T13:56:21.340 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.334+0000 7f7bcbcd9700 1 -- 172.21.15.39:0/702686979 wait complete. 2020-11-20T13:56:21.347 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-11-20T13:56:21.464 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.464+0000 7f366348a700 1 Processor -- start 2020-11-20T13:56:21.465 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.464+0000 7f366348a700 1 -- start start 2020-11-20T13:56:21.467 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.464+0000 7f366348a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f365c05ce20 0x7f365c0a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.467 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.464+0000 7f366348a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f365c09f5f0 0x7f365c0a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.467 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.464+0000 7f366348a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c0a4e60 con 0x7f365c0a2310 2020-11-20T13:56:21.468 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.464+0000 7f366348a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c0a5090 con 0x7f365c09f5f0 2020-11-20T13:56:21.468 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.464+0000 7f366348a700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c0a5330 con 0x7f365c05ce20 2020-11-20T13:56:21.468 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f3661226700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f365c05ce20 0x7f365c0a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.468 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f3661226700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f365c05ce20 0x7f365c0a3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45106/0 (socket says 172.21.15.39:45106) 2020-11-20T13:56:21.468 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f3661226700 1 -- 172.21.15.39:0/950097263 learned_addr learned my addr 172.21.15.39:0/950097263 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:21.469 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f3661226700 1 -- 172.21.15.39:0/950097263 >> v2:172.21.15.31:3300/0 conn(0x7f365c09f5f0 msgr2=0x7f365c0a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:21.469 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f3660a25700 1 --2- 172.21.15.39:0/950097263 >> v2:172.21.15.31:3300/0 conn(0x7f365c09f5f0 0x7f365c0a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.469 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f3661226700 1 --2- 172.21.15.39:0/950097263 >> v2:172.21.15.31:3300/0 conn(0x7f365c09f5f0 0x7f365c0a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.469 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f3661226700 1 -- 172.21.15.39:0/950097263 >> v1:172.21.15.31:6789/0 conn(0x7f365c0a2310 legacy=0x7f365c0a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:21.470 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f3661226700 1 -- 172.21.15.39:0/950097263 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0a2d10 con 0x7f365c05ce20 2020-11-20T13:56:21.470 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f3661226700 1 --2- 172.21.15.39:0/950097263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c05ce20 0x7f365c0a3df0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f365c0a4870 tx=0x7f364c006e80).ready entity=mon.1 client_cookie=876384238f64b32e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:21.470 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f364bfff700 1 -- 172.21.15.39:0/950097263 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f364c0097b0 con 0x7f365c05ce20 2020-11-20T13:56:21.471 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f364bfff700 1 -- 172.21.15.39:0/950097263 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c009910 con 0x7f365c05ce20 2020-11-20T13:56:21.471 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f364bfff700 1 -- 172.21.15.39:0/950097263 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f364c009a80 con 0x7f365c05ce20 2020-11-20T13:56:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f366348a700 1 -- 172.21.15.39:0/950097263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c05ce20 msgr2=0x7f365c0a3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.465+0000 7f366348a700 1 --2- 172.21.15.39:0/950097263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c05ce20 0x7f365c0a3df0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f365c0a4870 tx=0x7f364c006e80).stop 2020-11-20T13:56:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.466+0000 7f366348a700 1 -- 172.21.15.39:0/950097263 shutdown_connections 2020-11-20T13:56:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.466+0000 7f366348a700 1 --2- 172.21.15.39:0/950097263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c05ce20 0x7f365c0a3df0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.466+0000 7f366348a700 1 --2- 172.21.15.39:0/950097263 >> v2:172.21.15.31:3300/0 conn(0x7f365c09f5f0 0x7f365c0a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.466+0000 7f366348a700 1 -- 172.21.15.39:0/950097263 >> 172.21.15.39:0/950097263 conn(0x7f365c0ac1e0 msgr2=0x7f365c0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.466+0000 7f366348a700 1 -- 172.21.15.39:0/950097263 shutdown_connections 2020-11-20T13:56:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.466+0000 7f366348a700 1 -- 172.21.15.39:0/950097263 wait complete. 2020-11-20T13:56:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f366348a700 1 Processor -- start 2020-11-20T13:56:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f366348a700 1 -- start start 2020-11-20T13:56:21.476 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f366348a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f365c05ce20 0x7f365c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.476 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f366348a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c09f5f0 0x7f365c1496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.476 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f366348a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365c0a2310 0x7f365c149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.477 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f366348a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c14a0b0 con 0x7f365c0a2310 2020-11-20T13:56:21.477 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f366348a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c067990 con 0x7f365c09f5f0 2020-11-20T13:56:21.477 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f366348a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c063810 con 0x7f365c05ce20 2020-11-20T13:56:21.477 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f3660a25700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c09f5f0 0x7f365c1496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f3660a25700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c09f5f0 0x7f365c1496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45112/0 (socket says 172.21.15.39:45112) 2020-11-20T13:56:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f3660a25700 1 -- 172.21.15.39:0/507873381 learned_addr learned my addr 172.21.15.39:0/507873381 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f3661226700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f365c05ce20 0x7f365c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.467+0000 7f3661a27700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365c0a2310 0x7f365c149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f3660a25700 1 -- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f365c05ce20 msgr2=0x7f365c066550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f3660a25700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f365c05ce20 0x7f365c066550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f3660a25700 1 -- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365c0a2310 msgr2=0x7f365c149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f3660a25700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365c0a2310 0x7f365c149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f3660a25700 1 -- 172.21.15.39:0/507873381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c063ab0 con 0x7f365c09f5f0 2020-11-20T13:56:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f3661a27700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365c0a2310 0x7f365c149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f3660a25700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c09f5f0 0x7f365c1496d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f365c063490 tx=0x7f3658008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f364a7fc700 1 -- 172.21.15.39:0/507873381 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f365800ce60 con 0x7f365c09f5f0 2020-11-20T13:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f364a7fc700 1 -- 172.21.15.39:0/507873381 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3658007710 con 0x7f365c09f5f0 2020-11-20T13:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f364a7fc700 1 -- 172.21.15.39:0/507873381 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3658007a70 con 0x7f365c09f5f0 2020-11-20T13:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c063d50 con 0x7f365c09f5f0 2020-11-20T13:56:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.468+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c0622d0 con 0x7f365c09f5f0 2020-11-20T13:56:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.469+0000 7f364a7fc700 1 -- 172.21.15.39:0/507873381 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f3658007bd0 con 0x7f365c09f5f0 2020-11-20T13:56:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.469+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c057050 con 0x7f365c09f5f0 2020-11-20T13:56:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.469+0000 7f364a7fc700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f363c051270 0x7f363c053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.482 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.469+0000 7f364a7fc700 1 -- 172.21.15.39:0/507873381 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f36580691c0 con 0x7f365c09f5f0 2020-11-20T13:56:21.482 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.470+0000 7f3661226700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f363c051270 0x7f363c053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.482 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.470+0000 7f3661226700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f363c051270 0x7f363c053730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f364c019000 tx=0x7f364c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:21.482 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.473+0000 7f364a7fc700 1 -- 172.21.15.39:0/507873381 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f3658041470 con 0x7f365c09f5f0 2020-11-20T13:56:21.688 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.685+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f365c09f300 con 0x7f365c09f5f0 2020-11-20T13:56:21.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.726+0000 7f364a7fc700 1 -- 172.21.15.39:0/507873381 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3658044a90 con 0x7f365c09f5f0 2020-11-20T13:56:21.729 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.727+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f363c051270 msgr2=0x7f363c053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.729 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.727+0000 7f366348a700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f363c051270 0x7f363c053730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f364c019000 tx=0x7f364c016000).stop 2020-11-20T13:56:21.730 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c09f5f0 msgr2=0x7f365c1496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.730 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c09f5f0 0x7f365c1496d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f365c063490 tx=0x7f3658008040).stop 2020-11-20T13:56:21.730 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 shutdown_connections 2020-11-20T13:56:21.730 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f363c051270 0x7f363c053730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.731 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f365c0a2310 0x7f365c149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.731 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f365c05ce20 0x7f365c066550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.731 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 --2- 172.21.15.39:0/507873381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f365c09f5f0 0x7f365c1496d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.731 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 >> 172.21.15.39:0/507873381 conn(0x7f365c0ac1e0 msgr2=0x7f365c13b930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:21.733 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 shutdown_connections 2020-11-20T13:56:21.733 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.728+0000 7f366348a700 1 -- 172.21.15.39:0/507873381 wait complete. 2020-11-20T13:56:21.743 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs session_timeout 300 2020-11-20T13:56:21.861 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.860+0000 7f65f926b700 1 Processor -- start 2020-11-20T13:56:21.861 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.860+0000 7f65f926b700 1 -- start start 2020-11-20T13:56:21.864 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f926b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f65f40a8a80 0x7f65f40a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.864 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f926b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f65f40a3190 0x7f65f40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f926b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f40a3fa0 con 0x7f65f40a4870 2020-11-20T13:56:21.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f926b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40a0270 con 0x7f65f40a8a80 2020-11-20T13:56:21.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f926b700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40a59b0 con 0x7f65f40a3190 2020-11-20T13:56:21.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f37fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f65f40a3190 0x7f65f40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.866 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f37fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f65f40a3190 0x7f65f40a35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45118/0 (socket says 172.21.15.39:45118) 2020-11-20T13:56:21.866 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f37fe700 1 -- 172.21.15.39:0/2693085450 learned_addr learned my addr 172.21.15.39:0/2693085450 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:21.867 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f2ffd700 1 --2- 172.21.15.39:0/2693085450 >> v2:172.21.15.31:3300/0 conn(0x7f65f40a8a80 0x7f65f40a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.867 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f37fe700 1 -- 172.21.15.39:0/2693085450 >> v2:172.21.15.31:3300/0 conn(0x7f65f40a8a80 msgr2=0x7f65f40a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:21.867 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f37fe700 1 --2- 172.21.15.39:0/2693085450 >> v2:172.21.15.31:3300/0 conn(0x7f65f40a8a80 0x7f65f40a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.867 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f37fe700 1 -- 172.21.15.39:0/2693085450 >> v1:172.21.15.31:6789/0 conn(0x7f65f40a4870 legacy=0x7f65f40a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:21.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.861+0000 7f65f37fe700 1 -- 172.21.15.39:0/2693085450 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f40a41d0 con 0x7f65f40a3190 2020-11-20T13:56:21.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f37fe700 1 --2- 172.21.15.39:0/2693085450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a3190 0x7f65f40a35d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f65ec0032b0 tx=0x7f65ec009270).ready entity=mon.1 client_cookie=983d08e33d33e75 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:21.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f1ffb700 1 -- 172.21.15.39:0/2693085450 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ec00bc00 con 0x7f65f40a3190 2020-11-20T13:56:21.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f1ffb700 1 -- 172.21.15.39:0/2693085450 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec00bd60 con 0x7f65f40a3190 2020-11-20T13:56:21.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f1ffb700 1 -- 172.21.15.39:0/2693085450 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ec011400 con 0x7f65f40a3190 2020-11-20T13:56:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f926b700 1 -- 172.21.15.39:0/2693085450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a3190 msgr2=0x7f65f40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f926b700 1 --2- 172.21.15.39:0/2693085450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a3190 0x7f65f40a35d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f65ec0032b0 tx=0x7f65ec009270).stop 2020-11-20T13:56:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f926b700 1 -- 172.21.15.39:0/2693085450 shutdown_connections 2020-11-20T13:56:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f926b700 1 --2- 172.21.15.39:0/2693085450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a3190 0x7f65f40a35d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f926b700 1 --2- 172.21.15.39:0/2693085450 >> v2:172.21.15.31:3300/0 conn(0x7f65f40a8a80 0x7f65f40a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f926b700 1 -- 172.21.15.39:0/2693085450 >> 172.21.15.39:0/2693085450 conn(0x7f65f40ac1e0 msgr2=0x7f65f40a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f926b700 1 -- 172.21.15.39:0/2693085450 shutdown_connections 2020-11-20T13:56:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.862+0000 7f65f926b700 1 -- 172.21.15.39:0/2693085450 wait complete. 2020-11-20T13:56:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.863+0000 7f65f926b700 1 Processor -- start 2020-11-20T13:56:21.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.863+0000 7f65f926b700 1 -- start start 2020-11-20T13:56:21.873 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f926b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65f40a3190 0x7f65f40a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.873 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f926b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a4870 0x7f65f4149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f926b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65f40a8a80 0x7f65f414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f926b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f414a880 con 0x7f65f40a8a80 2020-11-20T13:56:21.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f926b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4149920 con 0x7f65f40a4870 2020-11-20T13:56:21.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f926b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f409e4b0 con 0x7f65f40a3190 2020-11-20T13:56:21.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a4870 0x7f65f4149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a4870 0x7f65f4149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45126/0 (socket says 172.21.15.39:45126) 2020-11-20T13:56:21.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f27fc700 1 -- 172.21.15.39:0/1363212759 learned_addr learned my addr 172.21.15.39:0/1363212759 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:21.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f2ffd700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65f40a3190 0x7f65f40a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f37fe700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65f40a8a80 0x7f65f414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f27fc700 1 -- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65f40a3190 msgr2=0x7f65f40a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f27fc700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65f40a3190 0x7f65f40a6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f27fc700 1 -- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65f40a8a80 msgr2=0x7f65f414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:21.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f27fc700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65f40a8a80 0x7f65f414a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:21.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f27fc700 1 -- 172.21.15.39:0/1363212759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f409df70 con 0x7f65f40a4870 2020-11-20T13:56:21.884 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65f27fc700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a4870 0x7f65f4149ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f65f409e640 tx=0x7f65e4007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:21.890 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.864+0000 7f65e3fff700 1 -- 172.21.15.39:0/1363212759 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65e4007240 con 0x7f65f40a4870 2020-11-20T13:56:21.891 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.865+0000 7f65e3fff700 1 -- 172.21.15.39:0/1363212759 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e40073a0 con 0x7f65f40a4870 2020-11-20T13:56:21.891 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.865+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f409e210 con 0x7f65f40a4870 2020-11-20T13:56:21.891 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.865+0000 7f65e3fff700 1 -- 172.21.15.39:0/1363212759 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65e40064e0 con 0x7f65f40a4870 2020-11-20T13:56:21.891 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.865+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f409dbc0 con 0x7f65f40a4870 2020-11-20T13:56:21.891 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.865+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f4057050 con 0x7f65f40a4870 2020-11-20T13:56:21.892 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.866+0000 7f65e3fff700 1 -- 172.21.15.39:0/1363212759 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f65e4010070 con 0x7f65f40a4870 2020-11-20T13:56:21.892 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.866+0000 7f65e3fff700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f65d0051270 0x7f65d0053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:21.892 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.866+0000 7f65e3fff700 1 -- 172.21.15.39:0/1363212759 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f65e40684c0 con 0x7f65f40a4870 2020-11-20T13:56:21.892 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.866+0000 7f65f2ffd700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f65d0051270 0x7f65d0053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:21.893 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.866+0000 7f65f2ffd700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f65d0051270 0x7f65d0053730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f65e800c000 tx=0x7f65e8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:21.893 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:21.869+0000 7f65e3fff700 1 -- 172.21.15.39:0/1363212759 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f65e4040780 con 0x7f65f40a4870 2020-11-20T13:56:22.088 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.086+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f65f40a56b0 con 0x7f65f40a4870 2020-11-20T13:56:22.735 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.732+0000 7f65e3fff700 1 -- 172.21.15.39:0/1363212759 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v5) v1 ==== 115+0+0 (secure 0 0 0) 0x7f65e4018030 con 0x7f65f40a4870 2020-11-20T13:56:22.737 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.734+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f65d0051270 msgr2=0x7f65d0053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:22.737 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.734+0000 7f65f926b700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f65d0051270 0x7f65d0053730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f65e800c000 tx=0x7f65e8008040).stop 2020-11-20T13:56:22.737 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.734+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a4870 msgr2=0x7f65f4149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:22.737 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.734+0000 7f65f926b700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a4870 0x7f65f4149ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f65f409e640 tx=0x7f65e4007be0).stop 2020-11-20T13:56:22.738 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.735+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 shutdown_connections 2020-11-20T13:56:22.738 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.735+0000 7f65f926b700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f65d0051270 0x7f65d0053730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:22.738 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.735+0000 7f65f926b700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65f40a8a80 0x7f65f414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:22.738 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.735+0000 7f65f926b700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65f40a3190 0x7f65f40a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:22.739 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.735+0000 7f65f926b700 1 --2- 172.21.15.39:0/1363212759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65f40a4870 0x7f65f4149ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:22.739 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.735+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 >> 172.21.15.39:0/1363212759 conn(0x7f65f40ac1e0 msgr2=0x7f65f40a1210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:22.739 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.735+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 shutdown_connections 2020-11-20T13:56:22.739 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.735+0000 7f65f926b700 1 -- 172.21.15.39:0/1363212759 wait complete. 2020-11-20T13:56:22.748 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-11-20T13:56:22.864 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.863+0000 7f0801378700 1 Processor -- start 2020-11-20T13:56:22.864 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.863+0000 7f0801378700 1 -- start start 2020-11-20T13:56:22.866 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f0801378700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a8a80 0x7f07fc0a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:22.867 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f0801378700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07fc0a4870 0x7f07fc0a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:22.867 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f0801378700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc0a3fa0 con 0x7f07fc0a2f70 2020-11-20T13:56:22.867 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f0801378700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc0a0270 con 0x7f07fc0a4870 2020-11-20T13:56:22.867 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f0801378700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc0a59b0 con 0x7f07fc0a8a80 2020-11-20T13:56:22.867 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07fa7fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07fc0a4870 0x7f07fc0a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07fa7fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07fc0a4870 0x7f07fc0a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45136/0 (socket says 172.21.15.39:45136) 2020-11-20T13:56:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07fa7fc700 1 -- 172.21.15.39:0/3880365303 learned_addr learned my addr 172.21.15.39:0/3880365303 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07faffd700 1 --2- 172.21.15.39:0/3880365303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a8a80 0x7f07fc0a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07fa7fc700 1 -- 172.21.15.39:0/3880365303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a8a80 msgr2=0x7f07fc0a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07fa7fc700 1 --2- 172.21.15.39:0/3880365303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a8a80 0x7f07fc0a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:22.869 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07fa7fc700 1 -- 172.21.15.39:0/3880365303 >> v1:172.21.15.31:6789/0 conn(0x7f07fc0a2f70 legacy=0x7f07fc0a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:22.869 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07fa7fc700 1 -- 172.21.15.39:0/3880365303 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc0a41d0 con 0x7f07fc0a4870 2020-11-20T13:56:22.869 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07fa7fc700 1 --2- 172.21.15.39:0/3880365303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a4870 0x7f07fc0a2a80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f07ec0032b0 tx=0x7f07ec009270).ready entity=mon.1 client_cookie=3b086020d99d6c64 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:22.869 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07f9ffb700 1 -- 172.21.15.39:0/3880365303 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec009e60 con 0x7f07fc0a4870 2020-11-20T13:56:22.869 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07f9ffb700 1 -- 172.21.15.39:0/3880365303 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec00bc00 con 0x7f07fc0a4870 2020-11-20T13:56:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f07f9ffb700 1 -- 172.21.15.39:0/3880365303 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec00bd70 con 0x7f07fc0a4870 2020-11-20T13:56:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f0801378700 1 -- 172.21.15.39:0/3880365303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a4870 msgr2=0x7f07fc0a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.864+0000 7f0801378700 1 --2- 172.21.15.39:0/3880365303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a4870 0x7f07fc0a2a80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f07ec0032b0 tx=0x7f07ec009270).stop 2020-11-20T13:56:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.865+0000 7f0801378700 1 -- 172.21.15.39:0/3880365303 shutdown_connections 2020-11-20T13:56:22.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.865+0000 7f0801378700 1 --2- 172.21.15.39:0/3880365303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a8a80 0x7f07fc0a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:22.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.865+0000 7f0801378700 1 --2- 172.21.15.39:0/3880365303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a4870 0x7f07fc0a2a80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:22.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.865+0000 7f0801378700 1 -- 172.21.15.39:0/3880365303 >> 172.21.15.39:0/3880365303 conn(0x7f07fc0ac1e0 msgr2=0x7f07fc0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:22.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.865+0000 7f0801378700 1 -- 172.21.15.39:0/3880365303 shutdown_connections 2020-11-20T13:56:22.871 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.865+0000 7f0801378700 1 -- 172.21.15.39:0/3880365303 wait complete. 2020-11-20T13:56:22.872 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.866+0000 7f0801378700 1 Processor -- start 2020-11-20T13:56:22.872 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.866+0000 7f0801378700 1 -- start start 2020-11-20T13:56:22.874 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f0801378700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07fc0a2f70 0x7f07fc066210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:22.875 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f0801378700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a4870 0x7f07fc1363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:22.877 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f0801378700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a8a80 0x7f07fc1368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:22.877 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f0801378700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc09d290 con 0x7f07fc0a2f70 2020-11-20T13:56:22.877 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f0801378700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc09b630 con 0x7f07fc0a8a80 2020-11-20T13:56:22.878 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f0801378700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc09dcc0 con 0x7f07fc0a4870 2020-11-20T13:56:22.878 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a8a80 0x7f07fc1368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:22.878 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a8a80 0x7f07fc1368c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45142/0 (socket says 172.21.15.39:45142) 2020-11-20T13:56:22.878 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fb7fe700 1 -- 172.21.15.39:0/2067812353 learned_addr learned my addr 172.21.15.39:0/2067812353 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:22.879 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07faffd700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07fc0a2f70 0x7f07fc066210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:22.879 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fa7fc700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a4870 0x7f07fc1363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:22.879 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fb7fe700 1 -- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a4870 msgr2=0x7f07fc1363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:22.879 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fb7fe700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a4870 0x7f07fc1363d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:22.879 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fb7fe700 1 -- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07fc0a2f70 msgr2=0x7f07fc066210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:22.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fb7fe700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07fc0a2f70 0x7f07fc066210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:22.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fb7fe700 1 -- 172.21.15.39:0/2067812353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc066700 con 0x7f07fc0a8a80 2020-11-20T13:56:22.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07fb7fe700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a8a80 0x7f07fc1368c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f07fc060b30 tx=0x7f07f4007b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:22.880 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07ebfff700 1 -- 172.21.15.39:0/2067812353 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f4013410 con 0x7f07fc0a8a80 2020-11-20T13:56:22.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07ebfff700 1 -- 172.21.15.39:0/2067812353 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f4013570 con 0x7f07fc0a8a80 2020-11-20T13:56:22.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f07ebfff700 1 -- 172.21.15.39:0/2067812353 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f40138d0 con 0x7f07fc0a8a80 2020-11-20T13:56:22.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07fc136db0 con 0x7f07fc0a8a80 2020-11-20T13:56:22.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.867+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc13bae0 con 0x7f07fc0a8a80 2020-11-20T13:56:22.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.868+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc09bc70 con 0x7f07fc0a8a80 2020-11-20T13:56:22.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.868+0000 7f07ebfff700 1 -- 172.21.15.39:0/2067812353 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f07f4010030 con 0x7f07fc0a8a80 2020-11-20T13:56:22.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.869+0000 7f07ebfff700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f07d8051280 0x7f07d8053740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:22.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.869+0000 7f07ebfff700 1 -- 172.21.15.39:0/2067812353 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f07f4068c20 con 0x7f07fc0a8a80 2020-11-20T13:56:22.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.869+0000 7f07faffd700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f07d8051280 0x7f07d8053740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:22.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.869+0000 7f07faffd700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f07d8051280 0x7f07d8053740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f07f000b000 tx=0x7f07f0006dc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:22.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:22.872+0000 7f07ebfff700 1 -- 172.21.15.39:0/2067812353 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f07f4040fe0 con 0x7f07fc0a8a80 2020-11-20T13:56:23.089 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.085+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07fc057050 con 0x7f07fc0a8a80 2020-11-20T13:56:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.085+0000 7f07ebfff700 1 -- 172.21.15.39:0/2067812353 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2129 (secure 0 0 0) 0x7f07f4044600 con 0x7f07fc0a8a80 2020-11-20T13:56:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.086+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f07d8051280 msgr2=0x7f07d8053740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.086+0000 7f0801378700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f07d8051280 0x7f07d8053740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f07f000b000 tx=0x7f07f0006dc0).stop 2020-11-20T13:56:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.086+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a8a80 msgr2=0x7f07fc1368c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.086+0000 7f0801378700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a8a80 0x7f07fc1368c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f07fc060b30 tx=0x7f07f4007b00).stop 2020-11-20T13:56:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.087+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 shutdown_connections 2020-11-20T13:56:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.087+0000 7f0801378700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f07d8051280 0x7f07d8053740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.087+0000 7f0801378700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07fc0a8a80 0x7f07fc1368c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.087+0000 7f0801378700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07fc0a2f70 0x7f07fc066210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.087+0000 7f0801378700 1 --2- 172.21.15.39:0/2067812353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07fc0a4870 0x7f07fc1363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.087+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 >> 172.21.15.39:0/2067812353 conn(0x7f07fc0ac1e0 msgr2=0x7f07fc0a3370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.087+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 shutdown_connections 2020-11-20T13:56:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.087+0000 7f0801378700 1 -- 172.21.15.39:0/2067812353 wait complete. 2020-11-20T13:56:23.093 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 5 2020-11-20T13:56:23.093 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:23.093 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/3919208998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3919208998},{"type":"v1","addr":"172.21.15.31:6835","nonce":3919208998}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T13:56:20.721257+0000","modified":"2020-11-20T13:56:22.730017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.39:6833/38159747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":38159747},{"type":"v1","addr":"172.21.15.39:6833","nonce":38159747}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T13:56:23.098 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-20T13:56:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.211+0000 7f3d04dfd700 1 Processor -- start 2020-11-20T13:56:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.211+0000 7f3d04dfd700 1 -- start start 2020-11-20T13:56:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3d04dfd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3d0013bf60 0x7f3d0013e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3d04dfd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013e840 0x7f3d00140c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3d04dfd700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000a3fa0 con 0x7f3d000a8a80 2020-11-20T13:56:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3d04dfd700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d000a0270 con 0x7f3d0013bf60 2020-11-20T13:56:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3d04dfd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000a59b0 con 0x7f3d0013e840 2020-11-20T13:56:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3cfdd9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3d0013bf60 0x7f3d0013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3cfe59c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3d000a8a80 0x7f3d000a4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35318/0 (socket says 172.21.15.39:35318) 2020-11-20T13:56:23.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3cfe59c700 1 -- 172.21.15.39:0/563458530 learned_addr learned my addr 172.21.15.39:0/563458530 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:23.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3cfed9d700 1 --2- 172.21.15.39:0/563458530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013e840 0x7f3d00140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3cfdd9b700 1 -- 172.21.15.39:0/563458530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013e840 msgr2=0x7f3d00140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:23.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3cfdd9b700 1 --2- 172.21.15.39:0/563458530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013e840 0x7f3d00140c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3cfdd9b700 1 -- 172.21.15.39:0/563458530 >> v1:172.21.15.39:6789/0 conn(0x7f3d000a8a80 legacy=0x7f3d000a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3cfd59a700 1 -- 172.21.15.39:0/563458530 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445415959 0 0) 0x7f3d000a3fa0 con 0x7f3d000a8a80 2020-11-20T13:56:23.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.212+0000 7f3cfdd9b700 1 -- 172.21.15.39:0/563458530 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000a41d0 con 0x7f3d0013bf60 2020-11-20T13:56:23.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3cfdd9b700 1 --2- 172.21.15.39:0/563458530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d0013bf60 0x7f3d0013e350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3cf00032b0 tx=0x7f3cf00091a0).ready entity=mon.1 client_cookie=cad216e0a272deed server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:23.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3cfd59a700 1 -- 172.21.15.39:0/563458530 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cf000ba50 con 0x7f3d0013bf60 2020-11-20T13:56:23.218 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3cfd59a700 1 -- 172.21.15.39:0/563458530 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf000bbb0 con 0x7f3d0013bf60 2020-11-20T13:56:23.218 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3cfd59a700 1 -- 172.21.15.39:0/563458530 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cf000bd20 con 0x7f3d0013bf60 2020-11-20T13:56:23.218 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3d04dfd700 1 -- 172.21.15.39:0/563458530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d0013bf60 msgr2=0x7f3d0013e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.218 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3d04dfd700 1 --2- 172.21.15.39:0/563458530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d0013bf60 0x7f3d0013e350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3cf00032b0 tx=0x7f3cf00091a0).stop 2020-11-20T13:56:23.218 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3d04dfd700 1 -- 172.21.15.39:0/563458530 shutdown_connections 2020-11-20T13:56:23.219 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3d04dfd700 1 --2- 172.21.15.39:0/563458530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013e840 0x7f3d00140c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.219 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3d04dfd700 1 --2- 172.21.15.39:0/563458530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d0013bf60 0x7f3d0013e350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.219 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3d04dfd700 1 -- 172.21.15.39:0/563458530 >> 172.21.15.39:0/563458530 conn(0x7f3d000ac1e0 msgr2=0x7f3d000a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:23.219 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3d04dfd700 1 -- 172.21.15.39:0/563458530 shutdown_connections 2020-11-20T13:56:23.219 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.213+0000 7f3d04dfd700 1 -- 172.21.15.39:0/563458530 wait complete. 2020-11-20T13:56:23.222 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.214+0000 7f3d04dfd700 1 Processor -- start 2020-11-20T13:56:23.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.214+0000 7f3d04dfd700 1 -- start start 2020-11-20T13:56:23.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3d04dfd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d000a8a80 0x7f3d0013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3d04dfd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013bf60 0x7f3d00137910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3d04dfd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d0013e840 0x7f3d00137e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3d04dfd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d001382f0 con 0x7f3d0013e840 2020-11-20T13:56:23.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3d04dfd700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0014a350 con 0x7f3d000a8a80 2020-11-20T13:56:23.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3d04dfd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00141ed0 con 0x7f3d0013bf60 2020-11-20T13:56:23.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfe59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d000a8a80 0x7f3d0013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfe59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d000a8a80 0x7f3d0013f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45152/0 (socket says 172.21.15.39:45152) 2020-11-20T13:56:23.225 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfe59c700 1 -- 172.21.15.39:0/2799764415 learned_addr learned my addr 172.21.15.39:0/2799764415 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:23.225 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfdd9b700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013bf60 0x7f3d00137910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.225 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfe59c700 1 -- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013bf60 msgr2=0x7f3d00137910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.225 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfed9d700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d0013e840 0x7f3d00137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.225 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfe59c700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013bf60 0x7f3d00137910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.226 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfe59c700 1 -- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d0013e840 msgr2=0x7f3d00137e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.226 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfe59c700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d0013e840 0x7f3d00137e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.226 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfe59c700 1 -- 172.21.15.39:0/2799764415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00149970 con 0x7f3d000a8a80 2020-11-20T13:56:23.226 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfed9d700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d0013e840 0x7f3d00137e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:23.227 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfdd9b700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013bf60 0x7f3d00137910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:23.227 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cfe59c700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d000a8a80 0x7f3d0013f620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3ce8000e90 tx=0x7f3ce80079f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:23.227 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.215+0000 7f3cf77fe700 1 -- 172.21.15.39:0/2799764415 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ce8007320 con 0x7f3d000a8a80 2020-11-20T13:56:23.227 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.216+0000 7f3cf77fe700 1 -- 172.21.15.39:0/2799764415 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8007480 con 0x7f3d000a8a80 2020-11-20T13:56:23.227 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.216+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d00149c10 con 0x7f3d000a8a80 2020-11-20T13:56:23.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.216+0000 7f3cf77fe700 1 -- 172.21.15.39:0/2799764415 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ce80057d0 con 0x7f3d000a8a80 2020-11-20T13:56:23.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.216+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d001494d0 con 0x7f3d000a8a80 2020-11-20T13:56:23.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.217+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d001497e0 con 0x7f3d000a8a80 2020-11-20T13:56:23.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.217+0000 7f3cf77fe700 1 -- 172.21.15.39:0/2799764415 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f3ce8010030 con 0x7f3d000a8a80 2020-11-20T13:56:23.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.217+0000 7f3cf77fe700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3ce40511d0 0x7f3ce4053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.217+0000 7f3cf77fe700 1 -- 172.21.15.39:0/2799764415 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3ce8068cf0 con 0x7f3d000a8a80 2020-11-20T13:56:23.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.217+0000 7f3cfdd9b700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3ce40511d0 0x7f3ce4053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.218+0000 7f3cfdd9b700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3ce40511d0 0x7f3ce4053690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3cf0017000 tx=0x7f3cf0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:23.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.221+0000 7f3cf77fe700 1 -- 172.21.15.39:0/2799764415 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f3ce8041050 con 0x7f3d000a8a80 2020-11-20T13:56:23.382 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.381+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d0014a070 con 0x7f3d000a8a80 2020-11-20T13:56:23.383 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.382+0000 7f3cf77fe700 1 -- 172.21.15.39:0/2799764415 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f3ce8044670 con 0x7f3d000a8a80 2020-11-20T13:56:23.383 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:23.383 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":23,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:23.331627+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T13:56:15.768689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T13:56:18.856235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T13:56:19.656250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3ce40511d0 msgr2=0x7f3ce4053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3ce40511d0 0x7f3ce4053690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3cf0017000 tx=0x7f3cf0016000).stop 2020-11-20T13:56:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d000a8a80 msgr2=0x7f3d0013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d000a8a80 0x7f3d0013f620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3ce8000e90 tx=0x7f3ce80079f0).stop 2020-11-20T13:56:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 shutdown_connections 2020-11-20T13:56:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3ce40511d0 0x7f3ce4053690 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d000a8a80 0x7f3d0013f620 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d0013e840 0x7f3d00137e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 --2- 172.21.15.39:0/2799764415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3d0013bf60 0x7f3d00137910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 >> 172.21.15.39:0/2799764415 conn(0x7f3d000ac1e0 msgr2=0x7f3d000aa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 shutdown_connections 2020-11-20T13:56:23.388 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.384+0000 7f3d04dfd700 1 -- 172.21.15.39:0/2799764415 wait complete. 2020-11-20T13:56:23.398 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-20T13:56:23.399 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-20T13:56:23.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.512+0000 7f39c7a58700 1 Processor -- start 2020-11-20T13:56:23.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.512+0000 7f39c7a58700 1 -- start start 2020-11-20T13:56:23.516 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c7a58700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39c005ce20 0x7f39c00a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.516 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c7a58700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39c013df70 0x7f39c0140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.516 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c7a58700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c00a2d10 con 0x7f39c009f5f0 2020-11-20T13:56:23.516 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c7a58700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c00a5090 con 0x7f39c013df70 2020-11-20T13:56:23.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c7a58700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c00a5330 con 0x7f39c005ce20 2020-11-20T13:56:23.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c57f4700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39c005ce20 0x7f39c00a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c57f4700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39c005ce20 0x7f39c00a3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45160/0 (socket says 172.21.15.39:45160) 2020-11-20T13:56:23.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c57f4700 1 -- 172.21.15.39:0/3354382826 learned_addr learned my addr 172.21.15.39:0/3354382826 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:23.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c5ff5700 1 --2- 172.21.15.39:0/3354382826 >> v2:172.21.15.31:3300/0 conn(0x7f39c013df70 0x7f39c0140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c57f4700 1 -- 172.21.15.39:0/3354382826 >> v2:172.21.15.31:3300/0 conn(0x7f39c013df70 msgr2=0x7f39c0140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:23.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.513+0000 7f39c57f4700 1 --2- 172.21.15.39:0/3354382826 >> v2:172.21.15.31:3300/0 conn(0x7f39c013df70 0x7f39c0140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c57f4700 1 -- 172.21.15.39:0/3354382826 >> v1:172.21.15.31:6789/0 conn(0x7f39c009f5f0 legacy=0x7f39c00a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c57f4700 1 -- 172.21.15.39:0/3354382826 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c00a2f40 con 0x7f39c005ce20 2020-11-20T13:56:23.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c5ff5700 1 --2- 172.21.15.39:0/3354382826 >> v2:172.21.15.31:3300/0 conn(0x7f39c013df70 0x7f39c0140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c57f4700 1 --2- 172.21.15.39:0/3354382826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 0x7f39c00a3df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f39b4002f30 tx=0x7f39b4006e80).ready entity=mon.1 client_cookie=3ee1429572308383 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39b3fff700 1 -- 172.21.15.39:0/3354382826 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39b40097f0 con 0x7f39c005ce20 2020-11-20T13:56:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39b3fff700 1 -- 172.21.15.39:0/3354382826 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4009950 con 0x7f39c005ce20 2020-11-20T13:56:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39b3fff700 1 -- 172.21.15.39:0/3354382826 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39b4009cb0 con 0x7f39c005ce20 2020-11-20T13:56:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c7a58700 1 -- 172.21.15.39:0/3354382826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 msgr2=0x7f39c00a3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c7a58700 1 --2- 172.21.15.39:0/3354382826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 0x7f39c00a3df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f39b4002f30 tx=0x7f39b4006e80).stop 2020-11-20T13:56:23.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c7a58700 1 -- 172.21.15.39:0/3354382826 shutdown_connections 2020-11-20T13:56:23.522 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c7a58700 1 --2- 172.21.15.39:0/3354382826 >> v2:172.21.15.31:3300/0 conn(0x7f39c013df70 0x7f39c0140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.523 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c7a58700 1 --2- 172.21.15.39:0/3354382826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 0x7f39c00a3df0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.523 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c7a58700 1 -- 172.21.15.39:0/3354382826 >> 172.21.15.39:0/3354382826 conn(0x7f39c00ac1e0 msgr2=0x7f39c00a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:23.523 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c7a58700 1 -- 172.21.15.39:0/3354382826 shutdown_connections 2020-11-20T13:56:23.523 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.514+0000 7f39c7a58700 1 -- 172.21.15.39:0/3354382826 wait complete. 2020-11-20T13:56:23.523 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.515+0000 7f39c7a58700 1 Processor -- start 2020-11-20T13:56:23.524 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.515+0000 7f39c7a58700 1 -- start start 2020-11-20T13:56:23.526 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c7a58700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 0x7f39c00643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.526 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c7a58700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39c009f5f0 0x7f39c0139c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.527 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c7a58700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39c013df70 0x7f39c013a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.527 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c7a58700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c013c270 con 0x7f39c009f5f0 2020-11-20T13:56:23.527 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c7a58700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c008f460 con 0x7f39c005ce20 2020-11-20T13:56:23.527 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c7a58700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c013a920 con 0x7f39c013df70 2020-11-20T13:56:23.527 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c57f4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 0x7f39c00643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.528 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c57f4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 0x7f39c00643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45166/0 (socket says 172.21.15.39:45166) 2020-11-20T13:56:23.528 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c57f4700 1 -- 172.21.15.39:0/2014237046 learned_addr learned my addr 172.21.15.39:0/2014237046 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:23.528 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c4ff3700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39c009f5f0 0x7f39c0139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.528 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c5ff5700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39c013df70 0x7f39c013a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.528 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c57f4700 1 -- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39c013df70 msgr2=0x7f39c013a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c57f4700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39c013df70 0x7f39c013a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c57f4700 1 -- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39c009f5f0 msgr2=0x7f39c0139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c57f4700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39c009f5f0 0x7f39c0139c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c57f4700 1 -- 172.21.15.39:0/2014237046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c008f6c0 con 0x7f39c005ce20 2020-11-20T13:56:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.516+0000 7f39c57f4700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 0x7f39c00643a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f39b4002f30 tx=0x7f39b4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:23.530 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.517+0000 7f39b27fc700 1 -- 172.21.15.39:0/2014237046 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39b401e460 con 0x7f39c005ce20 2020-11-20T13:56:23.530 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.517+0000 7f39b27fc700 1 -- 172.21.15.39:0/2014237046 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b401e5c0 con 0x7f39c005ce20 2020-11-20T13:56:23.530 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.517+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c013a650 con 0x7f39c005ce20 2020-11-20T13:56:23.530 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.517+0000 7f39b27fc700 1 -- 172.21.15.39:0/2014237046 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39b401e920 con 0x7f39c005ce20 2020-11-20T13:56:23.530 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.517+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c0065f10 con 0x7f39c005ce20 2020-11-20T13:56:23.531 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.518+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c008f850 con 0x7f39c005ce20 2020-11-20T13:56:23.531 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.518+0000 7f39b27fc700 1 -- 172.21.15.39:0/2014237046 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f39b4025030 con 0x7f39c005ce20 2020-11-20T13:56:23.531 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.518+0000 7f39b27fc700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39a0051270 0x7f39a0053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.531 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.518+0000 7f39b27fc700 1 -- 172.21.15.39:0/2014237046 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f39b406a280 con 0x7f39c005ce20 2020-11-20T13:56:23.532 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.519+0000 7f39c4ff3700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39a0051270 0x7f39a0053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.532 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.519+0000 7f39c4ff3700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39a0051270 0x7f39a0053730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f39bc00d000 tx=0x7f39bc007b60).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:23.532 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.522+0000 7f39b27fc700 1 -- 172.21.15.39:0/2014237046 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f39b4042640 con 0x7f39c005ce20 2020-11-20T13:56:23.683 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.682+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39c0057050 con 0x7f39c005ce20 2020-11-20T13:56:23.684 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.683+0000 7f39b27fc700 1 -- 172.21.15.39:0/2014237046 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f39b4023090 con 0x7f39c005ce20 2020-11-20T13:56:23.684 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:23.684 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":23,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:23.331627+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T13:56:15.768689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T13:56:18.856235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T13:56:19.656250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:23.686 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39a0051270 msgr2=0x7f39a0053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.686 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39a0051270 0x7f39a0053730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f39bc00d000 tx=0x7f39bc007b60).stop 2020-11-20T13:56:23.686 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 msgr2=0x7f39c00643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.687 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 0x7f39c00643a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f39b4002f30 tx=0x7f39b4015000).stop 2020-11-20T13:56:23.687 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 shutdown_connections 2020-11-20T13:56:23.687 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f39a0051270 0x7f39a0053730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.687 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c005ce20 0x7f39c00643a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.688 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39c013df70 0x7f39c013a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.688 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 --2- 172.21.15.39:0/2014237046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39c009f5f0 0x7f39c0139c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.688 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 >> 172.21.15.39:0/2014237046 conn(0x7f39c00ac1e0 msgr2=0x7f39c00aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:23.688 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 shutdown_connections 2020-11-20T13:56:23.688 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.685+0000 7f39c7a58700 1 -- 172.21.15.39:0/2014237046 wait complete. 2020-11-20T13:56:23.697 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T13:56:05.147084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T13:56:15.768689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T13:56:18.856235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T13:56:19.656250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T13:56:23.698 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-11-20T13:56:23.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.815+0000 7f38495b6700 1 Processor -- start 2020-11-20T13:56:23.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.815+0000 7f38495b6700 1 -- start start 2020-11-20T13:56:23.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.816+0000 7f38495b6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f384405ce20 0x7f38440a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.816+0000 7f38495b6700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f384409f5f0 0x7f38440a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.816+0000 7f38495b6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38440a4e60 con 0x7f38440a2310 2020-11-20T13:56:23.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.816+0000 7f38495b6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38440a5090 con 0x7f384405ce20 2020-11-20T13:56:23.821 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.816+0000 7f38495b6700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38440a5330 con 0x7f384409f5f0 2020-11-20T13:56:23.822 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.816+0000 7f38427fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f384409f5f0 0x7f38440a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.822 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.816+0000 7f38427fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f384409f5f0 0x7f38440a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45174/0 (socket says 172.21.15.39:45174) 2020-11-20T13:56:23.822 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.816+0000 7f38427fc700 1 -- 172.21.15.39:0/1930439757 learned_addr learned my addr 172.21.15.39:0/1930439757 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:23.822 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f3842ffd700 1 --2- 172.21.15.39:0/1930439757 >> v2:172.21.15.31:3300/0 conn(0x7f384405ce20 0x7f38440a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.823 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f38427fc700 1 -- 172.21.15.39:0/1930439757 >> v2:172.21.15.31:3300/0 conn(0x7f384405ce20 msgr2=0x7f38440a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:23.823 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f38427fc700 1 --2- 172.21.15.39:0/1930439757 >> v2:172.21.15.31:3300/0 conn(0x7f384405ce20 0x7f38440a3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.823 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f38427fc700 1 -- 172.21.15.39:0/1930439757 >> v1:172.21.15.31:6789/0 conn(0x7f38440a2310 legacy=0x7f38440a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.823 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f38427fc700 1 -- 172.21.15.39:0/1930439757 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440a2d10 con 0x7f384409f5f0 2020-11-20T13:56:23.823 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f38427fc700 1 --2- 172.21.15.39:0/1930439757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f384409f5f0 0x7f38440a1e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3834002f30 tx=0x7f3834006e80).ready entity=mon.1 client_cookie=4d4e95d80f662e55 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:23.824 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f3841ffb700 1 -- 172.21.15.39:0/1930439757 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38340097f0 con 0x7f384409f5f0 2020-11-20T13:56:23.824 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f3841ffb700 1 -- 172.21.15.39:0/1930439757 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834009950 con 0x7f384409f5f0 2020-11-20T13:56:23.824 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f3841ffb700 1 -- 172.21.15.39:0/1930439757 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3834009cb0 con 0x7f384409f5f0 2020-11-20T13:56:23.824 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f38495b6700 1 -- 172.21.15.39:0/1930439757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f384409f5f0 msgr2=0x7f38440a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.825 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.817+0000 7f38495b6700 1 --2- 172.21.15.39:0/1930439757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f384409f5f0 0x7f38440a1e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3834002f30 tx=0x7f3834006e80).stop 2020-11-20T13:56:23.825 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.818+0000 7f38495b6700 1 -- 172.21.15.39:0/1930439757 shutdown_connections 2020-11-20T13:56:23.825 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.818+0000 7f38495b6700 1 --2- 172.21.15.39:0/1930439757 >> v2:172.21.15.31:3300/0 conn(0x7f384405ce20 0x7f38440a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.825 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.818+0000 7f38495b6700 1 --2- 172.21.15.39:0/1930439757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f384409f5f0 0x7f38440a1e20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.825 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.818+0000 7f38495b6700 1 -- 172.21.15.39:0/1930439757 >> 172.21.15.39:0/1930439757 conn(0x7f38440ac1e0 msgr2=0x7f38440a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:23.826 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.818+0000 7f38495b6700 1 -- 172.21.15.39:0/1930439757 shutdown_connections 2020-11-20T13:56:23.826 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.818+0000 7f38495b6700 1 -- 172.21.15.39:0/1930439757 wait complete. 2020-11-20T13:56:23.826 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.818+0000 7f38495b6700 1 Processor -- start 2020-11-20T13:56:23.826 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.818+0000 7f38495b6700 1 -- start start 2020-11-20T13:56:23.829 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38495b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f384405ce20 0x7f384413b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.829 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38495b6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f384409f5f0 0x7f384409e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.829 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38495b6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38440a2310 0x7f38441353a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.829 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38495b6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844067a00 con 0x7f384405ce20 2020-11-20T13:56:23.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38495b6700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384409bfa0 con 0x7f38440a2310 2020-11-20T13:56:23.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38495b6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384409c240 con 0x7f384409f5f0 2020-11-20T13:56:23.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38437fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38440a2310 0x7f38441353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38437fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38440a2310 0x7f38441353a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45182/0 (socket says 172.21.15.39:45182) 2020-11-20T13:56:23.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38437fe700 1 -- 172.21.15.39:0/562586574 learned_addr learned my addr 172.21.15.39:0/562586574 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:23.831 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38427fc700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f384409f5f0 0x7f384409e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.831 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f3842ffd700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f384405ce20 0x7f384413b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.831 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38437fe700 1 -- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f384409f5f0 msgr2=0x7f384409e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.831 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38437fe700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f384409f5f0 0x7f384409e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.831 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38437fe700 1 -- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f384405ce20 msgr2=0x7f384413b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.832 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38437fe700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f384405ce20 0x7f384413b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.832 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.819+0000 7f38437fe700 1 -- 172.21.15.39:0/562586574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384409c4e0 con 0x7f38440a2310 2020-11-20T13:56:23.832 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.820+0000 7f38437fe700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38440a2310 0x7f38441353a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f38440a4870 tx=0x7f383c007e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:23.832 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.820+0000 7f383bfff700 1 -- 172.21.15.39:0/562586574 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383c00a5a0 con 0x7f38440a2310 2020-11-20T13:56:23.832 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.820+0000 7f383bfff700 1 -- 172.21.15.39:0/562586574 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00a700 con 0x7f38440a2310 2020-11-20T13:56:23.833 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.820+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38440a0c30 con 0x7f38440a2310 2020-11-20T13:56:23.833 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.820+0000 7f383bfff700 1 -- 172.21.15.39:0/562586574 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383c00aa60 con 0x7f38440a2310 2020-11-20T13:56:23.833 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.820+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3844138fb0 con 0x7f38440a2310 2020-11-20T13:56:23.833 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.821+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3844057050 con 0x7f38440a2310 2020-11-20T13:56:23.833 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.821+0000 7f383bfff700 1 -- 172.21.15.39:0/562586574 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f383c019030 con 0x7f38440a2310 2020-11-20T13:56:23.834 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.821+0000 7f383bfff700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3828051270 0x7f3828053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:23.834 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.821+0000 7f383bfff700 1 -- 172.21.15.39:0/562586574 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f383c068820 con 0x7f38440a2310 2020-11-20T13:56:23.834 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.821+0000 7f3842ffd700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3828051270 0x7f3828053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:23.834 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.822+0000 7f3842ffd700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3828051270 0x7f3828053730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f382c00c000 tx=0x7f382c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:23.834 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.825+0000 7f383bfff700 1 -- 172.21.15.39:0/562586574 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f383c040b40 con 0x7f38440a2310 2020-11-20T13:56:23.985 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.983+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f384406a5c0 con 0x7f38440a2310 2020-11-20T13:56:23.985 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.983+0000 7f383bfff700 1 -- 172.21.15.39:0/562586574 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f383c044160 con 0x7f38440a2310 2020-11-20T13:56:23.985 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2020-11-20T13:56:23.986 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.984+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3828051270 msgr2=0x7f3828053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.987 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.984+0000 7f38495b6700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3828051270 0x7f3828053730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f382c00c000 tx=0x7f382c008040).stop 2020-11-20T13:56:23.987 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.984+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38440a2310 msgr2=0x7f38441353a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:23.987 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.984+0000 7f38495b6700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38440a2310 0x7f38441353a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f38440a4870 tx=0x7f383c007e80).stop 2020-11-20T13:56:23.987 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.985+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 shutdown_connections 2020-11-20T13:56:23.988 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.985+0000 7f38495b6700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3828051270 0x7f3828053730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.988 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.985+0000 7f38495b6700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38440a2310 0x7f38441353a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.988 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.985+0000 7f38495b6700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f384405ce20 0x7f384413b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.989 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.985+0000 7f38495b6700 1 --2- 172.21.15.39:0/562586574 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f384409f5f0 0x7f384409e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:23.989 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.985+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 >> 172.21.15.39:0/562586574 conn(0x7f38440ac1e0 msgr2=0x7f38440a5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:23.989 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.985+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 shutdown_connections 2020-11-20T13:56:23.990 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:23.985+0000 7f38495b6700 1 -- 172.21.15.39:0/562586574 wait complete. 2020-11-20T13:56:23.996 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-11-20T13:56:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.113+0000 7f7e5b707700 1 Processor -- start 2020-11-20T13:56:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e5b707700 1 -- start start 2020-11-20T13:56:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e5b707700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5405ce20 0x7f7e540a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e5b707700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7e5413df70 0x7f7e54140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e5b707700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e540a2d10 con 0x7f7e5409f5f0 2020-11-20T13:56:24.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e5b707700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e540a5090 con 0x7f7e5413df70 2020-11-20T13:56:24.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e5b707700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540a5330 con 0x7f7e5405ce20 2020-11-20T13:56:24.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e59ca4700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7e5413df70 0x7f7e54140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e59ca4700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7e5413df70 0x7f7e54140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45190/0 (socket says 172.21.15.39:45190) 2020-11-20T13:56:24.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e59ca4700 1 -- 172.21.15.39:0/4101595569 learned_addr learned my addr 172.21.15.39:0/4101595569 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:24.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.114+0000 7f7e594a3700 1 --2- 172.21.15.39:0/4101595569 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5405ce20 0x7f7e540a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e59ca4700 1 -- 172.21.15.39:0/4101595569 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5405ce20 msgr2=0x7f7e540a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:24.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e59ca4700 1 --2- 172.21.15.39:0/4101595569 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5405ce20 0x7f7e540a3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e59ca4700 1 -- 172.21.15.39:0/4101595569 >> v1:172.21.15.31:6789/0 conn(0x7f7e5409f5f0 legacy=0x7f7e540a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e47fff700 1 -- 172.21.15.39:0/4101595569 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199529344 0 0) 0x7f7e540a2d10 con 0x7f7e5409f5f0 2020-11-20T13:56:24.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e59ca4700 1 -- 172.21.15.39:0/4101595569 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e540a2f40 con 0x7f7e5413df70 2020-11-20T13:56:24.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e59ca4700 1 --2- 172.21.15.39:0/4101595569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 0x7f7e54140360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7e4c0032b0 tx=0x7f7e4c00a410).ready entity=mon.1 client_cookie=8bbcfaa698e60282 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:24.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e47fff700 1 -- 172.21.15.39:0/4101595569 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4c010410 con 0x7f7e5413df70 2020-11-20T13:56:24.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e47fff700 1 -- 172.21.15.39:0/4101595569 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c010570 con 0x7f7e5413df70 2020-11-20T13:56:24.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e47fff700 1 -- 172.21.15.39:0/4101595569 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4c0108d0 con 0x7f7e5413df70 2020-11-20T13:56:24.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e5b707700 1 -- 172.21.15.39:0/4101595569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 msgr2=0x7f7e54140360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e5b707700 1 --2- 172.21.15.39:0/4101595569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 0x7f7e54140360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7e4c0032b0 tx=0x7f7e4c00a410).stop 2020-11-20T13:56:24.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e5b707700 1 -- 172.21.15.39:0/4101595569 shutdown_connections 2020-11-20T13:56:24.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e5b707700 1 --2- 172.21.15.39:0/4101595569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 0x7f7e54140360 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e5b707700 1 --2- 172.21.15.39:0/4101595569 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5405ce20 0x7f7e540a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.115+0000 7f7e5b707700 1 -- 172.21.15.39:0/4101595569 >> 172.21.15.39:0/4101595569 conn(0x7f7e540ac1e0 msgr2=0x7f7e540a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:24.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.116+0000 7f7e5b707700 1 -- 172.21.15.39:0/4101595569 shutdown_connections 2020-11-20T13:56:24.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.116+0000 7f7e5b707700 1 -- 172.21.15.39:0/4101595569 wait complete. 2020-11-20T13:56:24.125 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.116+0000 7f7e5b707700 1 Processor -- start 2020-11-20T13:56:24.125 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.116+0000 7f7e5b707700 1 -- start start 2020-11-20T13:56:24.125 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e5b707700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e5405ce20 0x7f7e54061f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.125 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e5b707700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5409f5f0 0x7f7e54065320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.126 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e5b707700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 0x7f7e54147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.126 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e5b707700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54147250 con 0x7f7e5405ce20 2020-11-20T13:56:24.126 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e5b707700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e541474f0 con 0x7f7e5413df70 2020-11-20T13:56:24.126 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e5b707700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54147790 con 0x7f7e5409f5f0 2020-11-20T13:56:24.126 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e59ca4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 0x7f7e54147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e59ca4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 0x7f7e54147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45196/0 (socket says 172.21.15.39:45196) 2020-11-20T13:56:24.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e59ca4700 1 -- 172.21.15.39:0/3971751963 learned_addr learned my addr 172.21.15.39:0/3971751963 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:24.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e594a3700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e5405ce20 0x7f7e54061f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e58ca2700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5409f5f0 0x7f7e54065320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e59ca4700 1 -- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5409f5f0 msgr2=0x7f7e54065320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.128 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e59ca4700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5409f5f0 0x7f7e54065320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.128 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e59ca4700 1 -- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e5405ce20 msgr2=0x7f7e54061f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.128 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e59ca4700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e5405ce20 0x7f7e54061f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.128 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.117+0000 7f7e59ca4700 1 -- 172.21.15.39:0/3971751963 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5413e350 con 0x7f7e5413df70 2020-11-20T13:56:24.128 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.118+0000 7f7e59ca4700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 0x7f7e54147c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f7e4c0032b0 tx=0x7f7e540a5640).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:24.129 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.118+0000 7f7e467fc700 1 -- 172.21.15.39:0/3971751963 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4c01f070 con 0x7f7e5413df70 2020-11-20T13:56:24.129 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.118+0000 7f7e467fc700 1 -- 172.21.15.39:0/3971751963 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c019870 con 0x7f7e5413df70 2020-11-20T13:56:24.129 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.118+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5409ea90 con 0x7f7e5413df70 2020-11-20T13:56:24.129 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.118+0000 7f7e467fc700 1 -- 172.21.15.39:0/3971751963 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4c019bd0 con 0x7f7e5413df70 2020-11-20T13:56:24.130 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.118+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e54063a30 con 0x7f7e5413df70 2020-11-20T13:56:24.130 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.119+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e54057050 con 0x7f7e5413df70 2020-11-20T13:56:24.130 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.119+0000 7f7e467fc700 1 -- 172.21.15.39:0/3971751963 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f7e4c02b070 con 0x7f7e5413df70 2020-11-20T13:56:24.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.119+0000 7f7e467fc700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7e34051270 0x7f7e34053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.119+0000 7f7e467fc700 1 -- 172.21.15.39:0/3971751963 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7e4c06a5e0 con 0x7f7e5413df70 2020-11-20T13:56:24.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.119+0000 7f7e594a3700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7e34051270 0x7f7e34053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.120+0000 7f7e594a3700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7e34051270 0x7f7e34053730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7e4800b000 tx=0x7f7e48006dc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:24.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.123+0000 7f7e467fc700 1 -- 172.21.15.39:0/3971751963 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f7e4c0429a0 con 0x7f7e5413df70 2020-11-20T13:56:24.283 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.282+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e5406a5c0 con 0x7f7e5413df70 2020-11-20T13:56:24.284 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.283+0000 7f7e467fc700 1 -- 172.21.15.39:0/3971751963 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e4c045fc0 con 0x7f7e5413df70 2020-11-20T13:56:24.284 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:24.285 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7e34051270 msgr2=0x7f7e34053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.285 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7e34051270 0x7f7e34053730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7e4800b000 tx=0x7f7e48006dc0).stop 2020-11-20T13:56:24.286 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 msgr2=0x7f7e54147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.286 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 0x7f7e54147c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f7e4c0032b0 tx=0x7f7e540a5640).stop 2020-11-20T13:56:24.286 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 shutdown_connections 2020-11-20T13:56:24.286 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f7e34051270 0x7f7e34053730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.286 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e5413df70 0x7f7e54147c30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.287 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e5405ce20 0x7f7e54061f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.287 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 --2- 172.21.15.39:0/3971751963 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7e5409f5f0 0x7f7e54065320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.287 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 >> 172.21.15.39:0/3971751963 conn(0x7f7e540ac1e0 msgr2=0x7f7e540aa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:24.287 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 shutdown_connections 2020-11-20T13:56:24.287 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.284+0000 7f7e5b707700 1 -- 172.21.15.39:0/3971751963 wait complete. 2020-11-20T13:56:24.295 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-11-20T13:56:24.413 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.412+0000 7f10c3723700 1 Processor -- start 2020-11-20T13:56:24.414 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.412+0000 7f10c3723700 1 -- start start 2020-11-20T13:56:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10c3723700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f10bc05ce20 0x7f10bc0a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10c3723700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 0x7f10bc140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10c3723700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0a2d10 con 0x7f10bc09f5f0 2020-11-20T13:56:24.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10c3723700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0a5090 con 0x7f10bc05ce20 2020-11-20T13:56:24.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10c3723700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0a5330 con 0x7f10bc13df70 2020-11-20T13:56:24.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10c0cbe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f10bc09f5f0 0x7f10bc0a1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35376/0 (socket says 172.21.15.39:35376) 2020-11-20T13:56:24.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10c0cbe700 1 -- 172.21.15.39:0/2538767284 learned_addr learned my addr 172.21.15.39:0/2538767284 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:24.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10c1cc0700 1 --2- 172.21.15.39:0/2538767284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 0x7f10bc140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10c14bf700 1 --2- 172.21.15.39:0/2538767284 >> v2:172.21.15.31:3300/0 conn(0x7f10bc05ce20 0x7f10bc0a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10abfff700 1 -- 172.21.15.39:0/2538767284 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424914917 0 0) 0x7f10bc0a2d10 con 0x7f10bc09f5f0 2020-11-20T13:56:24.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.413+0000 7f10abfff700 1 -- 172.21.15.39:0/2538767284 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a4003230 con 0x7f10bc09f5f0 2020-11-20T13:56:24.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c1cc0700 1 -- 172.21.15.39:0/2538767284 >> v2:172.21.15.31:3300/0 conn(0x7f10bc05ce20 msgr2=0x7f10bc0a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:24.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c1cc0700 1 --2- 172.21.15.39:0/2538767284 >> v2:172.21.15.31:3300/0 conn(0x7f10bc05ce20 0x7f10bc0a3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c1cc0700 1 -- 172.21.15.39:0/2538767284 >> v1:172.21.15.39:6789/0 conn(0x7f10bc09f5f0 legacy=0x7f10bc0a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c1cc0700 1 -- 172.21.15.39:0/2538767284 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0a2f40 con 0x7f10bc13df70 2020-11-20T13:56:24.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c1cc0700 1 --2- 172.21.15.39:0/2538767284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 0x7f10bc140360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f10b40032b0 tx=0x7f10b40091a0).ready entity=mon.2 client_cookie=da4c3eee1e41acda server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:24.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10abfff700 1 -- 172.21.15.39:0/2538767284 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10b400b940 con 0x7f10bc13df70 2020-11-20T13:56:24.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10abfff700 1 -- 172.21.15.39:0/2538767284 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b400baa0 con 0x7f10bc13df70 2020-11-20T13:56:24.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10abfff700 1 -- 172.21.15.39:0/2538767284 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10b400bc10 con 0x7f10bc13df70 2020-11-20T13:56:24.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c3723700 1 -- 172.21.15.39:0/2538767284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 msgr2=0x7f10bc140360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c3723700 1 --2- 172.21.15.39:0/2538767284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 0x7f10bc140360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f10b40032b0 tx=0x7f10b40091a0).stop 2020-11-20T13:56:24.421 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c3723700 1 -- 172.21.15.39:0/2538767284 shutdown_connections 2020-11-20T13:56:24.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c3723700 1 --2- 172.21.15.39:0/2538767284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 0x7f10bc140360 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c3723700 1 --2- 172.21.15.39:0/2538767284 >> v2:172.21.15.31:3300/0 conn(0x7f10bc05ce20 0x7f10bc0a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c3723700 1 -- 172.21.15.39:0/2538767284 >> 172.21.15.39:0/2538767284 conn(0x7f10bc0ac1e0 msgr2=0x7f10bc0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:24.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c3723700 1 -- 172.21.15.39:0/2538767284 shutdown_connections 2020-11-20T13:56:24.423 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.414+0000 7f10c3723700 1 -- 172.21.15.39:0/2538767284 wait complete. 2020-11-20T13:56:24.423 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.415+0000 7f10c3723700 1 Processor -- start 2020-11-20T13:56:24.423 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.415+0000 7f10c3723700 1 -- start start 2020-11-20T13:56:24.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c3723700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10bc05ce20 0x7f10bc1391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c3723700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc09f5f0 0x7f10bc09cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c3723700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 0x7f10bc09d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c3723700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc067990 con 0x7f10bc09f5f0 2020-11-20T13:56:24.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c3723700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc13c460 con 0x7f10bc05ce20 2020-11-20T13:56:24.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c3723700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc139f70 con 0x7f10bc13df70 2020-11-20T13:56:24.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c14bf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10bc05ce20 0x7f10bc1391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c14bf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10bc05ce20 0x7f10bc1391f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45206/0 (socket says 172.21.15.39:45206) 2020-11-20T13:56:24.429 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c14bf700 1 -- 172.21.15.39:0/1154842752 learned_addr learned my addr 172.21.15.39:0/1154842752 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:24.429 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c1cc0700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 0x7f10bc09d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.429 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c0cbe700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc09f5f0 0x7f10bc09cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c14bf700 1 -- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 msgr2=0x7f10bc09d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c14bf700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 0x7f10bc09d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c14bf700 1 -- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc09f5f0 msgr2=0x7f10bc09cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c14bf700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc09f5f0 0x7f10bc09cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c14bf700 1 -- 172.21.15.39:0/1154842752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc13a210 con 0x7f10bc05ce20 2020-11-20T13:56:24.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.416+0000 7f10c14bf700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10bc05ce20 0x7f10bc1391f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f10ac00c000 tx=0x7f10ac006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:24.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.417+0000 7f10aa7fc700 1 -- 172.21.15.39:0/1154842752 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ac00ca10 con 0x7f10bc05ce20 2020-11-20T13:56:24.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.417+0000 7f10aa7fc700 1 -- 172.21.15.39:0/1154842752 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac00cb70 con 0x7f10bc05ce20 2020-11-20T13:56:24.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.417+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc13c180 con 0x7f10bc05ce20 2020-11-20T13:56:24.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.417+0000 7f10aa7fc700 1 -- 172.21.15.39:0/1154842752 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ac0123f0 con 0x7f10bc05ce20 2020-11-20T13:56:24.432 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.417+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc13a730 con 0x7f10bc05ce20 2020-11-20T13:56:24.432 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.418+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc0a1bd0 con 0x7f10bc05ce20 2020-11-20T13:56:24.432 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.418+0000 7f10aa7fc700 1 -- 172.21.15.39:0/1154842752 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f10ac012550 con 0x7f10bc05ce20 2020-11-20T13:56:24.432 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.418+0000 7f10aa7fc700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f109c0511d0 0x7f109c053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.432 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.418+0000 7f10aa7fc700 1 -- 172.21.15.39:0/1154842752 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f10ac069230 con 0x7f10bc05ce20 2020-11-20T13:56:24.433 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.418+0000 7f10c0cbe700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f109c0511d0 0x7f109c053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.433 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.418+0000 7f10c0cbe700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f109c0511d0 0x7f109c053690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f10b800d000 tx=0x7f10b8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:24.433 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.421+0000 7f10aa7fc700 1 -- 172.21.15.39:0/1154842752 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f10ac041590 con 0x7f10bc05ce20 2020-11-20T13:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.580+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10bc1398a0 con 0x7f10bc05ce20 2020-11-20T13:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.581+0000 7f10aa7fc700 1 -- 172.21.15.39:0/1154842752 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f10bc1398a0 con 0x7f10bc05ce20 2020-11-20T13:56:24.582 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f109c0511d0 msgr2=0x7f109c053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f109c0511d0 0x7f109c053690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f10b800d000 tx=0x7f10b8009040).stop 2020-11-20T13:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10bc05ce20 msgr2=0x7f10bc1391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10bc05ce20 0x7f10bc1391f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f10ac00c000 tx=0x7f10ac006dc0).stop 2020-11-20T13:56:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 shutdown_connections 2020-11-20T13:56:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f109c0511d0 0x7f109c053690 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10bc05ce20 0x7f10bc1391f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10bc13df70 0x7f10bc09d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 --2- 172.21.15.39:0/1154842752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc09f5f0 0x7f10bc09cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 >> 172.21.15.39:0/1154842752 conn(0x7f10bc0ac1e0 msgr2=0x7f10bc069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 shutdown_connections 2020-11-20T13:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.582+0000 7f10c3723700 1 -- 172.21.15.39:0/1154842752 wait complete. 2020-11-20T13:56:24.593 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-11-20T13:56:24.710 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.709+0000 7fc01a689700 1 Processor -- start 2020-11-20T13:56:24.710 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.709+0000 7fc01a689700 1 -- start start 2020-11-20T13:56:24.713 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc01a689700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 0x7fc0140a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.713 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc01a689700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0140a4870 0x7fc0140a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.713 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc01a689700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc0140a2f70 0x7fc0140a3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.713 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc01a689700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140a3fa0 con 0x7fc0140a4870 2020-11-20T13:56:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc01a689700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140a41d0 con 0x7fc0140a2f70 2020-11-20T13:56:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc01a689700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140a0270 con 0x7fc0140a8a80 2020-11-20T13:56:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc018c26700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc0140a2f70 0x7fc0140a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc018c26700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc0140a2f70 0x7fc0140a3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45214/0 (socket says 172.21.15.39:45214) 2020-11-20T13:56:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc018c26700 1 -- 172.21.15.39:0/3673144138 learned_addr learned my addr 172.21.15.39:0/3673144138 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:24.715 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc013fff700 1 --2- 172.21.15.39:0/3673144138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 0x7fc0140a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.715 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc0137fe700 1 --2- 172.21.15.39:0/3673144138 >> v2:172.21.15.31:3300/0 conn(0x7fc0140a4870 0x7fc0140a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.715 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc018c26700 1 -- 172.21.15.39:0/3673144138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 msgr2=0x7fc0140a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:24.715 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc018c26700 1 --2- 172.21.15.39:0/3673144138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 0x7fc0140a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.715 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc018c26700 1 -- 172.21.15.39:0/3673144138 >> v2:172.21.15.31:3300/0 conn(0x7fc0140a4870 msgr2=0x7fc0140a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:24.716 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc018c26700 1 --2- 172.21.15.39:0/3673144138 >> v2:172.21.15.31:3300/0 conn(0x7fc0140a4870 0x7fc0140a2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.716 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc018c26700 1 -- 172.21.15.39:0/3673144138 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140a59b0 con 0x7fc0140a2f70 2020-11-20T13:56:24.716 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc0137fe700 1 --2- 172.21.15.39:0/3673144138 >> v2:172.21.15.31:3300/0 conn(0x7fc0140a4870 0x7fc0140a2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:24.716 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.710+0000 7fc018c26700 1 --2- 172.21.15.39:0/3673144138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 0x7fc0140a3370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc00c0032b0 tx=0x7fc00c009270).ready entity=mon.1 client_cookie=e8c8a2f67566ffab server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:24.716 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc012ffd700 1 -- 172.21.15.39:0/3673144138 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00c00bc00 con 0x7fc0140a2f70 2020-11-20T13:56:24.717 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc012ffd700 1 -- 172.21.15.39:0/3673144138 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00bd60 con 0x7fc0140a2f70 2020-11-20T13:56:24.717 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc012ffd700 1 -- 172.21.15.39:0/3673144138 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00c011400 con 0x7fc0140a2f70 2020-11-20T13:56:24.717 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc01a689700 1 -- 172.21.15.39:0/3673144138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 msgr2=0x7fc0140a3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.717 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc01a689700 1 --2- 172.21.15.39:0/3673144138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 0x7fc0140a3370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc00c0032b0 tx=0x7fc00c009270).stop 2020-11-20T13:56:24.717 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc01a689700 1 -- 172.21.15.39:0/3673144138 shutdown_connections 2020-11-20T13:56:24.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc01a689700 1 --2- 172.21.15.39:0/3673144138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 0x7fc0140a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc01a689700 1 --2- 172.21.15.39:0/3673144138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 0x7fc0140a3370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc01a689700 1 --2- 172.21.15.39:0/3673144138 >> v2:172.21.15.31:3300/0 conn(0x7fc0140a4870 0x7fc0140a2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc01a689700 1 -- 172.21.15.39:0/3673144138 >> 172.21.15.39:0/3673144138 conn(0x7fc0140ac1e0 msgr2=0x7fc0140a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:24.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc01a689700 1 -- 172.21.15.39:0/3673144138 shutdown_connections 2020-11-20T13:56:24.719 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.711+0000 7fc01a689700 1 -- 172.21.15.39:0/3673144138 wait complete. 2020-11-20T13:56:24.719 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.712+0000 7fc01a689700 1 Processor -- start 2020-11-20T13:56:24.719 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.712+0000 7fc01a689700 1 -- start start 2020-11-20T13:56:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc01a689700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 0x7fc0140a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc01a689700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0140a4870 0x7fc01414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc01a689700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 0x7fc01414b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc01a689700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140a16f0 con 0x7fc0140a4870 2020-11-20T13:56:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc01a689700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140a0c40 con 0x7fc0140a2f70 2020-11-20T13:56:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc01a689700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01409b630 con 0x7fc0140a8a80 2020-11-20T13:56:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc013fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 0x7fc0140a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc013fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 0x7fc0140a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45222/0 (socket says 172.21.15.39:45222) 2020-11-20T13:56:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc013fff700 1 -- 172.21.15.39:0/3281801181 learned_addr learned my addr 172.21.15.39:0/3281801181 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:24.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc0137fe700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0140a4870 0x7fc01414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc018c26700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 0x7fc01414b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc013fff700 1 -- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 msgr2=0x7fc01414b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc013fff700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 0x7fc01414b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc013fff700 1 -- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0140a4870 msgr2=0x7fc01414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.725 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc013fff700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0140a4870 0x7fc01414b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.725 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc013fff700 1 -- 172.21.15.39:0/3281801181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140a0ff0 con 0x7fc0140a2f70 2020-11-20T13:56:24.725 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.713+0000 7fc013fff700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 0x7fc0140a0410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fc004003070 tx=0x7fc004008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:24.725 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.714+0000 7fc0117fa700 1 -- 172.21.15.39:0/3281801181 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc004009790 con 0x7fc0140a2f70 2020-11-20T13:56:24.725 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.714+0000 7fc0117fa700 1 -- 172.21.15.39:0/3281801181 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0040098f0 con 0x7fc0140a2f70 2020-11-20T13:56:24.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.714+0000 7fc0117fa700 1 -- 172.21.15.39:0/3281801181 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc004009c50 con 0x7fc0140a2f70 2020-11-20T13:56:24.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.714+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0140a71e0 con 0x7fc0140a2f70 2020-11-20T13:56:24.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.714+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc014066590 con 0x7fc0140a2f70 2020-11-20T13:56:24.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.715+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc014066840 con 0x7fc0140a2f70 2020-11-20T13:56:24.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.715+0000 7fc0117fa700 1 -- 172.21.15.39:0/3281801181 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fc004009db0 con 0x7fc0140a2f70 2020-11-20T13:56:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.715+0000 7fc0117fa700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbff4051310 0x7fbff40537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.715+0000 7fc0117fa700 1 -- 172.21.15.39:0/3281801181 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc0040694f0 con 0x7fc0140a2f70 2020-11-20T13:56:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.715+0000 7fc0137fe700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbff4051310 0x7fbff40537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.715+0000 7fc0137fe700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbff4051310 0x7fbff40537d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc00800d000 tx=0x7fc008008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.718+0000 7fc0117fa700 1 -- 172.21.15.39:0/3281801181 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fc0040418b0 con 0x7fc0140a2f70 2020-11-20T13:56:24.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.882+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc014057050 con 0x7fc0140a2f70 2020-11-20T13:56:24.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.882+0000 7fc0117fa700 1 -- 172.21.15.39:0/3281801181 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc004044ed0 con 0x7fc0140a2f70 2020-11-20T13:56:24.883 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:24.884 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.883+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbff4051310 msgr2=0x7fbff40537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.883+0000 7fc01a689700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbff4051310 0x7fbff40537d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc00800d000 tx=0x7fc008008040).stop 2020-11-20T13:56:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 msgr2=0x7fc0140a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 0x7fc0140a0410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fc004003070 tx=0x7fc004008040).stop 2020-11-20T13:56:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 shutdown_connections 2020-11-20T13:56:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fbff4051310 0x7fbff40537d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0140a2f70 0x7fc0140a0410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0140a8a80 0x7fc01414b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 --2- 172.21.15.39:0/3281801181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0140a4870 0x7fc01414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 >> 172.21.15.39:0/3281801181 conn(0x7fc0140ac1e0 msgr2=0x7fc0140a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 shutdown_connections 2020-11-20T13:56:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:24.884+0000 7fc01a689700 1 -- 172.21.15.39:0/3281801181 wait complete. 2020-11-20T13:56:24.895 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-20T13:56:24.895 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-20T13:56:24.895 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-11-20T13:56:25.012 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.011+0000 7f7677fff700 1 Processor -- start 2020-11-20T13:56:25.012 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.011+0000 7f7677fff700 1 -- start start 2020-11-20T13:56:25.014 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7677fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 0x7f76780a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7677fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f767813a840 0x7f767813acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7677fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f767809b100 0x7f767809b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7677fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767813b1b0 con 0x7f767809b100 2020-11-20T13:56:25.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7677fff700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767809f5b0 con 0x7f767813a840 2020-11-20T13:56:25.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7677fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780a6330 con 0x7f76780a4d60 2020-11-20T13:56:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76767fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f767813a840 0x7f767813acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76767fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f767813a840 0x7f767813acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45228/0 (socket says 172.21.15.39:45228) 2020-11-20T13:56:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76767fc700 1 -- 172.21.15.39:0/3932837273 learned_addr learned my addr 172.21.15.39:0/3932837273 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76777fe700 1 --2- 172.21.15.39:0/3932837273 >> v2:172.21.15.31:3300/0 conn(0x7f767809b100 0x7f767809b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7676ffd700 1 --2- 172.21.15.39:0/3932837273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 0x7f76780a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76767fc700 1 -- 172.21.15.39:0/3932837273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 msgr2=0x7f76780a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76767fc700 1 --2- 172.21.15.39:0/3932837273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 0x7f76780a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76767fc700 1 -- 172.21.15.39:0/3932837273 >> v2:172.21.15.31:3300/0 conn(0x7f767809b100 msgr2=0x7f767809b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76767fc700 1 --2- 172.21.15.39:0/3932837273 >> v2:172.21.15.31:3300/0 conn(0x7f767809b100 0x7f767809b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76767fc700 1 -- 172.21.15.39:0/3932837273 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76780a65d0 con 0x7f767813a840 2020-11-20T13:56:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f76767fc700 1 --2- 172.21.15.39:0/3932837273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 0x7f767813acc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7668002f30 tx=0x7f7668006e80).ready entity=mon.1 client_cookie=808ff9ced678447 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:25.018 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7675ffb700 1 -- 172.21.15.39:0/3932837273 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7668009640 con 0x7f767813a840 2020-11-20T13:56:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7675ffb700 1 -- 172.21.15.39:0/3932837273 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76680097a0 con 0x7f767813a840 2020-11-20T13:56:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7675ffb700 1 -- 172.21.15.39:0/3932837273 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7668009b00 con 0x7f767813a840 2020-11-20T13:56:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7677fff700 1 -- 172.21.15.39:0/3932837273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 msgr2=0x7f767813acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.012+0000 7f7677fff700 1 --2- 172.21.15.39:0/3932837273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 0x7f767813acc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7668002f30 tx=0x7f7668006e80).stop 2020-11-20T13:56:25.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.013+0000 7f7677fff700 1 -- 172.21.15.39:0/3932837273 shutdown_connections 2020-11-20T13:56:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.013+0000 7f7677fff700 1 --2- 172.21.15.39:0/3932837273 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 0x7f76780a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.013+0000 7f7677fff700 1 --2- 172.21.15.39:0/3932837273 >> v2:172.21.15.31:3300/0 conn(0x7f767809b100 0x7f767809b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.013+0000 7f7677fff700 1 --2- 172.21.15.39:0/3932837273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 0x7f767813acc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.013+0000 7f7677fff700 1 -- 172.21.15.39:0/3932837273 >> 172.21.15.39:0/3932837273 conn(0x7f7678061f10 msgr2=0x7f76780ab550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:25.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.013+0000 7f7677fff700 1 -- 172.21.15.39:0/3932837273 shutdown_connections 2020-11-20T13:56:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.013+0000 7f7677fff700 1 -- 172.21.15.39:0/3932837273 wait complete. 2020-11-20T13:56:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.014+0000 7f7677fff700 1 Processor -- start 2020-11-20T13:56:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.014+0000 7f7677fff700 1 -- start start 2020-11-20T13:56:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7677fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f767809b100 0x7f7678134350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7677fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 0x7f7678134840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7677fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 0x7f7678148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7677fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780a16d0 con 0x7f767809b100 2020-11-20T13:56:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7677fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780670b0 con 0x7f767813a840 2020-11-20T13:56:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7677fff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7678067350 con 0x7f76780a4d60 2020-11-20T13:56:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76777fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 0x7f7678148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76777fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 0x7f7678148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45236/0 (socket says 172.21.15.39:45236) 2020-11-20T13:56:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76777fe700 1 -- 172.21.15.39:0/3725051611 learned_addr learned my addr 172.21.15.39:0/3725051611 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7676ffd700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f767809b100 0x7f7678134350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76767fc700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 0x7f7678134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76777fe700 1 -- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 msgr2=0x7f7678134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76777fe700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 0x7f7678134840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76777fe700 1 -- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f767809b100 msgr2=0x7f7678134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76777fe700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f767809b100 0x7f7678134350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76777fe700 1 -- 172.21.15.39:0/3725051611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76780a46a0 con 0x7f767813a840 2020-11-20T13:56:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f76777fe700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 0x7f7678148580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7670006dd0 tx=0x7f76700091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7667fff700 1 -- 172.21.15.39:0/3725051611 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f767000ca00 con 0x7f767813a840 2020-11-20T13:56:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7667fff700 1 -- 172.21.15.39:0/3725051611 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767000cb60 con 0x7f767813a840 2020-11-20T13:56:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76780a4890 con 0x7f767813a840 2020-11-20T13:56:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7667fff700 1 -- 172.21.15.39:0/3725051611 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76700123f0 con 0x7f767813a840 2020-11-20T13:56:25.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.015+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7678066cf0 con 0x7f767813a840 2020-11-20T13:56:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.016+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7678057050 con 0x7f767813a840 2020-11-20T13:56:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.016+0000 7f7667fff700 1 -- 172.21.15.39:0/3725051611 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f7670022070 con 0x7f767813a840 2020-11-20T13:56:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.017+0000 7f7667fff700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f76540512f0 0x7f76540537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.017+0000 7f7667fff700 1 -- 172.21.15.39:0/3725051611 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7670069660 con 0x7f767813a840 2020-11-20T13:56:25.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.017+0000 7f7676ffd700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f76540512f0 0x7f76540537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.017+0000 7f7676ffd700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f76540512f0 0x7f76540537b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f766c00b000 tx=0x7f766c006dc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:25.030 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.020+0000 7f7667fff700 1 -- 172.21.15.39:0/3725051611 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f7670041980 con 0x7f767813a840 2020-11-20T13:56:25.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.223+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f767813a620 con 0x7f767813a840 2020-11-20T13:56:25.228 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.225+0000 7f7667fff700 1 -- 172.21.15.39:0/3725051611 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+126697 (secure 0 0 0) 0x7f7670016020 con 0x7f767813a840 2020-11-20T13:56:25.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.227+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f76540512f0 msgr2=0x7f76540537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.227+0000 7f7677fff700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f76540512f0 0x7f76540537b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f766c00b000 tx=0x7f766c006dc0).stop 2020-11-20T13:56:25.229 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.227+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 msgr2=0x7f7678148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.230 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.227+0000 7f7677fff700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 0x7f7678148580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7670006dd0 tx=0x7f76700091a0).stop 2020-11-20T13:56:25.230 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.227+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 shutdown_connections 2020-11-20T13:56:25.230 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.227+0000 7f7677fff700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f76540512f0 0x7f76540537b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.230 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.227+0000 7f7677fff700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767813a840 0x7f7678148580 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.227+0000 7f7677fff700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f767809b100 0x7f7678134350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.228+0000 7f7677fff700 1 --2- 172.21.15.39:0/3725051611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f76780a4d60 0x7f7678134840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.228+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 >> 172.21.15.39:0/3725051611 conn(0x7f7678061f10 msgr2=0x7f7678069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.228+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 shutdown_connections 2020-11-20T13:56:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.228+0000 7f7677fff700 1 -- 172.21.15.39:0/3725051611 wait complete. 2020-11-20T13:56:25.232 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:25.239 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":4,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":21803},{"type":"v1","addr":"172.21.15.31:6801","nonce":21803}]},"active_addr":"172.21.15.31:6801/21803","active_change":"2020-11-20T13:56:04.667117+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":138037355}]},{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":891679451}]}]}} 2020-11-20T13:56:25.242 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-20T13:56:25.243 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-20T13:56:25.244 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-20T13:56:25.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78b49b2700 1 Processor -- start 2020-11-20T13:56:25.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78b49b2700 1 -- start start 2020-11-20T13:56:25.361 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78b49b2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78b00a4d60 0x7f78b00a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.361 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78b49b2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f78b013a840 0x7f78b013acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.361 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78b49b2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b009b100 0x7f78b009b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78b49b2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b013b1e0 con 0x7f78b00a4d60 2020-11-20T13:56:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78b49b2700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b009f5b0 con 0x7f78b013a840 2020-11-20T13:56:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78b49b2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00a6330 con 0x7f78b009b100 2020-11-20T13:56:25.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78aeffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f78b013a840 0x7f78b013acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.358+0000 7f78aeffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f78b013a840 0x7f78b013acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45240/0 (socket says 172.21.15.39:45240) 2020-11-20T13:56:25.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78aeffd700 1 -- 172.21.15.39:0/4227969197 learned_addr learned my addr 172.21.15.39:0/4227969197 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:25.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78affff700 1 --2- 172.21.15.39:0/4227969197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b009b100 0x7f78b009b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78af7fe700 1 --2- 172.21.15.39:0/4227969197 >> v2:172.21.15.31:3300/0 conn(0x7f78b00a4d60 0x7f78b00a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78aeffd700 1 -- 172.21.15.39:0/4227969197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b009b100 msgr2=0x7f78b009b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:25.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78aeffd700 1 --2- 172.21.15.39:0/4227969197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b009b100 0x7f78b009b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78aeffd700 1 -- 172.21.15.39:0/4227969197 >> v2:172.21.15.31:3300/0 conn(0x7f78b00a4d60 msgr2=0x7f78b00a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:25.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78aeffd700 1 --2- 172.21.15.39:0/4227969197 >> v2:172.21.15.31:3300/0 conn(0x7f78b00a4d60 0x7f78b00a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78aeffd700 1 -- 172.21.15.39:0/4227969197 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00a65d0 con 0x7f78b013a840 2020-11-20T13:56:25.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78aeffd700 1 --2- 172.21.15.39:0/4227969197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b013a840 0x7f78b013acf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7898002f30 tx=0x7f7898006e80).ready entity=mon.1 client_cookie=96648d5ded6a5cfb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:25.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78ae7fc700 1 -- 172.21.15.39:0/4227969197 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7898009640 con 0x7f78b013a840 2020-11-20T13:56:25.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78ae7fc700 1 -- 172.21.15.39:0/4227969197 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78980097a0 con 0x7f78b013a840 2020-11-20T13:56:25.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78ae7fc700 1 -- 172.21.15.39:0/4227969197 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7898009b00 con 0x7f78b013a840 2020-11-20T13:56:25.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78b49b2700 1 -- 172.21.15.39:0/4227969197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b013a840 msgr2=0x7f78b013acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.359+0000 7f78b49b2700 1 --2- 172.21.15.39:0/4227969197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b013a840 0x7f78b013acf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7898002f30 tx=0x7f7898006e80).stop 2020-11-20T13:56:25.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.360+0000 7f78b49b2700 1 -- 172.21.15.39:0/4227969197 shutdown_connections 2020-11-20T13:56:25.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.360+0000 7f78b49b2700 1 --2- 172.21.15.39:0/4227969197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b009b100 0x7f78b009b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.360+0000 7f78b49b2700 1 --2- 172.21.15.39:0/4227969197 >> v2:172.21.15.31:3300/0 conn(0x7f78b00a4d60 0x7f78b00a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.360+0000 7f78b49b2700 1 --2- 172.21.15.39:0/4227969197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b013a840 0x7f78b013acf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.360+0000 7f78b49b2700 1 -- 172.21.15.39:0/4227969197 >> 172.21.15.39:0/4227969197 conn(0x7f78b0061f10 msgr2=0x7f78b00ab550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:25.368 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.360+0000 7f78b49b2700 1 -- 172.21.15.39:0/4227969197 shutdown_connections 2020-11-20T13:56:25.368 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.360+0000 7f78b49b2700 1 -- 172.21.15.39:0/4227969197 wait complete. 2020-11-20T13:56:25.368 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.360+0000 7f78b49b2700 1 Processor -- start 2020-11-20T13:56:25.371 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78b49b2700 1 -- start start 2020-11-20T13:56:25.371 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78b49b2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b009b100 0x7f78b009e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.371 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78b49b2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78b00a4d60 0x7f78b0134350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.371 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78b49b2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b013a840 0x7f78b0134840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.371 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78b49b2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b009c2a0 con 0x7f78b00a4d60 2020-11-20T13:56:25.372 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78b49b2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b009c540 con 0x7f78b009b100 2020-11-20T13:56:25.372 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78b49b2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b013ca30 con 0x7f78b013a840 2020-11-20T13:56:25.372 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78af7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b009b100 0x7f78b009e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.372 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78af7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b009b100 0x7f78b009e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45246/0 (socket says 172.21.15.39:45246) 2020-11-20T13:56:25.373 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78af7fe700 1 -- 172.21.15.39:0/2186572939 learned_addr learned my addr 172.21.15.39:0/2186572939 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:25.373 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78aeffd700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78b00a4d60 0x7f78b0134350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.373 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.361+0000 7f78affff700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b013a840 0x7f78b0134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.373 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78af7fe700 1 -- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b013a840 msgr2=0x7f78b0134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.373 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78af7fe700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b013a840 0x7f78b0134840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.374 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78af7fe700 1 -- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78b00a4d60 msgr2=0x7f78b0134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.374 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78af7fe700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78b00a4d60 0x7f78b0134350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.374 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78af7fe700 1 -- 172.21.15.39:0/2186572939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b009e400 con 0x7f78b009b100 2020-11-20T13:56:25.374 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78af7fe700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b009b100 0x7f78b009e8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f78a800c000 tx=0x7f78a80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:25.374 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78acff9700 1 -- 172.21.15.39:0/2186572939 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a800cb00 con 0x7f78b009b100 2020-11-20T13:56:25.375 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78acff9700 1 -- 172.21.15.39:0/2186572939 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a800cc60 con 0x7f78b009b100 2020-11-20T13:56:25.375 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b013d4f0 con 0x7f78b009b100 2020-11-20T13:56:25.375 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78acff9700 1 -- 172.21.15.39:0/2186572939 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a80123f0 con 0x7f78b009b100 2020-11-20T13:56:25.375 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.362+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b009efa0 con 0x7f78b009b100 2020-11-20T13:56:25.375 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.363+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b0057050 con 0x7f78b009b100 2020-11-20T13:56:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.363+0000 7f78acff9700 1 -- 172.21.15.39:0/2186572939 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f78a8022070 con 0x7f78b009b100 2020-11-20T13:56:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.364+0000 7f78acff9700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f78940511d0 0x7f7894053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.364+0000 7f78acff9700 1 -- 172.21.15.39:0/2186572939 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f78a8069500 con 0x7f78b009b100 2020-11-20T13:56:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.364+0000 7f78aeffd700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f78940511d0 0x7f7894053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.364+0000 7f78aeffd700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f78940511d0 0x7f7894053690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f789801b000 tx=0x7f7898015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:25.377 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.367+0000 7f78acff9700 1 -- 172.21.15.39:0/2186572939 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f78a8041820 con 0x7f78b009b100 2020-11-20T13:56:25.530 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.529+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78b009efa0 con 0x7f78b009b100 2020-11-20T13:56:25.531 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.530+0000 7f78acff9700 1 -- 172.21.15.39:0/2186572939 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f78b009efa0 con 0x7f78b009b100 2020-11-20T13:56:25.531 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:25.531 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":23,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:23.331627+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T13:56:15.768689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T13:56:18.856235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T13:56:19.656250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:25.532 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.531+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f78940511d0 msgr2=0x7f7894053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.533 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.531+0000 7f78b49b2700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f78940511d0 0x7f7894053690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f789801b000 tx=0x7f7898015000).stop 2020-11-20T13:56:25.533 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.531+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b009b100 msgr2=0x7f78b009e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.533 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.531+0000 7f78b49b2700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b009b100 0x7f78b009e8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f78a800c000 tx=0x7f78a80091a0).stop 2020-11-20T13:56:25.533 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.532+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 shutdown_connections 2020-11-20T13:56:25.533 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.532+0000 7f78b49b2700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f78940511d0 0x7f7894053690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.534 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.532+0000 7f78b49b2700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78b009b100 0x7f78b009e8f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.534 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.532+0000 7f78b49b2700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78b013a840 0x7f78b0134840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.534 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.532+0000 7f78b49b2700 1 --2- 172.21.15.39:0/2186572939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78b00a4d60 0x7f78b0134350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.534 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.532+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 >> 172.21.15.39:0/2186572939 conn(0x7f78b0061f10 msgr2=0x7f78b0069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:25.535 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.532+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 shutdown_connections 2020-11-20T13:56:25.535 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.532+0000 7f78b49b2700 1 -- 172.21.15.39:0/2186572939 wait complete. 2020-11-20T13:56:25.543 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-20T13:56:25.543 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-20T13:56:25.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.656+0000 7f0ed5d42700 1 Processor -- start 2020-11-20T13:56:25.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.657+0000 7f0ed5d42700 1 -- start start 2020-11-20T13:56:25.660 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.657+0000 7f0ed5d42700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00ab630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.660 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.657+0000 7f0ed5d42700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ed00ac9b0 0x7f0ed013cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.660 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.657+0000 7f0ed5d42700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed00a7f10 con 0x7f0ed013d010 2020-11-20T13:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.657+0000 7f0ed5d42700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed00aaf60 con 0x7f0ed00ac9b0 2020-11-20T13:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.657+0000 7f0ed5d42700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00a81b0 con 0x7f0ed00a9c60 2020-11-20T13:56:25.661 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0eceffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ed00ac9b0 0x7f0ed013cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ecf7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.662 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ecf7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00ab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.39:55712/0 (socket says 172.21.15.39:55712) 2020-11-20T13:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0eceffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ed00ac9b0 0x7f0ed013cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.39:44972/0 (socket says 172.21.15.39:44972) 2020-11-20T13:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ecf7fe700 1 -- 172.21.15.39:0/1732399940 learned_addr learned my addr 172.21.15.39:0/1732399940 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ecffff700 1 --1- 172.21.15.39:0/1732399940 >> v1:172.21.15.31:6789/0 conn(0x7f0ed013d010 0x7f0ed01399b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.39:37088/0 (socket says 172.21.15.39:37088) 2020-11-20T13:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ecf7fe700 1 -- 172.21.15.39:0/1732399940 >> v2:172.21.15.31:3300/0 conn(0x7f0ed00ac9b0 msgr2=0x7f0ed013cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:25.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ecf7fe700 1 --2- 172.21.15.39:0/1732399940 >> v2:172.21.15.31:3300/0 conn(0x7f0ed00ac9b0 0x7f0ed013cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ecf7fe700 1 -- 172.21.15.39:0/1732399940 >> v1:172.21.15.31:6789/0 conn(0x7f0ed013d010 legacy=0x7f0ed01399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ecf7fe700 1 -- 172.21.15.39:0/1732399940 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00aa410 con 0x7f0ed00a9c60 2020-11-20T13:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ecf7fe700 1 --2- 172.21.15.39:0/1732399940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00ab630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0ec0002f30 tx=0x7f0ec0006e80).ready entity=mon.2 client_cookie=7c1df574b5459a61 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ece7fc700 1 -- 172.21.15.39:0/1732399940 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec00097f0 con 0x7f0ed00a9c60 2020-11-20T13:56:25.664 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ece7fc700 1 -- 172.21.15.39:0/1732399940 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec0009950 con 0x7f0ed00a9c60 2020-11-20T13:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ece7fc700 1 -- 172.21.15.39:0/1732399940 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec0009cb0 con 0x7f0ed00a9c60 2020-11-20T13:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ed5d42700 1 -- 172.21.15.39:0/1732399940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 msgr2=0x7f0ed00ab630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.658+0000 7f0ed5d42700 1 --2- 172.21.15.39:0/1732399940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00ab630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0ec0002f30 tx=0x7f0ec0006e80).stop 2020-11-20T13:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.659+0000 7f0ed5d42700 1 -- 172.21.15.39:0/1732399940 shutdown_connections 2020-11-20T13:56:25.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.659+0000 7f0ed5d42700 1 --2- 172.21.15.39:0/1732399940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00ab630 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.659+0000 7f0ed5d42700 1 --2- 172.21.15.39:0/1732399940 >> v2:172.21.15.31:3300/0 conn(0x7f0ed00ac9b0 0x7f0ed013cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.659+0000 7f0ed5d42700 1 -- 172.21.15.39:0/1732399940 >> 172.21.15.39:0/1732399940 conn(0x7f0ed005f360 msgr2=0x7f0ed005f770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:25.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.659+0000 7f0ed5d42700 1 -- 172.21.15.39:0/1732399940 shutdown_connections 2020-11-20T13:56:25.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.659+0000 7f0ed5d42700 1 -- 172.21.15.39:0/1732399940 wait complete. 2020-11-20T13:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.660+0000 7f0ed5d42700 1 Processor -- start 2020-11-20T13:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.660+0000 7f0ed5d42700 1 -- start start 2020-11-20T13:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.660+0000 7f0ed5d42700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.660+0000 7f0ed5d42700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed00ac9b0 0x7f0ed00a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.660+0000 7f0ed5d42700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed013d010 0x7f0ed0137780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.660+0000 7f0ed5d42700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0063890 con 0x7f0ed00ac9b0 2020-11-20T13:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.660+0000 7f0ed5d42700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00a47d0 con 0x7f0ed013d010 2020-11-20T13:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.660+0000 7f0ed5d42700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0062a60 con 0x7f0ed00a9c60 2020-11-20T13:56:25.670 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.660+0000 7f0ecffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed013d010 0x7f0ed0137780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ecffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed013d010 0x7f0ed0137780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45264/0 (socket says 172.21.15.39:45264) 2020-11-20T13:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ecffff700 1 -- 172.21.15.39:0/853489577 learned_addr learned my addr 172.21.15.39:0/853489577 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0eceffd700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed00ac9b0 0x7f0ed00a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ecf7fe700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.671 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ecffff700 1 -- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 msgr2=0x7f0ed00a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ecffff700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00a3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ecffff700 1 -- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed00ac9b0 msgr2=0x7f0ed00a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ecffff700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed00ac9b0 0x7f0ed00a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ecffff700 1 -- 172.21.15.39:0/853489577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00a3690 con 0x7f0ed013d010 2020-11-20T13:56:25.672 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ecffff700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed013d010 0x7f0ed0137780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0ed00a4910 tx=0x7f0ec8007e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:25.673 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0eccff9700 1 -- 172.21.15.39:0/853489577 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec8005ab0 con 0x7f0ed013d010 2020-11-20T13:56:25.673 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0eccff9700 1 -- 172.21.15.39:0/853489577 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec8005c10 con 0x7f0ed013d010 2020-11-20T13:56:25.673 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed0062cf0 con 0x7f0ed013d010 2020-11-20T13:56:25.673 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0eccff9700 1 -- 172.21.15.39:0/853489577 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec8007110 con 0x7f0ed013d010 2020-11-20T13:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.661+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed0063aa0 con 0x7f0ed013d010 2020-11-20T13:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.662+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed0057050 con 0x7f0ed013d010 2020-11-20T13:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.662+0000 7f0eccff9700 1 -- 172.21.15.39:0/853489577 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f0ec8010030 con 0x7f0ed013d010 2020-11-20T13:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.663+0000 7f0eccff9700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0eb0051270 0x7f0eb0053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:25.674 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.663+0000 7f0eccff9700 1 -- 172.21.15.39:0/853489577 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0ec8068d10 con 0x7f0ed013d010 2020-11-20T13:56:25.675 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.663+0000 7f0ecf7fe700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0eb0051270 0x7f0eb0053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:25.675 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.663+0000 7f0ecf7fe700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0eb0051270 0x7f0eb0053730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0ec001c000 tx=0x7f0ec0015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:25.675 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.666+0000 7f0eccff9700 1 -- 172.21.15.39:0/853489577 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f0ec80410d0 con 0x7f0ed013d010 2020-11-20T13:56:25.828 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.828+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ed005d5e0 con 0x7f0ed013d010 2020-11-20T13:56:25.914 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.829+0000 7f0eccff9700 1 -- 172.21.15.39:0/853489577 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f0ec80446f0 con 0x7f0ed013d010 2020-11-20T13:56:25.914 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0eb0051270 msgr2=0x7f0eb0053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.914 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0eb0051270 0x7f0eb0053730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0ec001c000 tx=0x7f0ec0015000).stop 2020-11-20T13:56:25.915 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed013d010 msgr2=0x7f0ed0137780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:25.915 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed013d010 0x7f0ed0137780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0ed00a4910 tx=0x7f0ec8007e80).stop 2020-11-20T13:56:25.915 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 shutdown_connections 2020-11-20T13:56:25.915 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0eb0051270 0x7f0eb0053730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.916 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed013d010 0x7f0ed0137780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.916 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed00a9c60 0x7f0ed00a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.916 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 --2- 172.21.15.39:0/853489577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed00ac9b0 0x7f0ed00a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:25.916 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 >> 172.21.15.39:0/853489577 conn(0x7f0ed005f360 msgr2=0x7f0ed013c620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:25.916 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 shutdown_connections 2020-11-20T13:56:25.917 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:25.830+0000 7f0ed5d42700 1 -- 172.21.15.39:0/853489577 wait complete. 2020-11-20T13:56:25.917 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:25.917 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":23,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:23.331627+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T13:56:15.768689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T13:56:18.856235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T13:56:19.656250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:25.918 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-11-20T13:56:26.033 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.033+0000 7f4b5b381700 1 Processor -- start 2020-11-20T13:56:26.034 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.033+0000 7f4b5b381700 1 -- start start 2020-11-20T13:56:26.037 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.033+0000 7f4b5b381700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b540a5080 0x7f4b54066ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.037 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.033+0000 7f4b5b381700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b540a0b00 con 0x7f4b5405c850 2020-11-20T13:56:26.037 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.033+0000 7f4b5b381700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b540a06d0 con 0x7f4b5405bcb0 2020-11-20T13:56:26.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.033+0000 7f4b5b381700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5409f630 con 0x7f4b540a5080 2020-11-20T13:56:26.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b5891c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4b5405bcb0 0x7f4b5405c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35440/0 (socket says 172.21.15.39:35440) 2020-11-20T13:56:26.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b5891c700 1 -- 172.21.15.39:0/2794847108 learned_addr learned my addr 172.21.15.39:0/2794847108 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:26.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b5911d700 1 --2- 172.21.15.39:0/2794847108 >> v2:172.21.15.31:3300/0 conn(0x7f4b540a5080 0x7f4b54066ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.038 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535486245 0 0) 0x7f4b540a06d0 con 0x7f4b5405bcb0 2020-11-20T13:56:26.039 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b3c003230 con 0x7f4b5405bcb0 2020-11-20T13:56:26.039 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2928908429 0 0) 0x7f4b3c003230 con 0x7f4b5405bcb0 2020-11-20T13:56:26.040 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 >> v2:172.21.15.31:3300/0 conn(0x7f4b540a5080 msgr2=0x7f4b54066ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.040 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 --2- 172.21.15.39:0/2794847108 >> v2:172.21.15.31:3300/0 conn(0x7f4b540a5080 0x7f4b54066ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.040 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 >> v1:172.21.15.31:6789/0 conn(0x7f4b5405c850 legacy=0x7f4b54141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.042 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b540a0d60 con 0x7f4b5405bcb0 2020-11-20T13:56:26.043 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7f4b500016d0 con 0x7f4b5405bcb0 2020-11-20T13:56:26.043 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 >> v1:172.21.15.39:6789/0 conn(0x7f4b5405bcb0 legacy=0x7f4b5405c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.043 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b3c003720 0x7f4b3c003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.043 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b3c0044d0 0x7f4b3c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b3c004e40 0x7f4b3c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5409f630 con 0x7f4b3c0044d0 2020-11-20T13:56:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c00bc10 con 0x7f4b3c004e40 2020-11-20T13:56:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c00bd50 con 0x7f4b3c003720 2020-11-20T13:56:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b5991e700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b3c004e40 0x7f4b3c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b5891c700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b3c0044d0 0x7f4b3c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.034+0000 7f4b5911d700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b3c003720 0x7f4b3c003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5991e700 1 -- 172.21.15.39:0/2794847108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b3c003720 msgr2=0x7f4b3c003b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5991e700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b3c003720 0x7f4b3c003b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5991e700 1 -- 172.21.15.39:0/2794847108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b3c0044d0 msgr2=0x7f4b3c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.046 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5991e700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b3c0044d0 0x7f4b3c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.046 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5991e700 1 -- 172.21.15.39:0/2794847108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c003230 con 0x7f4b3c004e40 2020-11-20T13:56:26.046 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5991e700 1 -- 172.21.15.39:0/2794847108 reap_dead start 2020-11-20T13:56:26.046 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5991e700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b3c004e40 0x7f4b3c00b720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4b5405d1e0 tx=0x7f4b4c007e50).ready entity=mon.1 client_cookie=92c36f5eee7e308c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.046 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b4c00c960 con 0x7f4b3c004e40 2020-11-20T13:56:26.047 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c00cac0 con 0x7f4b3c004e40 2020-11-20T13:56:26.047 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b47fff700 1 -- 172.21.15.39:0/2794847108 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b4c00ce20 con 0x7f4b3c004e40 2020-11-20T13:56:26.047 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5b381700 1 -- 172.21.15.39:0/2794847108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b3c004e40 msgr2=0x7f4b3c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.047 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5b381700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b3c004e40 0x7f4b3c00b720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4b5405d1e0 tx=0x7f4b4c007e50).stop 2020-11-20T13:56:26.047 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5b381700 1 -- 172.21.15.39:0/2794847108 shutdown_connections 2020-11-20T13:56:26.048 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5b381700 1 --2- 172.21.15.39:0/2794847108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b3c004e40 0x7f4b3c00b720 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.048 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5b381700 1 -- 172.21.15.39:0/2794847108 >> 172.21.15.39:0/2794847108 conn(0x7f4b540ab870 msgr2=0x7f4b540abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.048 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5b381700 1 -- 172.21.15.39:0/2794847108 shutdown_connections 2020-11-20T13:56:26.048 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.035+0000 7f4b5b381700 1 -- 172.21.15.39:0/2794847108 wait complete. 2020-11-20T13:56:26.048 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.036+0000 7f4b5b381700 1 Processor -- start 2020-11-20T13:56:26.049 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.036+0000 7f4b5b381700 1 -- start start 2020-11-20T13:56:26.052 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5b381700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b3c004e40 0x7f4b54148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.052 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5b381700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b54066470 0x7f4b54148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.052 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5b381700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b5409bf60 0x7f4b54137320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.052 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5b381700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54149200 con 0x7f4b54066470 2020-11-20T13:56:26.053 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5b381700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540a5780 con 0x7f4b5409bf60 2020-11-20T13:56:26.053 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5b381700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5409d5f0 con 0x7f4b3c004e40 2020-11-20T13:56:26.053 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5991e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b5409bf60 0x7f4b54137320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5991e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b5409bf60 0x7f4b54137320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45282/0 (socket says 172.21.15.39:45282) 2020-11-20T13:56:26.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5991e700 1 -- 172.21.15.39:0/4230851190 learned_addr learned my addr 172.21.15.39:0/4230851190 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5891c700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b54066470 0x7f4b54148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5911d700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b3c004e40 0x7f4b54148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5991e700 1 -- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b3c004e40 msgr2=0x7f4b54148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5991e700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b3c004e40 0x7f4b54148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5991e700 1 -- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b54066470 msgr2=0x7f4b54148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5991e700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b54066470 0x7f4b54148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5991e700 1 -- 172.21.15.39:0/4230851190 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5409d890 con 0x7f4b5409bf60 2020-11-20T13:56:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5891c700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b54066470 0x7f4b54148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5911d700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b3c004e40 0x7f4b54148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b5991e700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b5409bf60 0x7f4b54137320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4b5405d1e0 tx=0x7f4b4c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b467fc700 1 -- 172.21.15.39:0/4230851190 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b4c012d70 con 0x7f4b5409bf60 2020-11-20T13:56:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.037+0000 7f4b467fc700 1 -- 172.21.15.39:0/4230851190 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c01d420 con 0x7f4b5409bf60 2020-11-20T13:56:26.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.038+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5409db30 con 0x7f4b5409bf60 2020-11-20T13:56:26.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.038+0000 7f4b467fc700 1 -- 172.21.15.39:0/4230851190 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b4c01d780 con 0x7f4b5409bf60 2020-11-20T13:56:26.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.038+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b54066a20 con 0x7f4b5409bf60 2020-11-20T13:56:26.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.038+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b54148510 con 0x7f4b5409bf60 2020-11-20T13:56:26.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.039+0000 7f4b467fc700 1 -- 172.21.15.39:0/4230851190 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f4b4c024030 con 0x7f4b5409bf60 2020-11-20T13:56:26.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.039+0000 7f4b467fc700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4b340512f0 0x7f4b340537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.039+0000 7f4b467fc700 1 -- 172.21.15.39:0/4230851190 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b4c069a20 con 0x7f4b5409bf60 2020-11-20T13:56:26.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.039+0000 7f4b467fc700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.39:6800/22475,v1:172.21.15.39:6801/22475] conn(0x7f4b34058770 0x7f4b3405ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.039+0000 7f4b5911d700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4b340512f0 0x7f4b340537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.039+0000 7f4b467fc700 1 -- 172.21.15.39:0/4230851190 --> [v2:172.21.15.39:6800/22475,v1:172.21.15.39:6801/22475] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b3405b1e0 con 0x7f4b34058770 2020-11-20T13:56:26.059 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.039+0000 7f4b467fc700 1 -- 172.21.15.39:0/4230851190 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b4c06e240 con 0x7f4b5409bf60 2020-11-20T13:56:26.060 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.039+0000 7f4b5891c700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.39:6800/22475,v1:172.21.15.39:6801/22475] conn(0x7f4b34058770 0x7f4b3405ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.060 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.039+0000 7f4b5911d700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4b340512f0 0x7f4b340537b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4b48008000 tx=0x7f4b48008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.060 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.040+0000 7f4b5891c700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.39:6800/22475,v1:172.21.15.39:6801/22475] conn(0x7f4b34058770 0x7f4b3405ab90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.060 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.040+0000 7f4b467fc700 1 -- 172.21.15.39:0/4230851190 <== osd.0 v2:172.21.15.39:6800/22475 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f4b3405b1e0 con 0x7f4b34058770 2020-11-20T13:56:26.063 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.056+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 --> [v2:172.21.15.39:6800/22475,v1:172.21.15.39:6801/22475] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b54137e50 con 0x7f4b34058770 2020-11-20T13:56:26.063 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b467fc700 1 -- 172.21.15.39:0/4230851190 <== osd.0 v2:172.21.15.39:6800/22475 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b54137e50 con 0x7f4b34058770 2020-11-20T13:56:26.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 >> [v2:172.21.15.39:6800/22475,v1:172.21.15.39:6801/22475] conn(0x7f4b34058770 msgr2=0x7f4b3405ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.39:6800/22475,v1:172.21.15.39:6801/22475] conn(0x7f4b34058770 0x7f4b3405ab90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4b340512f0 msgr2=0x7f4b340537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4b340512f0 0x7f4b340537b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4b48008000 tx=0x7f4b48008040).stop 2020-11-20T13:56:26.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b5409bf60 msgr2=0x7f4b54137320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 --2- 172.21.15.39:0/4230851190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b5409bf60 0x7f4b54137320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4b5405d1e0 tx=0x7f4b4c015000).stop 2020-11-20T13:56:26.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5991e700 1 -- 172.21.15.39:0/4230851190 reap_dead start 2020-11-20T13:56:26.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 shutdown_connections 2020-11-20T13:56:26.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 >> 172.21.15.39:0/4230851190 conn(0x7f4b540ab870 msgr2=0x7f4b540a9770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 shutdown_connections 2020-11-20T13:56:26.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.057+0000 7f4b5b381700 1 -- 172.21.15.39:0/4230851190 wait complete. 2020-11-20T13:56:26.068 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:26.068 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-11-20T13:56:26.184 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.183+0000 7f586359e700 1 Processor -- start 2020-11-20T13:56:26.184 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.183+0000 7f586359e700 1 -- start start 2020-11-20T13:56:26.193 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.183+0000 7f586359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58640a4fe0 0x7f5864136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.193 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.183+0000 7f586359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640a3be0 con 0x7f58640a7380 2020-11-20T13:56:26.193 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.183+0000 7f586359e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640a54b0 con 0x7f5864136c30 2020-11-20T13:56:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.183+0000 7f586359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586409bb70 con 0x7f58640a4fe0 2020-11-20T13:56:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5862d9d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5864136c30 0x7f5864140a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35464/0 (socket says 172.21.15.39:35464) 2020-11-20T13:56:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5862d9d700 1 -- 172.21.15.39:0/1735658780 learned_addr learned my addr 172.21.15.39:0/1735658780 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810297898 0 0) 0x7f58640a54b0 con 0x7f5864136c30 2020-11-20T13:56:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f585bfff700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58640a4fe0 0x7f5864136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.195 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5844003230 con 0x7f5864136c30 2020-11-20T13:56:26.195 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2453643532 0 0) 0x7f5844003230 con 0x7f5864136c30 2020-11-20T13:56:26.196 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58640a4fe0 msgr2=0x7f5864136740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.196 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58640a4fe0 0x7f5864136740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.196 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 >> v1:172.21.15.31:6789/0 conn(0x7f58640a7380 legacy=0x7f58640a34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.196 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58640a5750 con 0x7f5864136c30 2020-11-20T13:56:26.197 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7f585c001a50 con 0x7f5864136c30 2020-11-20T13:56:26.197 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 >> v1:172.21.15.39:6789/0 conn(0x7f5864136c30 legacy=0x7f5864140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.197 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5844003720 0x7f5844003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.197 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58440044d0 0x7f5844004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.198 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58640a4fe0 0x7f5844004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.198 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844005350 con 0x7f58440044d0 2020-11-20T13:56:26.198 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844004290 con 0x7f5844003720 2020-11-20T13:56:26.198 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584400d930 con 0x7f58640a4fe0 2020-11-20T13:56:26.198 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f586259c700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5844003720 0x7f5844003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.199 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f5862d9d700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58640a4fe0 0x7f5844004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.199 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.184+0000 7f585bfff700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58440044d0 0x7f5844004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.199 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586259c700 1 -- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58640a4fe0 msgr2=0x7f5844004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.199 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586259c700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58640a4fe0 0x7f5844004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.199 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586259c700 1 -- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58440044d0 msgr2=0x7f5844004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.200 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586259c700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58440044d0 0x7f5844004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.200 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586259c700 1 -- 172.21.15.39:0/1735658780 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844003230 con 0x7f5844003720 2020-11-20T13:56:26.200 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f5862d9d700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58640a4fe0 0x7f5844004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:26.200 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f585bfff700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58440044d0 0x7f5844004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:26.200 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586259c700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5844003720 0x7f5844003b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f586405fe60 tx=0x7f5854007ad0).ready entity=mon.1 client_cookie=9d143c99c2debf2f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.201 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f585400c680 con 0x7f5844003720 2020-11-20T13:56:26.201 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585400c7e0 con 0x7f5844003720 2020-11-20T13:56:26.201 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f5861d9b700 1 -- 172.21.15.39:0/1735658780 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f585400cb40 con 0x7f5844003720 2020-11-20T13:56:26.201 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586359e700 1 -- 172.21.15.39:0/1735658780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5844003720 msgr2=0x7f5844003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.202 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586359e700 1 --2- 172.21.15.39:0/1735658780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5844003720 0x7f5844003b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f586405fe60 tx=0x7f5854007ad0).stop 2020-11-20T13:56:26.202 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f5862d9d700 1 -- 172.21.15.39:0/1735658780 reap_dead start 2020-11-20T13:56:26.202 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586359e700 1 -- 172.21.15.39:0/1735658780 shutdown_connections 2020-11-20T13:56:26.203 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586359e700 1 -- 172.21.15.39:0/1735658780 >> 172.21.15.39:0/1735658780 conn(0x7f5864061f10 msgr2=0x7f58640ab550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.203 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586359e700 1 -- 172.21.15.39:0/1735658780 shutdown_connections 2020-11-20T13:56:26.203 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.185+0000 7f586359e700 1 -- 172.21.15.39:0/1735658780 wait complete. 2020-11-20T13:56:26.204 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.186+0000 7f586359e700 1 Processor -- start 2020-11-20T13:56:26.204 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.186+0000 7f586359e700 1 -- start start 2020-11-20T13:56:26.204 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f586409c7a0 0x7f5864138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.204 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f586413a680 0x7f5864138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.204 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5864133110 0x7f5864133590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.205 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864138b70 con 0x7f5864133110 2020-11-20T13:56:26.205 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586359e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58640ac100 con 0x7f586409c7a0 2020-11-20T13:56:26.205 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586359e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58640a5bf0 con 0x7f586413a680 2020-11-20T13:56:26.205 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f586409c7a0 0x7f5864138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.205 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f586409c7a0 0x7f5864138190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45300/0 (socket says 172.21.15.39:45300) 2020-11-20T13:56:26.206 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586259c700 1 -- 172.21.15.39:0/2992091198 learned_addr learned my addr 172.21.15.39:0/2992091198 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.206 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f5862d9d700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5864133110 0x7f5864133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.207 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f585bfff700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f586413a680 0x7f5864138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.207 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586259c700 1 -- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f586413a680 msgr2=0x7f5864138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.207 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586259c700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f586413a680 0x7f5864138680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.207 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586259c700 1 -- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5864133110 msgr2=0x7f5864133590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.207 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586259c700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5864133110 0x7f5864133590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.208 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586259c700 1 -- 172.21.15.39:0/2992091198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5864137670 con 0x7f586409c7a0 2020-11-20T13:56:26.208 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586259c700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f586409c7a0 0x7f5864138190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f586405fe60 tx=0x7f5854017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.208 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f585b7fe700 1 -- 172.21.15.39:0/2992091198 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5854012790 con 0x7f586409c7a0 2020-11-20T13:56:26.208 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f585b7fe700 1 -- 172.21.15.39:0/2992091198 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58540128f0 con 0x7f586409c7a0 2020-11-20T13:56:26.209 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f585b7fe700 1 -- 172.21.15.39:0/2992091198 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5854012c50 con 0x7f586409c7a0 2020-11-20T13:56:26.209 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5864137910 con 0x7f586409c7a0 2020-11-20T13:56:26.209 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.187+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58641372f0 con 0x7f586409c7a0 2020-11-20T13:56:26.209 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.188+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5864057050 con 0x7f586409c7a0 2020-11-20T13:56:26.209 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f585b7fe700 1 -- 172.21.15.39:0/2992091198 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f5854010070 con 0x7f586409c7a0 2020-11-20T13:56:26.210 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f585b7fe700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5848051390 0x7f5848053850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.210 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f585b7fe700 1 -- 172.21.15.39:0/2992091198 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5854069990 con 0x7f586409c7a0 2020-11-20T13:56:26.210 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f585b7fe700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.39:6816/22477,v1:172.21.15.39:6817/22477] conn(0x7f5848058810 0x7f584805ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.210 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f585b7fe700 1 -- 172.21.15.39:0/2992091198 --> [v2:172.21.15.39:6816/22477,v1:172.21.15.39:6817/22477] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f584805b280 con 0x7f5848058810 2020-11-20T13:56:26.211 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f585b7fe700 1 -- 172.21.15.39:0/2992091198 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f585406e240 con 0x7f586409c7a0 2020-11-20T13:56:26.211 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f585bfff700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5848051390 0x7f5848053850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.211 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f5862d9d700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.39:6816/22477,v1:172.21.15.39:6817/22477] conn(0x7f5848058810 0x7f584805ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.212 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f585bfff700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5848051390 0x7f5848053850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f584c008000 tx=0x7f584c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.212 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.189+0000 7f5862d9d700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.39:6816/22477,v1:172.21.15.39:6817/22477] conn(0x7f5848058810 0x7f584805ac30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.213 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.190+0000 7f585b7fe700 1 -- 172.21.15.39:0/2992091198 <== osd.1 v2:172.21.15.39:6816/22477 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f584805b280 con 0x7f5848058810 2020-11-20T13:56:26.214 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.206+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 --> [v2:172.21.15.39:6816/22477,v1:172.21.15.39:6817/22477] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f58640a9ac0 con 0x7f5848058810 2020-11-20T13:56:26.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.206+0000 7f585b7fe700 1 -- 172.21.15.39:0/2992091198 <== osd.1 v2:172.21.15.39:6816/22477 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f58640a9ac0 con 0x7f5848058810 2020-11-20T13:56:26.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 >> [v2:172.21.15.39:6816/22477,v1:172.21.15.39:6817/22477] conn(0x7f5848058810 msgr2=0x7f584805ac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.39:6816/22477,v1:172.21.15.39:6817/22477] conn(0x7f5848058810 0x7f584805ac30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5848051390 msgr2=0x7f5848053850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f5848051390 0x7f5848053850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f584c008000 tx=0x7f584c008040).stop 2020-11-20T13:56:26.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f586409c7a0 msgr2=0x7f5864138190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 --2- 172.21.15.39:0/2992091198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f586409c7a0 0x7f5864138190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f586405fe60 tx=0x7f5854017000).stop 2020-11-20T13:56:26.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f5862d9d700 1 -- 172.21.15.39:0/2992091198 reap_dead start 2020-11-20T13:56:26.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 shutdown_connections 2020-11-20T13:56:26.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 >> 172.21.15.39:0/2992091198 conn(0x7f5864061f10 msgr2=0x7f586405c400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 shutdown_connections 2020-11-20T13:56:26.218 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.207+0000 7f586359e700 1 -- 172.21.15.39:0/2992091198 wait complete. 2020-11-20T13:56:26.219 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2020-11-20T13:56:26.219 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-11-20T13:56:26.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.336+0000 7f6319209700 1 Processor -- start 2020-11-20T13:56:26.337 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.336+0000 7f6319209700 1 -- start start 2020-11-20T13:56:26.342 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6319209700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f631405c8c0 0x7f63140a2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.342 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6319209700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140a3c80 0x7f631409b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.342 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6319209700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63140a5270 con 0x7f63140a5f80 2020-11-20T13:56:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6319209700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63140a54a0 con 0x7f631405c8c0 2020-11-20T13:56:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6319209700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63140a4190 con 0x7f63140a3c80 2020-11-20T13:56:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f631359e700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f63140a5f80 0x7f63140a6430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35486/0 (socket says 172.21.15.39:35486) 2020-11-20T13:56:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f631359e700 1 -- 172.21.15.39:0/3817579203 learned_addr learned my addr 172.21.15.39:0/3817579203 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f631259c700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140a3c80 0x7f631409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.344 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6312d9d700 1 --2- 172.21.15.39:0/3817579203 >> v2:172.21.15.31:3300/0 conn(0x7f631405c8c0 0x7f63140a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.344 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170891134 0 0) 0x7f63140a5270 con 0x7f63140a5f80 2020-11-20T13:56:26.344 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f8003230 con 0x7f63140a5f80 2020-11-20T13:56:26.344 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1740789414 0 0) 0x7f62f8003230 con 0x7f63140a5f80 2020-11-20T13:56:26.344 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140a3c80 msgr2=0x7f631409b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.345 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140a3c80 0x7f631409b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.345 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 >> v2:172.21.15.31:3300/0 conn(0x7f631405c8c0 msgr2=0x7f63140a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.345 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 --2- 172.21.15.39:0/3817579203 >> v2:172.21.15.31:3300/0 conn(0x7f631405c8c0 0x7f63140a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.345 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140a4430 con 0x7f63140a5f80 2020-11-20T13:56:26.345 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7f630c001a50 con 0x7f63140a5f80 2020-11-20T13:56:26.346 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 >> v1:172.21.15.39:6789/0 conn(0x7f63140a5f80 legacy=0x7f63140a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.346 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f8003720 0x7f62f8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.346 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f80044d0 0x7f62f8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.346 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140a3c80 0x7f62f8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.347 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140a54a0 con 0x7f62f8003720 2020-11-20T13:56:26.347 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140a4190 con 0x7f62f80044d0 2020-11-20T13:56:26.347 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.337+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8004260 con 0x7f63140a3c80 2020-11-20T13:56:26.347 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f631259c700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f80044d0 0x7f62f8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.347 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f6312d9d700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f8003720 0x7f62f8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.348 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f631359e700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140a3c80 0x7f62f8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.348 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f631259c700 1 -- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140a3c80 msgr2=0x7f62f8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.348 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f631259c700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140a3c80 0x7f62f8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.348 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f631259c700 1 -- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f8003720 msgr2=0x7f62f8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.348 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f631259c700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f8003720 0x7f62f8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.349 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f631259c700 1 -- 172.21.15.39:0/3817579203 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8003230 con 0x7f62f80044d0 2020-11-20T13:56:26.349 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f631259c700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f80044d0 0x7f62f8004950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f630400c000 tx=0x7f6304008040).ready entity=mon.1 client_cookie=536d053be7329384 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.349 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f630400e8a0 con 0x7f62f80044d0 2020-11-20T13:56:26.349 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630400ea00 con 0x7f62f80044d0 2020-11-20T13:56:26.350 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f6311d9b700 1 -- 172.21.15.39:0/3817579203 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f630400ed60 con 0x7f62f80044d0 2020-11-20T13:56:26.350 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f6319209700 1 -- 172.21.15.39:0/3817579203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f80044d0 msgr2=0x7f62f8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.350 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f6319209700 1 --2- 172.21.15.39:0/3817579203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f80044d0 0x7f62f8004950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f630400c000 tx=0x7f6304008040).stop 2020-11-20T13:56:26.350 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.338+0000 7f631359e700 1 -- 172.21.15.39:0/3817579203 reap_dead start 2020-11-20T13:56:26.350 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.339+0000 7f6319209700 1 -- 172.21.15.39:0/3817579203 shutdown_connections 2020-11-20T13:56:26.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.339+0000 7f6319209700 1 -- 172.21.15.39:0/3817579203 >> 172.21.15.39:0/3817579203 conn(0x7f63140ab870 msgr2=0x7f63140abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.339+0000 7f6319209700 1 -- 172.21.15.39:0/3817579203 shutdown_connections 2020-11-20T13:56:26.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.339+0000 7f6319209700 1 -- 172.21.15.39:0/3817579203 wait complete. 2020-11-20T13:56:26.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.339+0000 7f6319209700 1 Processor -- start 2020-11-20T13:56:26.351 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f6319209700 1 -- start start 2020-11-20T13:56:26.352 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f6319209700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63140a0d30 0x7f631409bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.352 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f6319209700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140632f0 0x7f631409c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.352 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f6319209700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6314134280 0x7f6314134730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.352 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f6319209700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631409c510 con 0x7f63140a0d30 2020-11-20T13:56:26.352 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f6319209700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631409df90 con 0x7f6314134280 2020-11-20T13:56:26.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f6319209700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631409e230 con 0x7f63140632f0 2020-11-20T13:56:26.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f631359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6314134280 0x7f6314134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f631259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140632f0 0x7f631409c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f631359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6314134280 0x7f6314134730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45326/0 (socket says 172.21.15.39:45326) 2020-11-20T13:56:26.353 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f631259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140632f0 0x7f631409c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.39:55782/0 (socket says 172.21.15.39:55782) 2020-11-20T13:56:26.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f631359e700 1 -- 172.21.15.39:0/2955398392 learned_addr learned my addr 172.21.15.39:0/2955398392 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.340+0000 7f6312d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63140a0d30 0x7f631409bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f631359e700 1 -- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140632f0 msgr2=0x7f631409c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f631359e700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140632f0 0x7f631409c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f631359e700 1 -- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63140a0d30 msgr2=0x7f631409bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f631359e700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63140a0d30 0x7f631409bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f631359e700 1 -- 172.21.15.39:0/2955398392 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631409e4d0 con 0x7f6314134280 2020-11-20T13:56:26.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f631259c700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63140632f0 0x7f631409c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:26.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f631359e700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6314134280 0x7f6314134730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f6314063770 tx=0x7f63140a45c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f6303fff700 1 -- 172.21.15.39:0/2955398392 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f630c00fb00 con 0x7f6314134280 2020-11-20T13:56:26.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f6303fff700 1 -- 172.21.15.39:0/2955398392 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c00fc60 con 0x7f6314134280 2020-11-20T13:56:26.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f6303fff700 1 -- 172.21.15.39:0/2955398392 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f630c012350 con 0x7f6314134280 2020-11-20T13:56:26.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6314134c20 con 0x7f6314134280 2020-11-20T13:56:26.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.341+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631409dbf0 con 0x7f6314134280 2020-11-20T13:56:26.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.342+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f631409b890 con 0x7f6314134280 2020-11-20T13:56:26.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.342+0000 7f6303fff700 1 -- 172.21.15.39:0/2955398392 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f630c0124b0 con 0x7f6314134280 2020-11-20T13:56:26.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.342+0000 7f6303fff700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f62f00512e0 0x7f62f00537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.342+0000 7f6303fff700 1 -- 172.21.15.39:0/2955398392 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f630c0686a0 con 0x7f6314134280 2020-11-20T13:56:26.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.342+0000 7f6303fff700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.39:6806/22476,v1:172.21.15.39:6808/22476] conn(0x7f62f0058760 0x7f62f005ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.342+0000 7f6303fff700 1 -- 172.21.15.39:0/2955398392 --> [v2:172.21.15.39:6806/22476,v1:172.21.15.39:6808/22476] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62f005b1d0 con 0x7f62f0058760 2020-11-20T13:56:26.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.342+0000 7f6303fff700 1 -- 172.21.15.39:0/2955398392 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f630c06ad30 con 0x7f6314134280 2020-11-20T13:56:26.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.342+0000 7f6312d9d700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f62f00512e0 0x7f62f00537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.343+0000 7f631259c700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.39:6806/22476,v1:172.21.15.39:6808/22476] conn(0x7f62f0058760 0x7f62f005ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.360 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.343+0000 7f6312d9d700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f62f00512e0 0x7f62f00537a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6308008000 tx=0x7f6308008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.360 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.343+0000 7f631259c700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.39:6806/22476,v1:172.21.15.39:6808/22476] conn(0x7f62f0058760 0x7f62f005ab80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.361 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.344+0000 7f6303fff700 1 -- 172.21.15.39:0/2955398392 <== osd.2 v2:172.21.15.39:6806/22476 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f62f005b1d0 con 0x7f62f0058760 2020-11-20T13:56:26.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 --> [v2:172.21.15.39:6806/22476,v1:172.21.15.39:6808/22476] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f63140abf40 con 0x7f62f0058760 2020-11-20T13:56:26.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6303fff700 1 -- 172.21.15.39:0/2955398392 <== osd.2 v2:172.21.15.39:6806/22476 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f63140abf40 con 0x7f62f0058760 2020-11-20T13:56:26.362 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 >> [v2:172.21.15.39:6806/22476,v1:172.21.15.39:6808/22476] conn(0x7f62f0058760 msgr2=0x7f62f005ab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.39:6806/22476,v1:172.21.15.39:6808/22476] conn(0x7f62f0058760 0x7f62f005ab80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f62f00512e0 msgr2=0x7f62f00537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f62f00512e0 0x7f62f00537a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6308008000 tx=0x7f6308008040).stop 2020-11-20T13:56:26.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6314134280 msgr2=0x7f6314134730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 --2- 172.21.15.39:0/2955398392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6314134280 0x7f6314134730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f6314063770 tx=0x7f63140a45c0).stop 2020-11-20T13:56:26.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f631359e700 1 -- 172.21.15.39:0/2955398392 reap_dead start 2020-11-20T13:56:26.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 shutdown_connections 2020-11-20T13:56:26.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 >> 172.21.15.39:0/2955398392 conn(0x7f63140ab870 msgr2=0x7f63141388a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 shutdown_connections 2020-11-20T13:56:26.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.360+0000 7f6319209700 1 -- 172.21.15.39:0/2955398392 wait complete. 2020-11-20T13:56:26.371 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2020-11-20T13:56:26.371 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-11-20T13:56:26.492 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.485+0000 7fb5d89e9700 1 Processor -- start 2020-11-20T13:56:26.492 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.485+0000 7fb5d89e9700 1 -- start start 2020-11-20T13:56:26.492 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d89e9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb5d40a04a0 0x7fb5d409fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.493 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d89e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d413df10 0x7fb5d4140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.494 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d89e9700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d40a02f0 con 0x7fb5d40a74e0 2020-11-20T13:56:26.494 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d89e9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d40a0050 con 0x7fb5d40a04a0 2020-11-20T13:56:26.494 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d89e9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40a43d0 con 0x7fb5d413df10 2020-11-20T13:56:26.494 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d259c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb5d40a74e0 0x7fb5d40a4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35504/0 (socket says 172.21.15.39:35504) 2020-11-20T13:56:26.494 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d259c700 1 -- 172.21.15.39:0/243532167 learned_addr learned my addr 172.21.15.39:0/243532167 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:26.495 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d2d9d700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d413df10 0x7fb5d4140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.495 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d1d9b700 1 --2- 172.21.15.39:0/243532167 >> v2:172.21.15.31:3300/0 conn(0x7fb5d40a04a0 0x7fb5d409fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.495 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574233648 0 0) 0x7fb5d40a02f0 con 0x7fb5d40a74e0 2020-11-20T13:56:26.495 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.486+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b8003230 con 0x7fb5d40a74e0 2020-11-20T13:56:26.496 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3825532670 0 0) 0x7fb5b8003230 con 0x7fb5d40a74e0 2020-11-20T13:56:26.496 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d413df10 msgr2=0x7fb5d4140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.496 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d413df10 0x7fb5d4140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.496 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 >> v2:172.21.15.31:3300/0 conn(0x7fb5d40a04a0 msgr2=0x7fb5d409fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.496 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 --2- 172.21.15.39:0/243532167 >> v2:172.21.15.31:3300/0 conn(0x7fb5d40a04a0 0x7fb5d409fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.497 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d40679a0 con 0x7fb5d40a74e0 2020-11-20T13:56:26.497 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7fb5c80016d0 con 0x7fb5d40a74e0 2020-11-20T13:56:26.497 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 >> v1:172.21.15.39:6789/0 conn(0x7fb5d40a74e0 legacy=0x7fb5d40a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.497 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5b8003720 0x7fb5b8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.497 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b80044d0 0x7fb5b8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.498 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d413df10 0x7fb5b8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.498 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40a0050 con 0x7fb5b80044d0 2020-11-20T13:56:26.498 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40a43d0 con 0x7fb5b8003720 2020-11-20T13:56:26.498 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8004260 con 0x7fb5d413df10 2020-11-20T13:56:26.498 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d259c700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5b8003720 0x7fb5b8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.499 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d1d9b700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b80044d0 0x7fb5b8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.499 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d2d9d700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d413df10 0x7fb5b8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.499 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d259c700 1 -- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d413df10 msgr2=0x7fb5b8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.499 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d259c700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d413df10 0x7fb5b8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.499 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d259c700 1 -- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b80044d0 msgr2=0x7fb5b8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.500 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d259c700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b80044d0 0x7fb5b8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.500 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d259c700 1 -- 172.21.15.39:0/243532167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8003230 con 0x7fb5b8003720 2020-11-20T13:56:26.500 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d1d9b700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5b80044d0 0x7fb5b8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:26.500 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d259c700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5b8003720 0x7fb5b8003b40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb5c80013e0 tx=0x7fb5c8007740).ready entity=mon.1 client_cookie=74d2dd742c481f9b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.500 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5c80070d0 con 0x7fb5b8003720 2020-11-20T13:56:26.501 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c8007230 con 0x7fb5b8003720 2020-11-20T13:56:26.501 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d159a700 1 -- 172.21.15.39:0/243532167 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5c80055e0 con 0x7fb5b8003720 2020-11-20T13:56:26.501 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d89e9700 1 -- 172.21.15.39:0/243532167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5b8003720 msgr2=0x7fb5b8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.501 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d89e9700 1 --2- 172.21.15.39:0/243532167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5b8003720 0x7fb5b8003b40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb5c80013e0 tx=0x7fb5c8007740).stop 2020-11-20T13:56:26.502 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.487+0000 7fb5d2d9d700 1 -- 172.21.15.39:0/243532167 reap_dead start 2020-11-20T13:56:26.502 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.488+0000 7fb5d89e9700 1 -- 172.21.15.39:0/243532167 shutdown_connections 2020-11-20T13:56:26.502 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.488+0000 7fb5d89e9700 1 -- 172.21.15.39:0/243532167 >> 172.21.15.39:0/243532167 conn(0x7fb5d40ab870 msgr2=0x7fb5d40abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.502 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.488+0000 7fb5d89e9700 1 -- 172.21.15.39:0/243532167 shutdown_connections 2020-11-20T13:56:26.502 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.488+0000 7fb5d89e9700 1 -- 172.21.15.39:0/243532167 wait complete. 2020-11-20T13:56:26.503 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.489+0000 7fb5d89e9700 1 Processor -- start 2020-11-20T13:56:26.503 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.489+0000 7fb5d89e9700 1 -- start start 2020-11-20T13:56:26.503 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.489+0000 7fb5d89e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d40a63d0 0x7fb5d4147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.503 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.489+0000 7fb5d89e9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5d409a460 0x7fb5d409a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.503 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.489+0000 7fb5d89e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d409add0 0x7fb5d4149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.504 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.489+0000 7fb5d89e9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40a7c20 con 0x7fb5d40a63d0 2020-11-20T13:56:26.504 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d89e9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40abe60 con 0x7fb5d409a460 2020-11-20T13:56:26.504 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d89e9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d4130260 con 0x7fb5d409add0 2020-11-20T13:56:26.504 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5d409a460 0x7fb5d409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.504 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5d409a460 0x7fb5d409a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45344/0 (socket says 172.21.15.39:45344) 2020-11-20T13:56:26.505 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d1d9b700 1 -- 172.21.15.39:0/83073060 learned_addr learned my addr 172.21.15.39:0/83073060 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.505 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d259c700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d40a63d0 0x7fb5d4147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.505 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d2d9d700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d409add0 0x7fb5d4149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.505 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d1d9b700 1 -- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d409add0 msgr2=0x7fb5d4149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.505 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d1d9b700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5d409add0 0x7fb5d4149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.506 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d1d9b700 1 -- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d40a63d0 msgr2=0x7fb5d4147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.506 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d1d9b700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d40a63d0 0x7fb5d4147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.506 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d1d9b700 1 -- 172.21.15.39:0/83073060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4130500 con 0x7fb5d409a460 2020-11-20T13:56:26.506 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d1d9b700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5d409a460 0x7fb5d409a8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb5d40a6ef0 tx=0x7fb5c4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.506 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5c37fe700 1 -- 172.21.15.39:0/83073060 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5c4012800 con 0x7fb5d409a460 2020-11-20T13:56:26.507 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5c37fe700 1 -- 172.21.15.39:0/83073060 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c4012960 con 0x7fb5d409a460 2020-11-20T13:56:26.507 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d41307a0 con 0x7fb5d409a460 2020-11-20T13:56:26.507 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5c37fe700 1 -- 172.21.15.39:0/83073060 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5c4012cc0 con 0x7fb5d409a460 2020-11-20T13:56:26.507 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.490+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d412fee0 con 0x7fb5d409a460 2020-11-20T13:56:26.507 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.491+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5d4066b10 con 0x7fb5d409a460 2020-11-20T13:56:26.508 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.491+0000 7fb5c37fe700 1 -- 172.21.15.39:0/83073060 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fb5c4014470 con 0x7fb5d409a460 2020-11-20T13:56:26.509 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.492+0000 7fb5c37fe700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb5b00512f0 0x7fb5b00537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.509 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.492+0000 7fb5c37fe700 1 -- 172.21.15.39:0/83073060 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb5c40696c0 con 0x7fb5d409a460 2020-11-20T13:56:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.492+0000 7fb5c37fe700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.39:6824/22479,v1:172.21.15.39:6825/22479] conn(0x7fb5b0058770 0x7fb5b005ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.492+0000 7fb5c37fe700 1 -- 172.21.15.39:0/83073060 --> [v2:172.21.15.39:6824/22479,v1:172.21.15.39:6825/22479] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5b005b1e0 con 0x7fb5b0058770 2020-11-20T13:56:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.492+0000 7fb5c37fe700 1 -- 172.21.15.39:0/83073060 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5c406bcd0 con 0x7fb5d409a460 2020-11-20T13:56:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.492+0000 7fb5d259c700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb5b00512f0 0x7fb5b00537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.510 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.492+0000 7fb5d2d9d700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.39:6824/22479,v1:172.21.15.39:6825/22479] conn(0x7fb5b0058770 0x7fb5b005ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.492+0000 7fb5d259c700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb5b00512f0 0x7fb5b00537b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fb5c8018000 tx=0x7fb5c8015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.492+0000 7fb5d2d9d700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.39:6824/22479,v1:172.21.15.39:6825/22479] conn(0x7fb5b0058770 0x7fb5b005ab90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.493+0000 7fb5c37fe700 1 -- 172.21.15.39:0/83073060 <== osd.3 v2:172.21.15.39:6824/22479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fb5b005b1e0 con 0x7fb5b0058770 2020-11-20T13:56:26.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.509+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 --> [v2:172.21.15.39:6824/22479,v1:172.21.15.39:6825/22479] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5d40a0c20 con 0x7fb5b0058770 2020-11-20T13:56:26.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.509+0000 7fb5c37fe700 1 -- 172.21.15.39:0/83073060 <== osd.3 v2:172.21.15.39:6824/22479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5d40a0c20 con 0x7fb5b0058770 2020-11-20T13:56:26.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.509+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 >> [v2:172.21.15.39:6824/22479,v1:172.21.15.39:6825/22479] conn(0x7fb5b0058770 msgr2=0x7fb5b005ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.509+0000 7fb5d89e9700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.39:6824/22479,v1:172.21.15.39:6825/22479] conn(0x7fb5b0058770 0x7fb5b005ab90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.509+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb5b00512f0 msgr2=0x7fb5b00537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.510+0000 7fb5d89e9700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb5b00512f0 0x7fb5b00537b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fb5c8018000 tx=0x7fb5c8015000).stop 2020-11-20T13:56:26.514 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.510+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5d409a460 msgr2=0x7fb5d409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.514 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.510+0000 7fb5d89e9700 1 --2- 172.21.15.39:0/83073060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5d409a460 0x7fb5d409a8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb5d40a6ef0 tx=0x7fb5c4008040).stop 2020-11-20T13:56:26.514 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.510+0000 7fb5d2d9d700 1 -- 172.21.15.39:0/83073060 reap_dead start 2020-11-20T13:56:26.514 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.510+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 shutdown_connections 2020-11-20T13:56:26.514 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.510+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 >> 172.21.15.39:0/83073060 conn(0x7fb5d40ab870 msgr2=0x7fb5d40a1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.515 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.510+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 shutdown_connections 2020-11-20T13:56:26.515 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.510+0000 7fb5d89e9700 1 -- 172.21.15.39:0/83073060 wait complete. 2020-11-20T13:56:26.520 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:26.521 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-11-20T13:56:26.637 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.636+0000 7fe2b9c52700 1 Processor -- start 2020-11-20T13:56:26.638 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.636+0000 7fe2b9c52700 1 -- start start 2020-11-20T13:56:26.645 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.636+0000 7fe2b9c52700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe2b40a7880 0x7fe2b40a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.646 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.636+0000 7fe2b9c52700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2b40a7cc0 0x7fe2b40a2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.647 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.636+0000 7fe2b9c52700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40a70c0 con 0x7fe2b40a5390 2020-11-20T13:56:26.647 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.636+0000 7fe2b9c52700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40a6ed0 con 0x7fe2b40a7880 2020-11-20T13:56:26.647 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.636+0000 7fe2b9c52700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40a2930 con 0x7fe2b40a7cc0 2020-11-20T13:56:26.647 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9451700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2b40a7cc0 0x7fe2b40a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.648 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9451700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2b40a7cc0 0x7fe2b40a2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45356/0 (socket says 172.21.15.39:45356) 2020-11-20T13:56:26.648 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9451700 1 -- 172.21.15.39:0/536113549 learned_addr learned my addr 172.21.15.39:0/536113549 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.648 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b3fff700 1 --2- 172.21.15.39:0/536113549 >> v2:172.21.15.31:3300/0 conn(0x7fe2b40a7880 0x7fe2b40a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.648 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9451700 1 -- 172.21.15.39:0/536113549 >> v2:172.21.15.31:3300/0 conn(0x7fe2b40a7880 msgr2=0x7fe2b40a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.648 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9451700 1 --2- 172.21.15.39:0/536113549 >> v2:172.21.15.31:3300/0 conn(0x7fe2b40a7880 0x7fe2b40a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9451700 1 -- 172.21.15.39:0/536113549 >> v1:172.21.15.31:6789/0 conn(0x7fe2b40a5390 legacy=0x7fe2b413aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9451700 1 -- 172.21.15.39:0/536113549 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40a6790 con 0x7fe2b40a7cc0 2020-11-20T13:56:26.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9451700 1 --2- 172.21.15.39:0/536113549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a7cc0 0x7fe2b40a2440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fe2ac0032b0 tx=0x7fe2ac009270).ready entity=mon.1 client_cookie=705191973516161a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b37fe700 1 -- 172.21.15.39:0/536113549 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac009e60 con 0x7fe2b40a7cc0 2020-11-20T13:56:26.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b37fe700 1 -- 172.21.15.39:0/536113549 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac00bc00 con 0x7fe2b40a7cc0 2020-11-20T13:56:26.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b37fe700 1 -- 172.21.15.39:0/536113549 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac00bd70 con 0x7fe2b40a7cc0 2020-11-20T13:56:26.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9c52700 1 -- 172.21.15.39:0/536113549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a7cc0 msgr2=0x7fe2b40a2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.637+0000 7fe2b9c52700 1 --2- 172.21.15.39:0/536113549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a7cc0 0x7fe2b40a2440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fe2ac0032b0 tx=0x7fe2ac009270).stop 2020-11-20T13:56:26.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.638+0000 7fe2b9c52700 1 -- 172.21.15.39:0/536113549 shutdown_connections 2020-11-20T13:56:26.651 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.638+0000 7fe2b9c52700 1 --2- 172.21.15.39:0/536113549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a7cc0 0x7fe2b40a2440 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.651 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.638+0000 7fe2b9c52700 1 --2- 172.21.15.39:0/536113549 >> v2:172.21.15.31:3300/0 conn(0x7fe2b40a7880 0x7fe2b40a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.651 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.638+0000 7fe2b9c52700 1 -- 172.21.15.39:0/536113549 >> 172.21.15.39:0/536113549 conn(0x7fe2b405ba90 msgr2=0x7fe2b405bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.651 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.638+0000 7fe2b9c52700 1 -- 172.21.15.39:0/536113549 shutdown_connections 2020-11-20T13:56:26.651 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.638+0000 7fe2b9c52700 1 -- 172.21.15.39:0/536113549 wait complete. 2020-11-20T13:56:26.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.639+0000 7fe2b9c52700 1 Processor -- start 2020-11-20T13:56:26.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.639+0000 7fe2b9c52700 1 -- start start 2020-11-20T13:56:26.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.639+0000 7fe2b9c52700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a5390 0x7fe2b40ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.639+0000 7fe2b9c52700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b40a7880 0x7fe2b413d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.639+0000 7fe2b9c52700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b40a7cc0 0x7fe2b4148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.653 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.639+0000 7fe2b9c52700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4148720 con 0x7fe2b40a7880 2020-11-20T13:56:26.653 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.639+0000 7fe2b9c52700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40abb30 con 0x7fe2b40a5390 2020-11-20T13:56:26.653 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.639+0000 7fe2b9c52700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40a4aa0 con 0x7fe2b40a7cc0 2020-11-20T13:56:26.653 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.639+0000 7fe2b8c50700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a5390 0x7fe2b40ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.653 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b8c50700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a5390 0x7fe2b40ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45358/0 (socket says 172.21.15.39:45358) 2020-11-20T13:56:26.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b8c50700 1 -- 172.21.15.39:0/2107158834 learned_addr learned my addr 172.21.15.39:0/2107158834 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b3fff700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b40a7880 0x7fe2b413d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b9451700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b40a7cc0 0x7fe2b4148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b8c50700 1 -- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b40a7cc0 msgr2=0x7fe2b4148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b8c50700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2b40a7cc0 0x7fe2b4148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b8c50700 1 -- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b40a7880 msgr2=0x7fe2b413d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b8c50700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2b40a7880 0x7fe2b413d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b8c50700 1 -- 172.21.15.39:0/2107158834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40a4d40 con 0x7fe2b40a5390 2020-11-20T13:56:26.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b8c50700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a5390 0x7fe2b40ac470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe2b4067d70 tx=0x7fe29c007b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b1ffb700 1 -- 172.21.15.39:0/2107158834 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe29c007030 con 0x7fe2b40a5390 2020-11-20T13:56:26.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b1ffb700 1 -- 172.21.15.39:0/2107158834 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c007190 con 0x7fe2b40a5390 2020-11-20T13:56:26.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b4138690 con 0x7fe2b40a5390 2020-11-20T13:56:26.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b1ffb700 1 -- 172.21.15.39:0/2107158834 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe29c0064e0 con 0x7fe2b40a5390 2020-11-20T13:56:26.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.640+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b40abf60 con 0x7fe2b40a5390 2020-11-20T13:56:26.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.641+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2b40a48e0 con 0x7fe2b40a5390 2020-11-20T13:56:26.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.641+0000 7fe2b1ffb700 1 -- 172.21.15.39:0/2107158834 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fe29c010070 con 0x7fe2b40a5390 2020-11-20T13:56:26.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.641+0000 7fe2b1ffb700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe2980511d0 0x7fe298053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.642+0000 7fe2b1ffb700 1 -- 172.21.15.39:0/2107158834 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe29c068440 con 0x7fe2b40a5390 2020-11-20T13:56:26.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.642+0000 7fe2b3fff700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe2980511d0 0x7fe298053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.642+0000 7fe2b1ffb700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6802/22791,v1:172.21.15.31:6803/22791] conn(0x7fe298058650 0x7fe29805aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.642+0000 7fe2b1ffb700 1 -- 172.21.15.39:0/2107158834 --> [v2:172.21.15.31:6802/22791,v1:172.21.15.31:6803/22791] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe29805b0c0 con 0x7fe298058650 2020-11-20T13:56:26.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.642+0000 7fe2b1ffb700 1 -- 172.21.15.39:0/2107158834 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe29c06aad0 con 0x7fe2b40a5390 2020-11-20T13:56:26.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.642+0000 7fe2b3fff700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe2980511d0 0x7fe298053690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe2a400b000 tx=0x7fe2a4006dc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.642+0000 7fe2b9451700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6802/22791,v1:172.21.15.31:6803/22791] conn(0x7fe298058650 0x7fe29805aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.642+0000 7fe2b9451700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6802/22791,v1:172.21.15.31:6803/22791] conn(0x7fe298058650 0x7fe29805aa70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.644+0000 7fe2b1ffb700 1 -- 172.21.15.39:0/2107158834 <== osd.4 v2:172.21.15.31:6802/22791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fe29805b0c0 con 0x7fe298058650 2020-11-20T13:56:26.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.660+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 --> [v2:172.21.15.31:6802/22791,v1:172.21.15.31:6803/22791] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2b413e590 con 0x7fe298058650 2020-11-20T13:56:26.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b1ffb700 1 -- 172.21.15.39:0/2107158834 <== osd.4 v2:172.21.15.31:6802/22791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2b413e590 con 0x7fe298058650 2020-11-20T13:56:26.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6802/22791,v1:172.21.15.31:6803/22791] conn(0x7fe298058650 msgr2=0x7fe29805aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6802/22791,v1:172.21.15.31:6803/22791] conn(0x7fe298058650 0x7fe29805aa70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe2980511d0 msgr2=0x7fe298053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe2980511d0 0x7fe298053690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe2a400b000 tx=0x7fe2a4006dc0).stop 2020-11-20T13:56:26.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a5390 msgr2=0x7fe2b40ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.665 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 --2- 172.21.15.39:0/2107158834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b40a5390 0x7fe2b40ac470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe2b4067d70 tx=0x7fe29c007b50).stop 2020-11-20T13:56:26.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9451700 1 -- 172.21.15.39:0/2107158834 reap_dead start 2020-11-20T13:56:26.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 shutdown_connections 2020-11-20T13:56:26.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 >> 172.21.15.39:0/2107158834 conn(0x7fe2b405ba90 msgr2=0x7fe2b413db90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.666 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 shutdown_connections 2020-11-20T13:56:26.667 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.661+0000 7fe2b9c52700 1 -- 172.21.15.39:0/2107158834 wait complete. 2020-11-20T13:56:26.673 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2020-11-20T13:56:26.674 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-11-20T13:56:26.789 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.788+0000 7f15ed4da700 1 Processor -- start 2020-11-20T13:56:26.789 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.788+0000 7f15ed4da700 1 -- start start 2020-11-20T13:56:26.792 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15ed4da700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15e80a7320 0x7f15e80a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.792 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15ed4da700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f15e805c470 0x7f15e8140f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.793 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15ed4da700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e809ff70 con 0x7f15e809fad0 2020-11-20T13:56:26.793 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15ed4da700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80a0210 con 0x7f15e805c470 2020-11-20T13:56:26.793 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15ed4da700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e80a4330 con 0x7f15e80a7320 2020-11-20T13:56:26.794 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15e77fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f15e805c470 0x7f15e8140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.794 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15e77fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f15e805c470 0x7f15e8140f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45368/0 (socket says 172.21.15.39:45368) 2020-11-20T13:56:26.794 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15e77fe700 1 -- 172.21.15.39:0/2775058686 learned_addr learned my addr 172.21.15.39:0/2775058686 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.794 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15e6ffd700 1 --2- 172.21.15.39:0/2775058686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15e80a7320 0x7f15e80a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.795 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15e77fe700 1 -- 172.21.15.39:0/2775058686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15e80a7320 msgr2=0x7f15e80a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.795 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15e77fe700 1 --2- 172.21.15.39:0/2775058686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15e80a7320 0x7f15e80a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.795 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.789+0000 7f15e77fe700 1 -- 172.21.15.39:0/2775058686 >> v1:172.21.15.31:6789/0 conn(0x7f15e809fad0 legacy=0x7f15e805bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.795 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15e77fe700 1 -- 172.21.15.39:0/2775058686 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80a7700 con 0x7f15e805c470 2020-11-20T13:56:26.796 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15e77fe700 1 --2- 172.21.15.39:0/2775058686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e805c470 0x7f15e8140f30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f15e00032b0 tx=0x7f15e0009270).ready entity=mon.1 client_cookie=89dd0f6bf8cd122d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.796 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15e5ffb700 1 -- 172.21.15.39:0/2775058686 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e000bc00 con 0x7f15e805c470 2020-11-20T13:56:26.796 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15e5ffb700 1 -- 172.21.15.39:0/2775058686 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000bd60 con 0x7f15e805c470 2020-11-20T13:56:26.796 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15e5ffb700 1 -- 172.21.15.39:0/2775058686 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e0011400 con 0x7f15e805c470 2020-11-20T13:56:26.796 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15ed4da700 1 -- 172.21.15.39:0/2775058686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e805c470 msgr2=0x7f15e8140f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.797 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15ed4da700 1 --2- 172.21.15.39:0/2775058686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e805c470 0x7f15e8140f30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f15e00032b0 tx=0x7f15e0009270).stop 2020-11-20T13:56:26.798 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15ed4da700 1 -- 172.21.15.39:0/2775058686 shutdown_connections 2020-11-20T13:56:26.798 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15ed4da700 1 --2- 172.21.15.39:0/2775058686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e805c470 0x7f15e8140f30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.798 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15ed4da700 1 --2- 172.21.15.39:0/2775058686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15e80a7320 0x7f15e80a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.798 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15ed4da700 1 -- 172.21.15.39:0/2775058686 >> 172.21.15.39:0/2775058686 conn(0x7f15e80ab870 msgr2=0x7f15e80abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.799 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15ed4da700 1 -- 172.21.15.39:0/2775058686 shutdown_connections 2020-11-20T13:56:26.799 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.790+0000 7f15ed4da700 1 -- 172.21.15.39:0/2775058686 wait complete. 2020-11-20T13:56:26.799 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.791+0000 7f15ed4da700 1 Processor -- start 2020-11-20T13:56:26.799 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.791+0000 7f15ed4da700 1 -- start start 2020-11-20T13:56:26.802 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15ed4da700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15e805c470 0x7f15e8139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.802 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15ed4da700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15e809fad0 0x7f15e8139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.803 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15ed4da700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e80a7320 0x7f15e813a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.803 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15ed4da700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e813a890 con 0x7f15e809fad0 2020-11-20T13:56:26.803 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15ed4da700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e80627d0 con 0x7f15e80a7320 2020-11-20T13:56:26.804 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15ed4da700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8062a70 con 0x7f15e805c470 2020-11-20T13:56:26.804 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e80a7320 0x7f15e813a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.804 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e80a7320 0x7f15e813a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45376/0 (socket says 172.21.15.39:45376) 2020-11-20T13:56:26.804 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e77fe700 1 -- 172.21.15.39:0/2697063991 learned_addr learned my addr 172.21.15.39:0/2697063991 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.805 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e6ffd700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15e805c470 0x7f15e8139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.805 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e67fc700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15e809fad0 0x7f15e8139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.805 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e77fe700 1 -- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15e805c470 msgr2=0x7f15e8139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.805 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e77fe700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f15e805c470 0x7f15e8139390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.806 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e77fe700 1 -- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15e809fad0 msgr2=0x7f15e8139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.806 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e77fe700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15e809fad0 0x7f15e8139eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.806 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e77fe700 1 -- 172.21.15.39:0/2697063991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80624c0 con 0x7f15e80a7320 2020-11-20T13:56:26.806 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.792+0000 7f15e77fe700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e80a7320 0x7f15e813a3a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f15e80ac4e0 tx=0x7f15e0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.806 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.793+0000 7f15d7fff700 1 -- 172.21.15.39:0/2697063991 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e001f670 con 0x7f15e80a7320 2020-11-20T13:56:26.807 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.793+0000 7f15d7fff700 1 -- 172.21.15.39:0/2697063991 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e001f7d0 con 0x7f15e80a7320 2020-11-20T13:56:26.807 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.793+0000 7f15d7fff700 1 -- 172.21.15.39:0/2697063991 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e001fb30 con 0x7f15e80a7320 2020-11-20T13:56:26.808 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.793+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e809e2e0 con 0x7f15e80a7320 2020-11-20T13:56:26.808 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.793+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e81377c0 con 0x7f15e80a7320 2020-11-20T13:56:26.808 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.794+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15e8139ac0 con 0x7f15e80a7320 2020-11-20T13:56:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.794+0000 7f15d7fff700 1 -- 172.21.15.39:0/2697063991 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f15e0026030 con 0x7f15e80a7320 2020-11-20T13:56:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.794+0000 7f15d7fff700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f15c40512f0 0x7f15c40537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.794+0000 7f15d7fff700 1 -- 172.21.15.39:0/2697063991 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f15e006a400 con 0x7f15e80a7320 2020-11-20T13:56:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.794+0000 7f15d7fff700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6818/22848,v1:172.21.15.31:6819/22848] conn(0x7f15c4058770 0x7f15c405ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.794+0000 7f15d7fff700 1 -- 172.21.15.39:0/2697063991 --> [v2:172.21.15.31:6818/22848,v1:172.21.15.31:6819/22848] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15c405b1e0 con 0x7f15c4058770 2020-11-20T13:56:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.794+0000 7f15d7fff700 1 -- 172.21.15.39:0/2697063991 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15e006ca70 con 0x7f15e80a7320 2020-11-20T13:56:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.794+0000 7f15e6ffd700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f15c40512f0 0x7f15c40537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.794+0000 7f15e67fc700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6818/22848,v1:172.21.15.31:6819/22848] conn(0x7f15c4058770 0x7f15c405ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.795+0000 7f15e6ffd700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f15c40512f0 0x7f15c40537b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f15dc00c000 tx=0x7f15dc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.795+0000 7f15e67fc700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6818/22848,v1:172.21.15.31:6819/22848] conn(0x7f15c4058770 0x7f15c405ab90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.811 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.796+0000 7f15d7fff700 1 -- 172.21.15.39:0/2697063991 <== osd.5 v2:172.21.15.31:6818/22848 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f15c405b1e0 con 0x7f15c4058770 2020-11-20T13:56:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.811+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 --> [v2:172.21.15.31:6818/22848,v1:172.21.15.31:6819/22848] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15e80a9800 con 0x7f15c4058770 2020-11-20T13:56:26.814 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.812+0000 7f15d7fff700 1 -- 172.21.15.39:0/2697063991 <== osd.5 v2:172.21.15.31:6818/22848 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f15e80a9800 con 0x7f15c4058770 2020-11-20T13:56:26.814 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.812+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6818/22848,v1:172.21.15.31:6819/22848] conn(0x7f15c4058770 msgr2=0x7f15c405ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.815 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.812+0000 7f15ed4da700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6818/22848,v1:172.21.15.31:6819/22848] conn(0x7f15c4058770 0x7f15c405ab90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.815 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.812+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f15c40512f0 msgr2=0x7f15c40537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.815 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.812+0000 7f15ed4da700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f15c40512f0 0x7f15c40537b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f15dc00c000 tx=0x7f15dc008040).stop 2020-11-20T13:56:26.816 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.812+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e80a7320 msgr2=0x7f15e813a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.816 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.812+0000 7f15ed4da700 1 --2- 172.21.15.39:0/2697063991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15e80a7320 0x7f15e813a3a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f15e80ac4e0 tx=0x7f15e0016000).stop 2020-11-20T13:56:26.816 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.813+0000 7f15e77fe700 1 -- 172.21.15.39:0/2697063991 reap_dead start 2020-11-20T13:56:26.816 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.813+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 shutdown_connections 2020-11-20T13:56:26.817 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.813+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 >> 172.21.15.39:0/2697063991 conn(0x7f15e80ab870 msgr2=0x7f15e8069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.817 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.813+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 shutdown_connections 2020-11-20T13:56:26.818 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.813+0000 7f15ed4da700 1 -- 172.21.15.39:0/2697063991 wait complete. 2020-11-20T13:56:26.823 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:26.823 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-11-20T13:56:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.940+0000 7f9c4e218700 1 Processor -- start 2020-11-20T13:56:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.940+0000 7f9c4e218700 1 -- start start 2020-11-20T13:56:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c4e218700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c480a74e0 0x7f9c4809fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.944 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c4e218700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9c480a04a0 0x7f9c480a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.944 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c4e218700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c480a02f0 con 0x7f9c4805bcb0 2020-11-20T13:56:26.944 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c4e218700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c480a0050 con 0x7f9c480a04a0 2020-11-20T13:56:26.944 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c4e218700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480a43d0 con 0x7f9c480a74e0 2020-11-20T13:56:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c46ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9c480a04a0 0x7f9c480a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c46ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9c480a04a0 0x7f9c480a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45384/0 (socket says 172.21.15.39:45384) 2020-11-20T13:56:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c46ffd700 1 -- 172.21.15.39:0/1670517188 learned_addr learned my addr 172.21.15.39:0/1670517188 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c477fe700 1 --2- 172.21.15.39:0/1670517188 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c480a74e0 0x7f9c4809fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c46ffd700 1 -- 172.21.15.39:0/1670517188 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c480a74e0 msgr2=0x7f9c4809fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:26.946 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c46ffd700 1 --2- 172.21.15.39:0/1670517188 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c480a74e0 0x7f9c4809fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.946 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c46ffd700 1 -- 172.21.15.39:0/1670517188 >> v1:172.21.15.31:6789/0 conn(0x7f9c4805bcb0 legacy=0x7f9c4805c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.946 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c46ffd700 1 -- 172.21.15.39:0/1670517188 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c480679a0 con 0x7f9c480a04a0 2020-11-20T13:56:26.946 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c46ffd700 1 --2- 172.21.15.39:0/1670517188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a04a0 0x7f9c480a4870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9c3c002f30 tx=0x7f9c3c006e80).ready entity=mon.1 client_cookie=4ffc10659b42067b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.946 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.941+0000 7f9c467fc700 1 -- 172.21.15.39:0/1670517188 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c3c0097f0 con 0x7f9c480a04a0 2020-11-20T13:56:26.947 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c467fc700 1 -- 172.21.15.39:0/1670517188 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c009950 con 0x7f9c480a04a0 2020-11-20T13:56:26.947 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c467fc700 1 -- 172.21.15.39:0/1670517188 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c3c009cb0 con 0x7f9c480a04a0 2020-11-20T13:56:26.947 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c4e218700 1 -- 172.21.15.39:0/1670517188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a04a0 msgr2=0x7f9c480a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.947 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c4e218700 1 --2- 172.21.15.39:0/1670517188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a04a0 0x7f9c480a4870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9c3c002f30 tx=0x7f9c3c006e80).stop 2020-11-20T13:56:26.947 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c4e218700 1 -- 172.21.15.39:0/1670517188 shutdown_connections 2020-11-20T13:56:26.948 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c4e218700 1 --2- 172.21.15.39:0/1670517188 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c480a74e0 0x7f9c4809fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.948 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c4e218700 1 --2- 172.21.15.39:0/1670517188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a04a0 0x7f9c480a4870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.948 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c4e218700 1 -- 172.21.15.39:0/1670517188 >> 172.21.15.39:0/1670517188 conn(0x7f9c480ab870 msgr2=0x7f9c480abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.948 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c4e218700 1 -- 172.21.15.39:0/1670517188 shutdown_connections 2020-11-20T13:56:26.948 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.942+0000 7f9c4e218700 1 -- 172.21.15.39:0/1670517188 wait complete. 2020-11-20T13:56:26.952 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.943+0000 7f9c4e218700 1 Processor -- start 2020-11-20T13:56:26.953 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.943+0000 7f9c4e218700 1 -- start start 2020-11-20T13:56:26.953 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c4e218700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c4805bcb0 0x7f9c4812adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.953 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c4e218700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c480a04a0 0x7f9c4814be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.953 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c4e218700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a74e0 0x7f9c4814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c4e218700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c48136d70 con 0x7f9c480a04a0 2020-11-20T13:56:26.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c4e218700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480a3600 con 0x7f9c480a74e0 2020-11-20T13:56:26.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c4e218700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4812b4c0 con 0x7f9c4805bcb0 2020-11-20T13:56:26.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c47fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a74e0 0x7f9c4814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c477fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c4805bcb0 0x7f9c4812adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c477fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c4805bcb0 0x7f9c4812adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.39:55846/0 (socket says 172.21.15.39:55846) 2020-11-20T13:56:26.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c47fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a74e0 0x7f9c4814c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45392/0 (socket says 172.21.15.39:45392) 2020-11-20T13:56:26.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c477fe700 1 -- 172.21.15.39:0/3826480084 learned_addr learned my addr 172.21.15.39:0/3826480084 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:26.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c46ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c480a04a0 0x7f9c4814be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c47fff700 1 -- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c4805bcb0 msgr2=0x7f9c4812adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.956 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c47fff700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c4805bcb0 0x7f9c4812adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.960 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c47fff700 1 -- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c480a04a0 msgr2=0x7f9c4814be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.961 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c47fff700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c480a04a0 0x7f9c4814be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.962 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c47fff700 1 -- 172.21.15.39:0/3826480084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4812a590 con 0x7f9c480a74e0 2020-11-20T13:56:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c47fff700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a74e0 0x7f9c4814c380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f9c480a0920 tx=0x7f9c40007df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c44ff9700 1 -- 172.21.15.39:0/3826480084 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c4000ce10 con 0x7f9c480a74e0 2020-11-20T13:56:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c44ff9700 1 -- 172.21.15.39:0/3826480084 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4000a7b0 con 0x7f9c480a74e0 2020-11-20T13:56:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c48134ca0 con 0x7f9c480a74e0 2020-11-20T13:56:26.965 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.944+0000 7f9c44ff9700 1 -- 172.21.15.39:0/3826480084 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c4000ab10 con 0x7f9c480a74e0 2020-11-20T13:56:26.965 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.945+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4814c870 con 0x7f9c480a74e0 2020-11-20T13:56:26.965 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.945+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c4812b680 con 0x7f9c480a74e0 2020-11-20T13:56:26.965 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.946+0000 7f9c44ff9700 1 -- 172.21.15.39:0/3826480084 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f9c40019030 con 0x7f9c480a74e0 2020-11-20T13:56:26.966 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.946+0000 7f9c44ff9700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9c280511d0 0x7f9c28053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.966 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.946+0000 7f9c44ff9700 1 -- 172.21.15.39:0/3826480084 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c40068520 con 0x7f9c480a74e0 2020-11-20T13:56:26.966 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.946+0000 7f9c44ff9700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6810/22792,v1:172.21.15.31:6811/22792] conn(0x7f9c28058650 0x7f9c2805aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:26.966 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.946+0000 7f9c44ff9700 1 -- 172.21.15.39:0/3826480084 --> [v2:172.21.15.31:6810/22792,v1:172.21.15.31:6811/22792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c2805b0c0 con 0x7f9c28058650 2020-11-20T13:56:26.966 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.946+0000 7f9c44ff9700 1 -- 172.21.15.39:0/3826480084 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c4006abb0 con 0x7f9c480a74e0 2020-11-20T13:56:26.967 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.946+0000 7f9c477fe700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9c280511d0 0x7f9c28053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.967 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.946+0000 7f9c46ffd700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6810/22792,v1:172.21.15.31:6811/22792] conn(0x7f9c28058650 0x7f9c2805aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:26.967 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.946+0000 7f9c477fe700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9c280511d0 0x7f9c28053690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9c3800b000 tx=0x7f9c38006dc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.967 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.947+0000 7f9c46ffd700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6810/22792,v1:172.21.15.31:6811/22792] conn(0x7f9c28058650 0x7f9c2805aa70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:26.967 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.947+0000 7f9c44ff9700 1 -- 172.21.15.39:0/3826480084 <== osd.6 v2:172.21.15.31:6810/22792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f9c2805b0c0 con 0x7f9c28058650 2020-11-20T13:56:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.963+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 --> [v2:172.21.15.31:6810/22792,v1:172.21.15.31:6811/22792] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c4813a410 con 0x7f9c28058650 2020-11-20T13:56:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.964+0000 7f9c44ff9700 1 -- 172.21.15.39:0/3826480084 <== osd.6 v2:172.21.15.31:6810/22792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c4813a410 con 0x7f9c28058650 2020-11-20T13:56:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6810/22792,v1:172.21.15.31:6811/22792] conn(0x7f9c28058650 msgr2=0x7f9c2805aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.970 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6810/22792,v1:172.21.15.31:6811/22792] conn(0x7f9c28058650 0x7f9c2805aa70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:26.970 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9c280511d0 msgr2=0x7f9c28053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.970 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f9c280511d0 0x7f9c28053690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9c3800b000 tx=0x7f9c38006dc0).stop 2020-11-20T13:56:26.970 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a74e0 msgr2=0x7f9c4814c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:26.970 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 --2- 172.21.15.39:0/3826480084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c480a74e0 0x7f9c4814c380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f9c480a0920 tx=0x7f9c40007df0).stop 2020-11-20T13:56:26.971 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c47fff700 1 -- 172.21.15.39:0/3826480084 reap_dead start 2020-11-20T13:56:26.971 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 shutdown_connections 2020-11-20T13:56:26.971 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 >> 172.21.15.39:0/3826480084 conn(0x7f9c480ab870 msgr2=0x7f9c480a3950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:26.971 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 shutdown_connections 2020-11-20T13:56:26.972 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:26.965+0000 7f9c4e218700 1 -- 172.21.15.39:0/3826480084 wait complete. 2020-11-20T13:56:26.975 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:26.976 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-11-20T13:56:27.091 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.090+0000 7ff20a624700 1 Processor -- start 2020-11-20T13:56:27.091 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.090+0000 7ff20a624700 1 -- start start 2020-11-20T13:56:27.096 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff20a624700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2040a74e0 0x7ff20409fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.097 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff20a624700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040a02f0 con 0x7ff2040a04a0 2020-11-20T13:56:27.097 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff20a624700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040a0050 con 0x7ff20413df10 2020-11-20T13:56:27.097 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff20a624700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040a43d0 con 0x7ff2040a74e0 2020-11-20T13:56:27.097 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff208bc1700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff20413df10 0x7ff204140300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35572/0 (socket says 172.21.15.39:35572) 2020-11-20T13:56:27.097 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff208bc1700 1 -- 172.21.15.39:0/986200874 learned_addr learned my addr 172.21.15.39:0/986200874 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff203fff700 1 --2- 172.21.15.39:0/986200874 >> v2:172.21.15.31:3300/0 conn(0x7ff2040a74e0 0x7ff20409fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382014250 0 0) 0x7ff2040a0050 con 0x7ff20413df10 2020-11-20T13:56:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f0003230 con 0x7ff20413df10 2020-11-20T13:56:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3481800821 0 0) 0x7ff1f0003230 con 0x7ff20413df10 2020-11-20T13:56:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 >> v2:172.21.15.31:3300/0 conn(0x7ff2040a74e0 msgr2=0x7ff20409fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff202ffd700 1 --2- 172.21.15.39:0/986200874 >> v2:172.21.15.31:3300/0 conn(0x7ff2040a74e0 0x7ff20409fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.091+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 >> v1:172.21.15.31:6789/0 conn(0x7ff2040a04a0 legacy=0x7ff2040a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040679a0 con 0x7ff20413df10 2020-11-20T13:56:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7ff1fc001a50 con 0x7ff20413df10 2020-11-20T13:56:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 >> v1:172.21.15.39:6789/0 conn(0x7ff20413df10 legacy=0x7ff204140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff1f0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1f00044d0 0x7ff1f0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f0004e40 0x7ff1f000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040a43d0 con 0x7ff1f0004e40 2020-11-20T13:56:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0004340 con 0x7ff1f0003720 2020-11-20T13:56:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f000bc40 con 0x7ff1f00044d0 2020-11-20T13:56:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff203fff700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff1f0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff208bc1700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f0004e40 0x7ff1f000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff2037fe700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1f00044d0 0x7ff1f0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff203fff700 1 -- 172.21.15.39:0/986200874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1f00044d0 msgr2=0x7ff1f0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff203fff700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1f00044d0 0x7ff1f0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff203fff700 1 -- 172.21.15.39:0/986200874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f0004e40 msgr2=0x7ff1f000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff203fff700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f0004e40 0x7ff1f000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff203fff700 1 -- 172.21.15.39:0/986200874 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0003230 con 0x7ff1f0003720 2020-11-20T13:56:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff208bc1700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f0004e40 0x7ff1f000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:27.103 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff208bc1700 1 -- 172.21.15.39:0/986200874 reap_dead start 2020-11-20T13:56:27.103 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff203fff700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff1f0003b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff1f400c000 tx=0x7ff1f4008040).ready entity=mon.1 client_cookie=b18603026449e982 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.103 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1f400e9d0 con 0x7ff1f0003720 2020-11-20T13:56:27.103 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f400eb30 con 0x7ff1f0003720 2020-11-20T13:56:27.103 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff202ffd700 1 -- 172.21.15.39:0/986200874 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1f400ee90 con 0x7ff1f0003720 2020-11-20T13:56:27.104 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff20a624700 1 -- 172.21.15.39:0/986200874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 msgr2=0x7ff1f0003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.104 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.092+0000 7ff20a624700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff1f0003b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff1f400c000 tx=0x7ff1f4008040).stop 2020-11-20T13:56:27.104 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.093+0000 7ff20a624700 1 -- 172.21.15.39:0/986200874 shutdown_connections 2020-11-20T13:56:27.104 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.093+0000 7ff20a624700 1 --2- 172.21.15.39:0/986200874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff1f0003b40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.104 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.093+0000 7ff20a624700 1 -- 172.21.15.39:0/986200874 >> 172.21.15.39:0/986200874 conn(0x7ff2040ab870 msgr2=0x7ff2040abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:27.105 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.093+0000 7ff20a624700 1 -- 172.21.15.39:0/986200874 shutdown_connections 2020-11-20T13:56:27.105 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.093+0000 7ff20a624700 1 -- 172.21.15.39:0/986200874 wait complete. 2020-11-20T13:56:27.105 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff20a624700 1 Processor -- start 2020-11-20T13:56:27.106 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff20a624700 1 -- start start 2020-11-20T13:56:27.106 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff20a624700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff204064190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.106 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff20a624700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2040a6540 0x7ff20414b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.106 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff20a624700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff204063190 0x7ff20414bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.106 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff20a624700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040637e0 con 0x7ff2040a6540 2020-11-20T13:56:27.107 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff20a624700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff204063e30 con 0x7ff1f0003720 2020-11-20T13:56:27.107 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff20a624700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff204065e00 con 0x7ff204063190 2020-11-20T13:56:27.107 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff203fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff204064190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.107 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.094+0000 7ff203fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff204064190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45408/0 (socket says 172.21.15.39:45408) 2020-11-20T13:56:27.107 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff203fff700 1 -- 172.21.15.39:0/2941551724 learned_addr learned my addr 172.21.15.39:0/2941551724 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:27.107 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff208bc1700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff204063190 0x7ff20414bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.108 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff2037fe700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2040a6540 0x7ff20414b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.108 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff203fff700 1 -- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff204063190 msgr2=0x7ff20414bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.108 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff203fff700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff204063190 0x7ff20414bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.108 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff203fff700 1 -- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2040a6540 msgr2=0x7ff20414b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.108 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff203fff700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2040a6540 0x7ff20414b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.109 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff203fff700 1 -- 172.21.15.39:0/2941551724 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040660a0 con 0x7ff1f0003720 2020-11-20T13:56:27.109 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff2037fe700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2040a6540 0x7ff20414b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:27.109 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff203fff700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff204064190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff1f400c000 tx=0x7ff1f401a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.109 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff2017fa700 1 -- 172.21.15.39:0/2941551724 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1f401c620 con 0x7ff1f0003720 2020-11-20T13:56:27.109 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff2017fa700 1 -- 172.21.15.39:0/2941551724 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f401c780 con 0x7ff1f0003720 2020-11-20T13:56:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff2017fa700 1 -- 172.21.15.39:0/2941551724 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1f401cae0 con 0x7ff1f0003720 2020-11-20T13:56:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2040a3e30 con 0x7ff1f0003720 2020-11-20T13:56:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.095+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff204066840 con 0x7ff1f0003720 2020-11-20T13:56:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.096+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff204066230 con 0x7ff1f0003720 2020-11-20T13:56:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.096+0000 7ff2017fa700 1 -- 172.21.15.39:0/2941551724 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7ff1f402c070 con 0x7ff1f0003720 2020-11-20T13:56:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.096+0000 7ff2017fa700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1e4051270 0x7ff1e4053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.097+0000 7ff2017fa700 1 -- 172.21.15.39:0/2941551724 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff1f406adf0 con 0x7ff1f0003720 2020-11-20T13:56:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.097+0000 7ff2017fa700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6826/22898,v1:172.21.15.31:6827/22898] conn(0x7ff1e40586f0 0x7ff1e405ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.097+0000 7ff2017fa700 1 -- 172.21.15.39:0/2941551724 --> [v2:172.21.15.31:6826/22898,v1:172.21.15.31:6827/22898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1e405b160 con 0x7ff1e40586f0 2020-11-20T13:56:27.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.097+0000 7ff2017fa700 1 -- 172.21.15.39:0/2941551724 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1f406d480 con 0x7ff1f0003720 2020-11-20T13:56:27.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.097+0000 7ff2037fe700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1e4051270 0x7ff1e4053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.097+0000 7ff2037fe700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1e4051270 0x7ff1e4053730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff1f800d000 tx=0x7ff1f8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.105+0000 7ff208bc1700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6826/22898,v1:172.21.15.31:6827/22898] conn(0x7ff1e40586f0 0x7ff1e405ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.105+0000 7ff208bc1700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6826/22898,v1:172.21.15.31:6827/22898] conn(0x7ff1e40586f0 0x7ff1e405ab10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.114 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.106+0000 7ff2017fa700 1 -- 172.21.15.39:0/2941551724 <== osd.7 v2:172.21.15.31:6826/22898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7ff1e405b160 con 0x7ff1e40586f0 2020-11-20T13:56:27.123 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.122+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 --> [v2:172.21.15.31:6826/22898,v1:172.21.15.31:6827/22898] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff20414c5b0 con 0x7ff1e40586f0 2020-11-20T13:56:27.124 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.123+0000 7ff2017fa700 1 -- 172.21.15.39:0/2941551724 <== osd.7 v2:172.21.15.31:6826/22898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff20414c5b0 con 0x7ff1e40586f0 2020-11-20T13:56:27.124 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.123+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6826/22898,v1:172.21.15.31:6827/22898] conn(0x7ff1e40586f0 msgr2=0x7ff1e405ab10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.125 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.123+0000 7ff20a624700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6826/22898,v1:172.21.15.31:6827/22898] conn(0x7ff1e40586f0 0x7ff1e405ab10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.125 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.123+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1e4051270 msgr2=0x7ff1e4053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.125 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.123+0000 7ff20a624700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1e4051270 0x7ff1e4053730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff1f800d000 tx=0x7ff1f8009040).stop 2020-11-20T13:56:27.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.123+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 msgr2=0x7ff204064190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.123+0000 7ff20a624700 1 --2- 172.21.15.39:0/2941551724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1f0003720 0x7ff204064190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff1f400c000 tx=0x7ff1f401a000).stop 2020-11-20T13:56:27.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.123+0000 7ff208bc1700 1 -- 172.21.15.39:0/2941551724 reap_dead start 2020-11-20T13:56:27.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.124+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 shutdown_connections 2020-11-20T13:56:27.127 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.124+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 >> 172.21.15.39:0/2941551724 conn(0x7ff2040ab870 msgr2=0x7ff2040a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:27.128 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.124+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 shutdown_connections 2020-11-20T13:56:27.128 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.124+0000 7ff20a624700 1 -- 172.21.15.39:0/2941551724 wait complete. 2020-11-20T13:56:27.134 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:27.134 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-11-20T13:56:27.250 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.249+0000 7f4ab9cc9700 1 Processor -- start 2020-11-20T13:56:27.250 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.249+0000 7f4ab9cc9700 1 -- start start 2020-11-20T13:56:27.256 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab9cc9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab40a9e20 0x7f4ab413bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.257 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab9cc9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab4060df0 con 0x7f4ab40607e0 2020-11-20T13:56:27.257 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab9cc9700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab4061020 con 0x7f4ab405c030 2020-11-20T13:56:27.257 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab9cc9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab4061ac0 con 0x7f4ab40a9e20 2020-11-20T13:56:27.258 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab37fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4ab405c030 0x7f4ab40a9710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35590/0 (socket says 172.21.15.39:35590) 2020-11-20T13:56:27.258 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab37fe700 1 -- 172.21.15.39:0/2184776428 learned_addr learned my addr 172.21.15.39:0/2184776428 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:27.258 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241411118 0 0) 0x7f4ab4061020 con 0x7f4ab405c030 2020-11-20T13:56:27.258 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab2ffd700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab40a9e20 0x7f4ab413bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.258 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa0003230 con 0x7f4ab405c030 2020-11-20T13:56:27.259 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3860013719 0 0) 0x7f4aa0003230 con 0x7f4ab405c030 2020-11-20T13:56:27.259 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab40a9e20 msgr2=0x7f4ab413bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:27.259 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab40a9e20 0x7f4ab413bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.260 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 >> v1:172.21.15.31:6789/0 conn(0x7f4ab40607e0 legacy=0x7f4ab413c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.260 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40612c0 con 0x7f4ab405c030 2020-11-20T13:56:27.261 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7f4aa40016d0 con 0x7f4ab405c030 2020-11-20T13:56:27.261 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 >> v1:172.21.15.39:6789/0 conn(0x7f4ab405c030 legacy=0x7f4ab40a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.261 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab40a9e20 0x7f4aa0003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.262 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa0003c30 0x7f4aa00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.262 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa00049c0 0x7f4aa0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.262 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab4061ac0 con 0x7f4aa00049c0 2020-11-20T13:56:27.263 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00041c0 con 0x7f4aa0003c30 2020-11-20T13:56:27.264 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa000b720 con 0x7f4ab40a9e20 2020-11-20T13:56:27.265 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.250+0000 7f4ab2ffd700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa0003c30 0x7f4aa00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.265 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab37fe700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab40a9e20 0x7f4aa0003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.265 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab3fff700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa00049c0 0x7f4aa0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.266 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab40a9e20 msgr2=0x7f4aa0003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:27.266 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab2ffd700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab40a9e20 0x7f4aa0003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.267 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa00049c0 msgr2=0x7f4aa0004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:27.267 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab2ffd700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa00049c0 0x7f4aa0004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.268 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184776428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa0003230 con 0x7f4aa0003c30 2020-11-20T13:56:27.268 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab2ffd700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa0003c30 0x7f4aa00044d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f4aa800c000 tx=0x7f4aa8008040).ready entity=mon.1 client_cookie=a0178d7ad4374650 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.268 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa800e840 con 0x7f4aa0003c30 2020-11-20T13:56:27.268 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa800e9a0 con 0x7f4aa0003c30 2020-11-20T13:56:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab27fc700 1 -- 172.21.15.39:0/2184776428 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa800ed00 con 0x7f4aa0003c30 2020-11-20T13:56:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/2184776428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa0003c30 msgr2=0x7f4aa00044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab9cc9700 1 --2- 172.21.15.39:0/2184776428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4aa0003c30 0x7f4aa00044d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f4aa800c000 tx=0x7f4aa8008040).stop 2020-11-20T13:56:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.251+0000 7f4ab3fff700 1 -- 172.21.15.39:0/2184776428 reap_dead start 2020-11-20T13:56:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.252+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/2184776428 shutdown_connections 2020-11-20T13:56:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.252+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/2184776428 >> 172.21.15.39:0/2184776428 conn(0x7f4ab40ad8b0 msgr2=0x7f4ab40adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.252+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/2184776428 shutdown_connections 2020-11-20T13:56:27.271 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.252+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/2184776428 wait complete. 2020-11-20T13:56:27.271 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.252+0000 7f4ab9cc9700 1 Processor -- start 2020-11-20T13:56:27.271 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab9cc9700 1 -- start start 2020-11-20T13:56:27.271 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab9cc9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab413b320 0x7f4ab4139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab9cc9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab41155e0 0x7f4ab4139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab9cc9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab4117070 0x7f4ab4063ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab9cc9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab4066c90 con 0x7f4ab4117070 2020-11-20T13:56:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab9cc9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40659a0 con 0x7f4ab413b320 2020-11-20T13:56:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab9cc9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab4065540 con 0x7f4ab41155e0 2020-11-20T13:56:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab413b320 0x7f4ab4139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab413b320 0x7f4ab4139290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45430/0 (socket says 172.21.15.39:45430) 2020-11-20T13:56:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab37fe700 1 -- 172.21.15.39:0/1151562013 learned_addr learned my addr 172.21.15.39:0/1151562013 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.253+0000 7f4ab2ffd700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab41155e0 0x7f4ab4139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab3fff700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab4117070 0x7f4ab4063ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab37fe700 1 -- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab41155e0 msgr2=0x7f4ab4139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab37fe700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab41155e0 0x7f4ab4139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab37fe700 1 -- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab4117070 msgr2=0x7f4ab4063ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab37fe700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab4117070 0x7f4ab4063ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab37fe700 1 -- 172.21.15.39:0/1151562013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab4066770 con 0x7f4ab413b320 2020-11-20T13:56:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab2ffd700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab41155e0 0x7f4ab4139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab37fe700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab413b320 0x7f4ab4139290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4ab40acd90 tx=0x7f4ab4061560).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/1151562013 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa400fbd0 con 0x7f4ab413b320 2020-11-20T13:56:27.276 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/1151562013 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa400fd30 con 0x7f4ab413b320 2020-11-20T13:56:27.276 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab405c960 con 0x7f4ab413b320 2020-11-20T13:56:27.276 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/1151562013 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa4012540 con 0x7f4ab413b320 2020-11-20T13:56:27.276 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.254+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab40a4840 con 0x7f4ab413b320 2020-11-20T13:56:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.255+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab4066900 con 0x7f4ab413b320 2020-11-20T13:56:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.255+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/1151562013 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f4aa401b030 con 0x7f4ab413b320 2020-11-20T13:56:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.256+0000 7f4ab0ff9700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a940512f0 0x7f4a940537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.256+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/1151562013 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4aa4068940 con 0x7f4ab413b320 2020-11-20T13:56:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.256+0000 7f4ab2ffd700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a940512f0 0x7f4a940537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.278 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.256+0000 7f4ab2ffd700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a940512f0 0x7f4a940537b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4aa8008000 tx=0x7f4aa801a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.278 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.259+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/1151562013 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f4aa4040d00 con 0x7f4ab413b320 2020-11-20T13:56:27.421 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.420+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ab4057050 con 0x7f4ab413b320 2020-11-20T13:56:27.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.421+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/1151562013 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4aa4019030 con 0x7f4ab413b320 2020-11-20T13:56:27.422 INFO:teuthology.orchestra.run.smithi039.stdout:55834574855 2020-11-20T13:56:27.423 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a940512f0 msgr2=0x7f4a940537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.423 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a940512f0 0x7f4a940537b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4aa8008000 tx=0x7f4aa801a000).stop 2020-11-20T13:56:27.423 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab413b320 msgr2=0x7f4ab4139290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.424 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab413b320 0x7f4ab4139290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4ab40acd90 tx=0x7f4ab4061560).stop 2020-11-20T13:56:27.424 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 shutdown_connections 2020-11-20T13:56:27.424 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4a940512f0 0x7f4a940537b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.424 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab413b320 0x7f4ab4139290 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab4117070 0x7f4ab4063ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 --2- 172.21.15.39:0/1151562013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ab41155e0 0x7f4ab4139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 >> 172.21.15.39:0/1151562013 conn(0x7f4ab40ad8b0 msgr2=0x7f4ab40a4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:27.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 shutdown_connections 2020-11-20T13:56:27.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.422+0000 7f4ab9cc9700 1 -- 172.21.15.39:0/1151562013 wait complete. 2020-11-20T13:56:27.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2020-11-20T13:56:27.434 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-11-20T13:56:27.550 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.548+0000 7fccd6315700 1 Processor -- start 2020-11-20T13:56:27.550 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.548+0000 7fccd6315700 1 -- start start 2020-11-20T13:56:27.550 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.548+0000 7fccd6315700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fccd00a74e0 0x7fccd009fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.551 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.548+0000 7fccd6315700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00a02f0 con 0x7fccd013df10 2020-11-20T13:56:27.551 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.548+0000 7fccd6315700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00a0050 con 0x7fccd00a04a0 2020-11-20T13:56:27.551 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.548+0000 7fccd6315700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd00a43d0 con 0x7fccd00a74e0 2020-11-20T13:56:27.551 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.548+0000 7fcccffff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fccd00a74e0 0x7fccd009fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.551 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.548+0000 7fcccf7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fccd00a04a0 0x7fccd00a4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35610/0 (socket says 172.21.15.39:35610) 2020-11-20T13:56:27.552 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fcccf7fe700 1 -- 172.21.15.39:0/1209205585 learned_addr learned my addr 172.21.15.39:0/1209205585 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:27.552 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fcccffff700 1 -- 172.21.15.39:0/1209205585 >> v1:172.21.15.39:6789/0 conn(0x7fccd00a04a0 legacy=0x7fccd00a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.552 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fcccffff700 1 -- 172.21.15.39:0/1209205585 >> v1:172.21.15.31:6789/0 conn(0x7fccd013df10 legacy=0x7fccd0140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:27.552 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fcccffff700 1 -- 172.21.15.39:0/1209205585 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd00679a0 con 0x7fccd00a74e0 2020-11-20T13:56:27.552 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fcccffff700 1 --2- 172.21.15.39:0/1209205585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 0x7fccd009fa60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fccd009bb20 tx=0x7fccc0006dc0).ready entity=mon.1 client_cookie=f80ce5864d31fcf4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.553 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fccceffd700 1 -- 172.21.15.39:0/1209205585 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccc00097b0 con 0x7fccd00a74e0 2020-11-20T13:56:27.553 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fccceffd700 1 -- 172.21.15.39:0/1209205585 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc0009910 con 0x7fccd00a74e0 2020-11-20T13:56:27.553 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fccceffd700 1 -- 172.21.15.39:0/1209205585 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccc0009c70 con 0x7fccd00a74e0 2020-11-20T13:56:27.553 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fccd6315700 1 -- 172.21.15.39:0/1209205585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 msgr2=0x7fccd009fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.554 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.549+0000 7fccd6315700 1 --2- 172.21.15.39:0/1209205585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 0x7fccd009fa60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fccd009bb20 tx=0x7fccc0006dc0).stop 2020-11-20T13:56:27.556 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.550+0000 7fccd6315700 1 -- 172.21.15.39:0/1209205585 shutdown_connections 2020-11-20T13:56:27.557 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.550+0000 7fccd6315700 1 --2- 172.21.15.39:0/1209205585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 0x7fccd009fa60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.557 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.550+0000 7fccd6315700 1 -- 172.21.15.39:0/1209205585 >> 172.21.15.39:0/1209205585 conn(0x7fccd00ab870 msgr2=0x7fccd00abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:27.557 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.550+0000 7fccd6315700 1 -- 172.21.15.39:0/1209205585 shutdown_connections 2020-11-20T13:56:27.557 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.550+0000 7fccd6315700 1 -- 172.21.15.39:0/1209205585 wait complete. 2020-11-20T13:56:27.558 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.550+0000 7fccd6315700 1 Processor -- start 2020-11-20T13:56:27.558 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.550+0000 7fccd6315700 1 -- start start 2020-11-20T13:56:27.558 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fccd6315700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccd00a04a0 0x7fccd009cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.558 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fccd6315700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 0x7fccd009d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fccd6315700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd013df10 0x7fccd0137c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fccd6315700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd008f4a0 con 0x7fccd013df10 2020-11-20T13:56:27.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fccd6315700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd008f740 con 0x7fccd00a74e0 2020-11-20T13:56:27.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fccd6315700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd008f9e0 con 0x7fccd00a04a0 2020-11-20T13:56:27.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fcccf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 0x7fccd009d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.560 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fcccf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 0x7fccd009d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45446/0 (socket says 172.21.15.39:45446) 2020-11-20T13:56:27.560 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fcccf7fe700 1 -- 172.21.15.39:0/1784751003 learned_addr learned my addr 172.21.15.39:0/1784751003 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:27.560 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.551+0000 7fccd48b2700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd013df10 0x7fccd0137c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.560 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccffff700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccd00a04a0 0x7fccd009cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccf7fe700 1 -- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccd00a04a0 msgr2=0x7fccd009cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccf7fe700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccd00a04a0 0x7fccd009cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccf7fe700 1 -- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd013df10 msgr2=0x7fccd0137c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccf7fe700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd013df10 0x7fccd0137c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccf7fe700 1 -- 172.21.15.39:0/1784751003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd009f230 con 0x7fccd00a74e0 2020-11-20T13:56:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccffff700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccd00a04a0 0x7fccd009cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccf7fe700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 0x7fccd009d2e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fccd005d1a0 tx=0x7fccc4007ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccd7fa700 1 -- 172.21.15.39:0/1784751003 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccc40072e0 con 0x7fccd00a74e0 2020-11-20T13:56:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccd7fa700 1 -- 172.21.15.39:0/1784751003 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc4007440 con 0x7fccd00a74e0 2020-11-20T13:56:27.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd009db10 con 0x7fccd00a74e0 2020-11-20T13:56:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fcccd7fa700 1 -- 172.21.15.39:0/1784751003 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccc40057d0 con 0x7fccd00a74e0 2020-11-20T13:56:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.552+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd009e3d0 con 0x7fccd00a74e0 2020-11-20T13:56:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.553+0000 7fcccd7fa700 1 -- 172.21.15.39:0/1784751003 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fccc4010070 con 0x7fccd00a74e0 2020-11-20T13:56:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.553+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd009dd00 con 0x7fccd00a74e0 2020-11-20T13:56:27.563 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.553+0000 7fcccd7fa700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccb00512f0 0x7fccb00537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.564 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.553+0000 7fcccd7fa700 1 -- 172.21.15.39:0/1784751003 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fccc4068650 con 0x7fccd00a74e0 2020-11-20T13:56:27.564 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.553+0000 7fcccffff700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccb00512f0 0x7fccb00537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.564 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.554+0000 7fcccffff700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccb00512f0 0x7fccb00537b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fccc0016000 tx=0x7fccc0015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.564 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.557+0000 7fcccd7fa700 1 -- 172.21.15.39:0/1784751003 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fccc4040970 con 0x7fccd00a74e0 2020-11-20T13:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.717+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fccd008fba0 con 0x7fccd00a74e0 2020-11-20T13:56:27.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.717+0000 7fcccd7fa700 1 -- 172.21.15.39:0/1784751003 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccc4043f90 con 0x7fccd00a74e0 2020-11-20T13:56:27.719 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:27.720 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccb00512f0 msgr2=0x7fccb00537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.720 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccb00512f0 0x7fccb00537b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fccc0016000 tx=0x7fccc0015000).stop 2020-11-20T13:56:27.720 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 msgr2=0x7fccd009d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.720 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 0x7fccd009d2e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fccd005d1a0 tx=0x7fccc4007ba0).stop 2020-11-20T13:56:27.720 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 shutdown_connections 2020-11-20T13:56:27.721 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fccb00512f0 0x7fccb00537b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.721 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd013df10 0x7fccd0137c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccd00a04a0 0x7fccd009cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 --2- 172.21.15.39:0/1784751003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccd00a74e0 0x7fccd009d2e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 >> 172.21.15.39:0/1784751003 conn(0x7fccd00ab870 msgr2=0x7fccd00a3950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:27.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 shutdown_connections 2020-11-20T13:56:27.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.719+0000 7fccd6315700 1 -- 172.21.15.39:0/1784751003 wait complete. 2020-11-20T13:56:27.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2020-11-20T13:56:27.731 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-11-20T13:56:27.848 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.845+0000 7f3f9c8bd700 1 Processor -- start 2020-11-20T13:56:27.849 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.845+0000 7f3f9c8bd700 1 -- start start 2020-11-20T13:56:27.849 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.846+0000 7f3f9c8bd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f980a7320 0x7f3f980a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.849 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.846+0000 7f3f9c8bd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3f9809fad0 0x7f3f9805bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.850 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.846+0000 7f3f9c8bd700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9809ff70 con 0x7f3f9805c250 2020-11-20T13:56:27.850 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.846+0000 7f3f9c8bd700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f980a0210 con 0x7f3f9809fad0 2020-11-20T13:56:27.850 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.846+0000 7f3f9c8bd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980a4330 con 0x7f3f980a7320 2020-11-20T13:56:27.850 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.846+0000 7f3f95d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3f9809fad0 0x7f3f9805bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.850 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.846+0000 7f3f96d9d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3f9805c250 0x7f3f9813ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35628/0 (socket says 172.21.15.39:35628) 2020-11-20T13:56:27.851 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.846+0000 7f3f96d9d700 1 -- 172.21.15.39:0/1810039175 learned_addr learned my addr 172.21.15.39:0/1810039175 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:27.851 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f9659c700 1 --2- 172.21.15.39:0/1810039175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f980a7320 0x7f3f980a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.851 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f9559a700 1 -- 172.21.15.39:0/1810039175 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106593336 0 0) 0x7f3f9809ff70 con 0x7f3f9805c250 2020-11-20T13:56:27.852 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f9559a700 1 -- 172.21.15.39:0/1810039175 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f78003230 con 0x7f3f9805c250 2020-11-20T13:56:27.852 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f95d9b700 1 -- 172.21.15.39:0/1810039175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f980a7320 msgr2=0x7f3f980a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:27.852 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f95d9b700 1 --2- 172.21.15.39:0/1810039175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f980a7320 0x7f3f980a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.852 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f95d9b700 1 -- 172.21.15.39:0/1810039175 >> v1:172.21.15.39:6789/0 conn(0x7f3f9805c250 legacy=0x7f3f9813ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.853 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f95d9b700 1 -- 172.21.15.39:0/1810039175 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980a7700 con 0x7f3f9809fad0 2020-11-20T13:56:27.853 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f95d9b700 1 --2- 172.21.15.39:0/1810039175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 0x7f3f9805bd60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3f88002f30 tx=0x7f3f88006dc0).ready entity=mon.1 client_cookie=c224ae2b63bdb10f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.853 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f9559a700 1 -- 172.21.15.39:0/1810039175 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f8800f9c0 con 0x7f3f9809fad0 2020-11-20T13:56:27.853 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f9559a700 1 -- 172.21.15.39:0/1810039175 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8800fb20 con 0x7f3f9809fad0 2020-11-20T13:56:27.854 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f9559a700 1 -- 172.21.15.39:0/1810039175 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f8800fe80 con 0x7f3f9809fad0 2020-11-20T13:56:27.854 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/1810039175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 msgr2=0x7f3f9805bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.854 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.847+0000 7f3f9c8bd700 1 --2- 172.21.15.39:0/1810039175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 0x7f3f9805bd60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3f88002f30 tx=0x7f3f88006dc0).stop 2020-11-20T13:56:27.854 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.848+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/1810039175 shutdown_connections 2020-11-20T13:56:27.854 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.848+0000 7f3f9c8bd700 1 --2- 172.21.15.39:0/1810039175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f980a7320 0x7f3f980a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.855 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.848+0000 7f3f9c8bd700 1 --2- 172.21.15.39:0/1810039175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 0x7f3f9805bd60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.855 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.848+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/1810039175 >> 172.21.15.39:0/1810039175 conn(0x7f3f980ab870 msgr2=0x7f3f980abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:27.855 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.848+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/1810039175 shutdown_connections 2020-11-20T13:56:27.855 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.848+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/1810039175 wait complete. 2020-11-20T13:56:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f9c8bd700 1 Processor -- start 2020-11-20T13:56:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f9c8bd700 1 -- start start 2020-11-20T13:56:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f9c8bd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f9805c250 0x7f3f98063910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f9c8bd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 0x7f3f981470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.860 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f9c8bd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f980a7320 0x7f3f981475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.860 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f9c8bd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9809dd20 con 0x7f3f980a7320 2020-11-20T13:56:27.860 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f9c8bd700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9809dfc0 con 0x7f3f9809fad0 2020-11-20T13:56:27.860 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f9c8bd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9809e260 con 0x7f3f9805c250 2020-11-20T13:56:27.860 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f95d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 0x7f3f981470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.861 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f95d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 0x7f3f981470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45460/0 (socket says 172.21.15.39:45460) 2020-11-20T13:56:27.861 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f95d9b700 1 -- 172.21.15.39:0/3698546406 learned_addr learned my addr 172.21.15.39:0/3698546406 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:27.861 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f9659c700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f9805c250 0x7f3f98063910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.861 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.849+0000 7f3f96d9d700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f980a7320 0x7f3f981475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.861 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f95d9b700 1 -- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f9805c250 msgr2=0x7f3f98063910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.862 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f95d9b700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f9805c250 0x7f3f98063910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.862 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f95d9b700 1 -- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f980a7320 msgr2=0x7f3f981475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:27.863 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f95d9b700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f980a7320 0x7f3f981475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:27.863 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f95d9b700 1 -- 172.21.15.39:0/3698546406 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9809eda0 con 0x7f3f9809fad0 2020-11-20T13:56:27.864 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f95d9b700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 0x7f3f981470c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3f88002f30 tx=0x7f3f88017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.864 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f8f7fe700 1 -- 172.21.15.39:0/3698546406 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f88018400 con 0x7f3f9809fad0 2020-11-20T13:56:27.864 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f8f7fe700 1 -- 172.21.15.39:0/3698546406 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88018560 con 0x7f3f9809fad0 2020-11-20T13:56:27.864 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f8f7fe700 1 -- 172.21.15.39:0/3698546406 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f880188c0 con 0x7f3f9809fad0 2020-11-20T13:56:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9813bf60 con 0x7f3f9809fad0 2020-11-20T13:56:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.850+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9809f250 con 0x7f3f9809fad0 2020-11-20T13:56:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.851+0000 7f3f8f7fe700 1 -- 172.21.15.39:0/3698546406 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f3f8802b070 con 0x7f3f9809fad0 2020-11-20T13:56:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.851+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f98057050 con 0x7f3f9809fad0 2020-11-20T13:56:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.851+0000 7f3f8f7fe700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3f7c0511d0 0x7f3f7c053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:27.866 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.851+0000 7f3f8f7fe700 1 -- 172.21.15.39:0/3698546406 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3f8806c2a0 con 0x7f3f9809fad0 2020-11-20T13:56:27.866 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.851+0000 7f3f9659c700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3f7c0511d0 0x7f3f7c053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:27.866 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.852+0000 7f3f9659c700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3f7c0511d0 0x7f3f7c053690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3f8000c000 tx=0x7f3f80008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:27.866 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:27.855+0000 7f3f8f7fe700 1 -- 172.21.15.39:0/3698546406 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f3f88044660 con 0x7f3f9809fad0 2020-11-20T13:56:28.017 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.016+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f9805d770 con 0x7f3f9809fad0 2020-11-20T13:56:28.017 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.016+0000 7f3f8f7fe700 1 -- 172.21.15.39:0/3698546406 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f88047c80 con 0x7f3f9809fad0 2020-11-20T13:56:28.017 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2020-11-20T13:56:28.018 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.017+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3f7c0511d0 msgr2=0x7f3f7c053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.017+0000 7f3f9c8bd700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3f7c0511d0 0x7f3f7c053690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3f8000c000 tx=0x7f3f80008040).stop 2020-11-20T13:56:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.017+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 msgr2=0x7f3f981470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.017+0000 7f3f9c8bd700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 0x7f3f981470c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3f88002f30 tx=0x7f3f88017000).stop 2020-11-20T13:56:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.017+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 shutdown_connections 2020-11-20T13:56:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.017+0000 7f3f9c8bd700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3f7c0511d0 0x7f3f7c053690 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.018+0000 7f3f9c8bd700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f980a7320 0x7f3f981475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.018+0000 7f3f9c8bd700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f9805c250 0x7f3f98063910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.018+0000 7f3f9c8bd700 1 --2- 172.21.15.39:0/3698546406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f9809fad0 0x7f3f981470c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.018+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 >> 172.21.15.39:0/3698546406 conn(0x7f3f980ab870 msgr2=0x7f3f98069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:28.021 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.018+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 shutdown_connections 2020-11-20T13:56:28.021 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.018+0000 7f3f9c8bd700 1 -- 172.21.15.39:0/3698546406 wait complete. 2020-11-20T13:56:28.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2020-11-20T13:56:28.029 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-11-20T13:56:28.144 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.143+0000 7fe291cc1700 1 Processor -- start 2020-11-20T13:56:28.144 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.143+0000 7fe291cc1700 1 -- start start 2020-11-20T13:56:28.147 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.144+0000 7fe291cc1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c0a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.147 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.144+0000 7fe291cc1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe28c05c470 0x7fe28c140f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.147 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.144+0000 7fe291cc1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c09ff70 con 0x7fe28c09fad0 2020-11-20T13:56:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.144+0000 7fe291cc1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c0a0210 con 0x7fe28c05c470 2020-11-20T13:56:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.144+0000 7fe291cc1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0a4330 con 0x7fe28c0a7320 2020-11-20T13:56:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.144+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c0a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.144+0000 7fe28bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe28c05c470 0x7fe28c140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.148 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.144+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c0a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.39:55924/0 (socket says 172.21.15.39:55924) 2020-11-20T13:56:28.149 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.144+0000 7fe28b7fe700 1 -- 172.21.15.39:0/1547439849 learned_addr learned my addr 172.21.15.39:0/1547439849 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:28.149 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe28b7fe700 1 -- 172.21.15.39:0/1547439849 >> v2:172.21.15.31:3300/0 conn(0x7fe28c05c470 msgr2=0x7fe28c140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:28.149 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe28b7fe700 1 --2- 172.21.15.39:0/1547439849 >> v2:172.21.15.31:3300/0 conn(0x7fe28c05c470 0x7fe28c140f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.149 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe28b7fe700 1 -- 172.21.15.39:0/1547439849 >> v1:172.21.15.31:6789/0 conn(0x7fe28c09fad0 legacy=0x7fe28c05bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.149 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe28b7fe700 1 -- 172.21.15.39:0/1547439849 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c0a7700 con 0x7fe28c0a7320 2020-11-20T13:56:28.150 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe28b7fe700 1 --2- 172.21.15.39:0/1547439849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c0a47d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe27c002f30 tx=0x7fe27c006e80).ready entity=mon.2 client_cookie=e12cbdff7c2c6377 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:28.150 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe28a7fc700 1 -- 172.21.15.39:0/1547439849 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe27c0097f0 con 0x7fe28c0a7320 2020-11-20T13:56:28.150 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe28a7fc700 1 -- 172.21.15.39:0/1547439849 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c009950 con 0x7fe28c0a7320 2020-11-20T13:56:28.150 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe28a7fc700 1 -- 172.21.15.39:0/1547439849 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe27c009cb0 con 0x7fe28c0a7320 2020-11-20T13:56:28.150 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe291cc1700 1 -- 172.21.15.39:0/1547439849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 msgr2=0x7fe28c0a47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.151 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe291cc1700 1 --2- 172.21.15.39:0/1547439849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c0a47d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe27c002f30 tx=0x7fe27c006e80).stop 2020-11-20T13:56:28.151 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe291cc1700 1 -- 172.21.15.39:0/1547439849 shutdown_connections 2020-11-20T13:56:28.151 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe291cc1700 1 --2- 172.21.15.39:0/1547439849 >> v2:172.21.15.31:3300/0 conn(0x7fe28c05c470 0x7fe28c140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.151 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe291cc1700 1 --2- 172.21.15.39:0/1547439849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c0a47d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.151 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe291cc1700 1 -- 172.21.15.39:0/1547439849 >> 172.21.15.39:0/1547439849 conn(0x7fe28c0ab870 msgr2=0x7fe28c0abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe291cc1700 1 -- 172.21.15.39:0/1547439849 shutdown_connections 2020-11-20T13:56:28.153 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.145+0000 7fe291cc1700 1 -- 172.21.15.39:0/1547439849 wait complete. 2020-11-20T13:56:28.153 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.146+0000 7fe291cc1700 1 Processor -- start 2020-11-20T13:56:28.153 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe291cc1700 1 -- start start 2020-11-20T13:56:28.156 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe291cc1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe28c05c470 0x7fe28c09ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.156 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe291cc1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe28c09fad0 0x7fe28c09ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.156 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe291cc1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c130570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.156 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe291cc1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c09bf60 con 0x7fe28c09fad0 2020-11-20T13:56:28.157 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe291cc1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c09c150 con 0x7fe28c05c470 2020-11-20T13:56:28.157 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe291cc1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c09c3f0 con 0x7fe28c0a7320 2020-11-20T13:56:28.157 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe28c05c470 0x7fe28c09ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.157 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe28c05c470 0x7fe28c09ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45474/0 (socket says 172.21.15.39:45474) 2020-11-20T13:56:28.158 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe28b7fe700 1 -- 172.21.15.39:0/3897538046 learned_addr learned my addr 172.21.15.39:0/3897538046 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:28.158 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe28bfff700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.158 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.147+0000 7fe28affd700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe28c09fad0 0x7fe28c09ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe28b7fe700 1 -- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 msgr2=0x7fe28c130570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe28b7fe700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c130570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe28b7fe700 1 -- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe28c09fad0 msgr2=0x7fe28c09ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe28b7fe700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe28c09fad0 0x7fe28c09ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe28b7fe700 1 -- 172.21.15.39:0/3897538046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c136e80 con 0x7fe28c05c470 2020-11-20T13:56:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe28b7fe700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe28c05c470 0x7fe28c09ea40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe27c002f30 tx=0x7fe27c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe288ff9700 1 -- 172.21.15.39:0/3897538046 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe27c009ea0 con 0x7fe28c05c470 2020-11-20T13:56:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe288ff9700 1 -- 172.21.15.39:0/3897538046 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c011e50 con 0x7fe28c05c470 2020-11-20T13:56:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c1350b0 con 0x7fe28c05c470 2020-11-20T13:56:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe288ff9700 1 -- 172.21.15.39:0/3897538046 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe27c01e460 con 0x7fe28c05c470 2020-11-20T13:56:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.148+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c137f10 con 0x7fe28c05c470 2020-11-20T13:56:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.149+0000 7fe288ff9700 1 -- 172.21.15.39:0/3897538046 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fe27c025030 con 0x7fe28c05c470 2020-11-20T13:56:28.162 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.149+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c09d2d0 con 0x7fe28c05c470 2020-11-20T13:56:28.162 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.149+0000 7fe288ff9700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe26c051270 0x7fe26c053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.162 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.149+0000 7fe288ff9700 1 -- 172.21.15.39:0/3897538046 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe27c06a160 con 0x7fe28c05c470 2020-11-20T13:56:28.162 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.149+0000 7fe28affd700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe26c051270 0x7fe26c053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.162 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.150+0000 7fe28affd700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe26c051270 0x7fe26c053730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe28000d000 tx=0x7fe280000b80).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:28.163 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.153+0000 7fe288ff9700 1 -- 172.21.15.39:0/3897538046 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fe27c042520 con 0x7fe28c05c470 2020-11-20T13:56:28.313 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.313+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe28c057050 con 0x7fe28c05c470 2020-11-20T13:56:28.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.313+0000 7fe288ff9700 1 -- 172.21.15.39:0/3897538046 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe27c023090 con 0x7fe28c05c470 2020-11-20T13:56:28.314 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:28.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe26c051270 msgr2=0x7fe26c053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe26c051270 0x7fe26c053730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe28000d000 tx=0x7fe280000b80).stop 2020-11-20T13:56:28.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe28c05c470 msgr2=0x7fe28c09ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe28c05c470 0x7fe28c09ea40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe27c002f30 tx=0x7fe27c015000).stop 2020-11-20T13:56:28.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 shutdown_connections 2020-11-20T13:56:28.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fe26c051270 0x7fe26c053730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe28c05c470 0x7fe28c09ea40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe28c0a7320 0x7fe28c130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 --2- 172.21.15.39:0/3897538046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe28c09fad0 0x7fe28c09ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 >> 172.21.15.39:0/3897538046 conn(0x7fe28c0ab870 msgr2=0x7fe28c05bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:28.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 shutdown_connections 2020-11-20T13:56:28.318 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.314+0000 7fe291cc1700 1 -- 172.21.15.39:0/3897538046 wait complete. 2020-11-20T13:56:28.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2020-11-20T13:56:28.326 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-11-20T13:56:28.442 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.441+0000 7f2e61568700 1 Processor -- start 2020-11-20T13:56:28.442 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.441+0000 7f2e61568700 1 -- start start 2020-11-20T13:56:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.441+0000 7f2e61568700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e5c0a6aa0 0x7f2e5c05c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.441+0000 7f2e61568700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c0a29b0 con 0x7f2e5c0a73a0 2020-11-20T13:56:28.444 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.441+0000 7f2e61568700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c0a6100 con 0x7f2e5c0a35e0 2020-11-20T13:56:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.441+0000 7f2e61568700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c066ff0 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e5b7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2e5c0a35e0 0x7f2e5c0668e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35654/0 (socket says 172.21.15.39:35654) 2020-11-20T13:56:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e5b7fe700 1 -- 172.21.15.39:0/1114771428 learned_addr learned my addr 172.21.15.39:0/1114771428 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e53fff700 1 --2- 172.21.15.39:0/1114771428 >> v2:172.21.15.31:3300/0 conn(0x7f2e5c0a6aa0 0x7f2e5c05c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.445 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e5a7fc700 1 -- 172.21.15.39:0/1114771428 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017828995 0 0) 0x7f2e5c0a6100 con 0x7f2e5c0a35e0 2020-11-20T13:56:28.446 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e5a7fc700 1 -- 172.21.15.39:0/1114771428 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c003230 con 0x7f2e5c0a35e0 2020-11-20T13:56:28.446 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e53fff700 1 -- 172.21.15.39:0/1114771428 >> v1:172.21.15.39:6789/0 conn(0x7f2e5c0a35e0 legacy=0x7f2e5c0668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.446 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e53fff700 1 -- 172.21.15.39:0/1114771428 >> v1:172.21.15.31:6789/0 conn(0x7f2e5c0a73a0 legacy=0x7f2e5c0661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.446 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e53fff700 1 -- 172.21.15.39:0/1114771428 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c0a6360 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.446 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e53fff700 1 --2- 172.21.15.39:0/1114771428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e5c0a6aa0 0x7f2e5c05c180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2e44002f30 tx=0x7f2e44006dc0).ready entity=mon.0 client_cookie=f0859cfa65f758c3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e5a7fc700 1 -- 172.21.15.39:0/1114771428 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e44009800 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e5a7fc700 1 -- 172.21.15.39:0/1114771428 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44009960 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e61568700 1 -- 172.21.15.39:0/1114771428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e5c0a6aa0 msgr2=0x7f2e5c05c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e61568700 1 --2- 172.21.15.39:0/1114771428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e5c0a6aa0 0x7f2e5c05c180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2e44002f30 tx=0x7f2e44006dc0).stop 2020-11-20T13:56:28.447 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.442+0000 7f2e5a7fc700 1 -- 172.21.15.39:0/1114771428 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e44009cc0 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.448 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.443+0000 7f2e61568700 1 -- 172.21.15.39:0/1114771428 shutdown_connections 2020-11-20T13:56:28.448 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.443+0000 7f2e61568700 1 --2- 172.21.15.39:0/1114771428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e5c0a6aa0 0x7f2e5c05c180 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.448 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.443+0000 7f2e61568700 1 -- 172.21.15.39:0/1114771428 >> 172.21.15.39:0/1114771428 conn(0x7f2e5c0ab870 msgr2=0x7f2e5c0abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:28.449 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.443+0000 7f2e61568700 1 -- 172.21.15.39:0/1114771428 shutdown_connections 2020-11-20T13:56:28.449 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.443+0000 7f2e61568700 1 -- 172.21.15.39:0/1114771428 wait complete. 2020-11-20T13:56:28.452 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.444+0000 7f2e61568700 1 Processor -- start 2020-11-20T13:56:28.452 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.444+0000 7f2e61568700 1 -- start start 2020-11-20T13:56:28.453 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.444+0000 7f2e61568700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e5c0a35e0 0x7f2e5c09ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.453 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.444+0000 7f2e61568700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e5c0a6aa0 0x7f2e5c148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.453 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.444+0000 7f2e61568700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e5c0a73a0 0x7f2e5c138330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.453 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.444+0000 7f2e61568700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0a0a30 con 0x7f2e5c0a35e0 2020-11-20T13:56:28.454 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e61568700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0a06e0 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.454 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e61568700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c147ff0 con 0x7f2e5c0a73a0 2020-11-20T13:56:28.454 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e53fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e5c0a6aa0 0x7f2e5c148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.454 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e53fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e5c0a6aa0 0x7f2e5c148730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45488/0 (socket says 172.21.15.39:45488) 2020-11-20T13:56:28.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e53fff700 1 -- 172.21.15.39:0/3208609767 learned_addr learned my addr 172.21.15.39:0/3208609767 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:28.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e5affd700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e5c0a35e0 0x7f2e5c09ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e5b7fe700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e5c0a73a0 0x7f2e5c138330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e53fff700 1 -- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e5c0a73a0 msgr2=0x7f2e5c138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.455 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e53fff700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e5c0a73a0 0x7f2e5c138330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.456 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e53fff700 1 -- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e5c0a35e0 msgr2=0x7f2e5c09ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.456 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e53fff700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e5c0a35e0 0x7f2e5c09ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.456 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e53fff700 1 -- 172.21.15.39:0/3208609767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c148290 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.456 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e53fff700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e5c0a6aa0 0x7f2e5c148730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2e5c09e810 tx=0x7f2e44015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:28.457 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e58ff9700 1 -- 172.21.15.39:0/3208609767 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e44011b40 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.457 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e58ff9700 1 -- 172.21.15.39:0/3208609767 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44011ca0 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.457 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e58ff9700 1 -- 172.21.15.39:0/3208609767 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e4401d440 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.457 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c0a2630 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.458 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.445+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c13fd70 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.458 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.446+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c148420 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.458 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.446+0000 7f2e58ff9700 1 -- 172.21.15.39:0/3208609767 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f2e44017070 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.458 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.447+0000 7f2e58ff9700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f2e400511d0 0x7f2e40053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.458 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.447+0000 7f2e58ff9700 1 -- 172.21.15.39:0/3208609767 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2e44069ab0 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.447+0000 7f2e5affd700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f2e400511d0 0x7f2e40053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.447+0000 7f2e5affd700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f2e400511d0 0x7f2e40053690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2e4c00d000 tx=0x7f2e4c007ad0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:28.459 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.450+0000 7f2e58ff9700 1 -- 172.21.15.39:0/3208609767 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f2e44041e70 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.610 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.609+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2e5c057050 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.610 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.609+0000 7f2e58ff9700 1 -- 172.21.15.39:0/3208609767 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e44022070 con 0x7f2e5c0a6aa0 2020-11-20T13:56:28.610 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2020-11-20T13:56:28.612 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f2e400511d0 msgr2=0x7f2e40053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.612 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f2e400511d0 0x7f2e40053690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2e4c00d000 tx=0x7f2e4c007ad0).stop 2020-11-20T13:56:28.612 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e5c0a6aa0 msgr2=0x7f2e5c148730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.612 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e5c0a6aa0 0x7f2e5c148730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2e5c09e810 tx=0x7f2e44015000).stop 2020-11-20T13:56:28.613 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 shutdown_connections 2020-11-20T13:56:28.613 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f2e400511d0 0x7f2e40053690 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.613 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e5c0a73a0 0x7f2e5c138330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e5c0a35e0 0x7f2e5c09ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 --2- 172.21.15.39:0/3208609767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e5c0a6aa0 0x7f2e5c148730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 >> 172.21.15.39:0/3208609767 conn(0x7f2e5c0ab870 msgr2=0x7f2e5c0abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 shutdown_connections 2020-11-20T13:56:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.611+0000 7f2e61568700 1 -- 172.21.15.39:0/3208609767 wait complete. 2020-11-20T13:56:28.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2020-11-20T13:56:28.622 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-11-20T13:56:28.737 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.737+0000 7f3b5a307700 1 Processor -- start 2020-11-20T13:56:28.738 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.737+0000 7f3b5a307700 1 -- start start 2020-11-20T13:56:28.743 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.737+0000 7f3b5a307700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3b5405fdf0 0x7f3b540a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.743 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.737+0000 7f3b5a307700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5409cbd0 con 0x7f3b5413d750 2020-11-20T13:56:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.737+0000 7f3b5a307700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b540a8e80 con 0x7f3b540a7b50 2020-11-20T13:56:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.737+0000 7f3b5a307700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b540a3f90 con 0x7f3b5405fdf0 2020-11-20T13:56:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.737+0000 7f3b537fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3b540a7b50 0x7f3b5413d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35668/0 (socket says 172.21.15.39:35668) 2020-11-20T13:56:28.744 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b537fe700 1 -- 172.21.15.39:0/1411609108 learned_addr learned my addr 172.21.15.39:0/1411609108 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639255457 0 0) 0x7f3b540a8e80 con 0x7f3b540a7b50 2020-11-20T13:56:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b53fff700 1 --2- 172.21.15.39:0/1411609108 >> v2:172.21.15.31:3300/0 conn(0x7f3b5405fdf0 0x7f3b540a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b40003230 con 0x7f3b540a7b50 2020-11-20T13:56:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 975276961 0 0) 0x7f3b40003230 con 0x7f3b540a7b50 2020-11-20T13:56:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 >> v2:172.21.15.31:3300/0 conn(0x7f3b5405fdf0 msgr2=0x7f3b540a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 --2- 172.21.15.39:0/1411609108 >> v2:172.21.15.31:3300/0 conn(0x7f3b5405fdf0 0x7f3b540a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 >> v1:172.21.15.31:6789/0 conn(0x7f3b5413d750 legacy=0x7f3b54144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5405c450 con 0x7f3b540a7b50 2020-11-20T13:56:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7f3b480016d0 con 0x7f3b540a7b50 2020-11-20T13:56:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 >> v1:172.21.15.39:6789/0 conn(0x7f3b540a7b50 legacy=0x7f3b5413d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b40003720 0x7f3b40003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b400044d0 0x7f3b40004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b4000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540a3f90 con 0x7f3b400044d0 2020-11-20T13:56:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4000bc10 con 0x7f3b40004e40 2020-11-20T13:56:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4000bd50 con 0x7f3b40003720 2020-11-20T13:56:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b588a4700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b4000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b53fff700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b40003720 0x7f3b40003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.738+0000 7f3b537fe700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b400044d0 0x7f3b40004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b588a4700 1 -- 172.21.15.39:0/1411609108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b40003720 msgr2=0x7f3b40003b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b588a4700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b40003720 0x7f3b40003b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b588a4700 1 -- 172.21.15.39:0/1411609108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b400044d0 msgr2=0x7f3b40004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:28.751 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b588a4700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b400044d0 0x7f3b40004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.751 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b588a4700 1 -- 172.21.15.39:0/1411609108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b40003230 con 0x7f3b40004e40 2020-11-20T13:56:28.751 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b588a4700 1 -- 172.21.15.39:0/1411609108 reap_dead start 2020-11-20T13:56:28.751 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b588a4700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b4000b720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f3b540a8820 tx=0x7f3b4c007e50).ready entity=mon.1 client_cookie=37f363b1b88723 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:28.751 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b4c00c960 con 0x7f3b40004e40 2020-11-20T13:56:28.752 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c00cac0 con 0x7f3b40004e40 2020-11-20T13:56:28.752 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b52ffd700 1 -- 172.21.15.39:0/1411609108 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b4c00ce20 con 0x7f3b40004e40 2020-11-20T13:56:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b5a307700 1 -- 172.21.15.39:0/1411609108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 msgr2=0x7f3b4000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b5a307700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b4000b720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f3b540a8820 tx=0x7f3b4c007e50).stop 2020-11-20T13:56:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b5a307700 1 -- 172.21.15.39:0/1411609108 shutdown_connections 2020-11-20T13:56:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b5a307700 1 --2- 172.21.15.39:0/1411609108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b4000b720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b5a307700 1 -- 172.21.15.39:0/1411609108 >> 172.21.15.39:0/1411609108 conn(0x7f3b54062f90 msgr2=0x7f3b5405f360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b5a307700 1 -- 172.21.15.39:0/1411609108 shutdown_connections 2020-11-20T13:56:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.739+0000 7f3b5a307700 1 -- 172.21.15.39:0/1411609108 wait complete. 2020-11-20T13:56:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.740+0000 7f3b5a307700 1 Processor -- start 2020-11-20T13:56:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.740+0000 7f3b5a307700 1 -- start start 2020-11-20T13:56:28.756 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b5a307700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b5409f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.756 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b5a307700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b54063710 0x7f3b5409d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.756 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b5a307700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b54140480 0x7f3b5409d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.757 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b5a307700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54065360 con 0x7f3b54063710 2020-11-20T13:56:28.757 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b5a307700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540a0190 con 0x7f3b40004e40 2020-11-20T13:56:28.757 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b5a307700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54065550 con 0x7f3b54140480 2020-11-20T13:56:28.757 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b5409f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.757 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b5409f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45506/0 (socket says 172.21.15.39:45506) 2020-11-20T13:56:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b53fff700 1 -- 172.21.15.39:0/1185679226 learned_addr learned my addr 172.21.15.39:0/1185679226 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b588a4700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b54140480 0x7f3b5409d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b537fe700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b54063710 0x7f3b5409d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b53fff700 1 -- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b54140480 msgr2=0x7f3b5409d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.758 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b53fff700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b54140480 0x7f3b5409d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b53fff700 1 -- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b54063710 msgr2=0x7f3b5409d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b53fff700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b54063710 0x7f3b5409d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b53fff700 1 -- 172.21.15.39:0/1185679226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540657f0 con 0x7f3b40004e40 2020-11-20T13:56:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.741+0000 7f3b53fff700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b5409f070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f3b54067ce0 tx=0x7f3b44008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.742+0000 7f3b517fa700 1 -- 172.21.15.39:0/1185679226 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b4400f910 con 0x7f3b40004e40 2020-11-20T13:56:28.760 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.742+0000 7f3b517fa700 1 -- 172.21.15.39:0/1185679226 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4400fa70 con 0x7f3b40004e40 2020-11-20T13:56:28.760 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.742+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b540a6e80 con 0x7f3b40004e40 2020-11-20T13:56:28.760 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.742+0000 7f3b517fa700 1 -- 172.21.15.39:0/1185679226 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b4400fdd0 con 0x7f3b40004e40 2020-11-20T13:56:28.760 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.742+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5409f560 con 0x7f3b40004e40 2020-11-20T13:56:28.761 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.743+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b54065980 con 0x7f3b40004e40 2020-11-20T13:56:28.762 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.743+0000 7f3b517fa700 1 -- 172.21.15.39:0/1185679226 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f3b44014440 con 0x7f3b40004e40 2020-11-20T13:56:28.762 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.743+0000 7f3b517fa700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3b340512f0 0x7f3b340537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:28.762 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.743+0000 7f3b517fa700 1 -- 172.21.15.39:0/1185679226 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b440698b0 con 0x7f3b40004e40 2020-11-20T13:56:28.762 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.743+0000 7f3b537fe700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3b340512f0 0x7f3b340537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:28.762 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.744+0000 7f3b537fe700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3b340512f0 0x7f3b340537b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f3b48005000 tx=0x7f3b540a6350).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:28.763 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.747+0000 7f3b517fa700 1 -- 172.21.15.39:0/1185679226 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f3b44041c10 con 0x7f3b40004e40 2020-11-20T13:56:28.909 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.908+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3b54057050 con 0x7f3b40004e40 2020-11-20T13:56:28.910 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.909+0000 7f3b517fa700 1 -- 172.21.15.39:0/1185679226 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b44018020 con 0x7f3b40004e40 2020-11-20T13:56:28.910 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2020-11-20T13:56:28.911 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3b340512f0 msgr2=0x7f3b340537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.912 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3b340512f0 0x7f3b340537b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f3b48005000 tx=0x7f3b540a6350).stop 2020-11-20T13:56:28.912 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 msgr2=0x7f3b5409f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:28.912 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b5409f070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f3b54067ce0 tx=0x7f3b44008040).stop 2020-11-20T13:56:28.912 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 shutdown_connections 2020-11-20T13:56:28.913 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3b340512f0 0x7f3b340537b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.913 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b40004e40 0x7f3b5409f070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.913 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b54140480 0x7f3b5409d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.913 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 --2- 172.21.15.39:0/1185679226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b54063710 0x7f3b5409d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:28.914 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.910+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 >> 172.21.15.39:0/1185679226 conn(0x7f3b54062f90 msgr2=0x7f3b540acf00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:28.914 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.911+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 shutdown_connections 2020-11-20T13:56:28.914 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:28.911+0000 7f3b5a307700 1 -- 172.21.15.39:0/1185679226 wait complete. 2020-11-20T13:56:28.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2020-11-20T13:56:29.923 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-11-20T13:56:30.050 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.049+0000 7fb678dc4700 1 Processor -- start 2020-11-20T13:56:30.051 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.049+0000 7fb678dc4700 1 -- start start 2020-11-20T13:56:30.053 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.050+0000 7fb678dc4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6740a5080 0x7fb674066ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.053 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.050+0000 7fb678dc4700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb67405bcb0 0x7fb67405c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.053 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.050+0000 7fb678dc4700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740a0b00 con 0x7fb67405c600 2020-11-20T13:56:30.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.050+0000 7fb678dc4700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6740a06d0 con 0x7fb67405bcb0 2020-11-20T13:56:30.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.050+0000 7fb678dc4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67409f630 con 0x7fb6740a5080 2020-11-20T13:56:30.054 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.050+0000 7fb671d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb67405bcb0 0x7fb67405c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.050+0000 7fb672d9d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb67405c600 0x7fb674140f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35690/0 (socket says 172.21.15.39:35690) 2020-11-20T13:56:30.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.050+0000 7fb672d9d700 1 -- 172.21.15.39:0/2917838644 learned_addr learned my addr 172.21.15.39:0/2917838644 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:30.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb67259c700 1 --2- 172.21.15.39:0/2917838644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6740a5080 0x7fb674066ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb671d9b700 1 -- 172.21.15.39:0/2917838644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6740a5080 msgr2=0x7fb674066ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:30.055 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb671d9b700 1 --2- 172.21.15.39:0/2917838644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6740a5080 0x7fb674066ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb671d9b700 1 -- 172.21.15.39:0/2917838644 >> v1:172.21.15.39:6789/0 conn(0x7fb67405c600 legacy=0x7fb674140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb671d9b700 1 -- 172.21.15.39:0/2917838644 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6740a0d60 con 0x7fb67405bcb0 2020-11-20T13:56:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb67159a700 1 -- 172.21.15.39:0/2917838644 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282777503 0 0) 0x7fb6740a0b00 con 0x7fb67405c600 2020-11-20T13:56:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb671d9b700 1 --2- 172.21.15.39:0/2917838644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb67405bcb0 0x7fb67405c110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb664002f30 tx=0x7fb664006dc0).ready entity=mon.1 client_cookie=dadb930e1fbc5ead server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.056 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb67159a700 1 -- 172.21.15.39:0/2917838644 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb664009760 con 0x7fb67405bcb0 2020-11-20T13:56:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb67159a700 1 -- 172.21.15.39:0/2917838644 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640098c0 con 0x7fb67405bcb0 2020-11-20T13:56:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb67159a700 1 -- 172.21.15.39:0/2917838644 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb664009c20 con 0x7fb67405bcb0 2020-11-20T13:56:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb678dc4700 1 -- 172.21.15.39:0/2917838644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb67405bcb0 msgr2=0x7fb67405c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.051+0000 7fb678dc4700 1 --2- 172.21.15.39:0/2917838644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb67405bcb0 0x7fb67405c110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb664002f30 tx=0x7fb664006dc0).stop 2020-11-20T13:56:30.057 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.052+0000 7fb678dc4700 1 -- 172.21.15.39:0/2917838644 shutdown_connections 2020-11-20T13:56:30.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.052+0000 7fb678dc4700 1 --2- 172.21.15.39:0/2917838644 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6740a5080 0x7fb674066ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.052+0000 7fb678dc4700 1 --2- 172.21.15.39:0/2917838644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb67405bcb0 0x7fb67405c110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.052+0000 7fb678dc4700 1 -- 172.21.15.39:0/2917838644 >> 172.21.15.39:0/2917838644 conn(0x7fb6740ab870 msgr2=0x7fb6740abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:30.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.052+0000 7fb678dc4700 1 -- 172.21.15.39:0/2917838644 shutdown_connections 2020-11-20T13:56:30.058 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.052+0000 7fb678dc4700 1 -- 172.21.15.39:0/2917838644 wait complete. 2020-11-20T13:56:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.053+0000 7fb678dc4700 1 Processor -- start 2020-11-20T13:56:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.053+0000 7fb678dc4700 1 -- start start 2020-11-20T13:56:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb678dc4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb67405bcb0 0x7fb674063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.062 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb678dc4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb67405c600 0x7fb67409d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.062 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb678dc4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6740a5080 0x7fb6741375b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.062 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb678dc4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740667d0 con 0x7fb67405c600 2020-11-20T13:56:30.062 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb678dc4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb674066a70 con 0x7fb6740a5080 2020-11-20T13:56:30.062 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb678dc4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb674063720 con 0x7fb67405bcb0 2020-11-20T13:56:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb672d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6740a5080 0x7fb6741375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb67259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb67405bcb0 0x7fb674063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb672d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6740a5080 0x7fb6741375b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45524/0 (socket says 172.21.15.39:45524) 2020-11-20T13:56:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb672d9d700 1 -- 172.21.15.39:0/2967277992 learned_addr learned my addr 172.21.15.39:0/2967277992 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:30.063 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb671d9b700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb67405c600 0x7fb67409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb672d9d700 1 -- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb67405bcb0 msgr2=0x7fb674063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb672d9d700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb67405bcb0 0x7fb674063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.064 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb672d9d700 1 -- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb67405c600 msgr2=0x7fb67409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb672d9d700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb67405c600 0x7fb67409d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb672d9d700 1 -- 172.21.15.39:0/2967277992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67409ea60 con 0x7fb6740a5080 2020-11-20T13:56:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb672d9d700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6740a5080 0x7fb6741375b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb66c000f00 tx=0x7fb66c007cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.065 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb66b7fe700 1 -- 172.21.15.39:0/2967277992 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb66c00ce70 con 0x7fb6740a5080 2020-11-20T13:56:30.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.054+0000 7fb66b7fe700 1 -- 172.21.15.39:0/2967277992 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c005b70 con 0x7fb6740a5080 2020-11-20T13:56:30.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.055+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6740621f0 con 0x7fb6740a5080 2020-11-20T13:56:30.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.055+0000 7fb66b7fe700 1 -- 172.21.15.39:0/2967277992 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb66c007110 con 0x7fb6740a5080 2020-11-20T13:56:30.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.055+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67413a360 con 0x7fb6740a5080 2020-11-20T13:56:30.066 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.056+0000 7fb66b7fe700 1 -- 172.21.15.39:0/2967277992 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fb66c010030 con 0x7fb6740a5080 2020-11-20T13:56:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.056+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6740638e0 con 0x7fb6740a5080 2020-11-20T13:56:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.056+0000 7fb66b7fe700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb658051270 0x7fb658053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.056+0000 7fb66b7fe700 1 -- 172.21.15.39:0/2967277992 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb66c068f20 con 0x7fb6740a5080 2020-11-20T13:56:30.067 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.056+0000 7fb67259c700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb658051270 0x7fb658053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.068 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.056+0000 7fb67259c700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb658051270 0x7fb658053730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb65c00b000 tx=0x7fb65c006dc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.068 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.059+0000 7fb66b7fe700 1 -- 172.21.15.39:0/2967277992 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fb66c066a60 con 0x7fb6740a5080 2020-11-20T13:56:30.220 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.219+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb674066bb0 con 0x7fb6740a5080 2020-11-20T13:56:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.220+0000 7fb66b7fe700 1 -- 172.21.15.39:0/2967277992 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb66c041280 con 0x7fb6740a5080 2020-11-20T13:56:30.221 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb658051270 msgr2=0x7fb658053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb658051270 0x7fb658053730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb65c00b000 tx=0x7fb65c006dc0).stop 2020-11-20T13:56:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6740a5080 msgr2=0x7fb6741375b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6740a5080 0x7fb6741375b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb66c000f00 tx=0x7fb66c007cb0).stop 2020-11-20T13:56:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 shutdown_connections 2020-11-20T13:56:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fb658051270 0x7fb658053730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6740a5080 0x7fb6741375b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb67405bcb0 0x7fb674063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 --2- 172.21.15.39:0/2967277992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb67405c600 0x7fb67409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 >> 172.21.15.39:0/2967277992 conn(0x7fb6740ab870 msgr2=0x7fb6740a75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:30.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 shutdown_connections 2020-11-20T13:56:30.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.221+0000 7fb678dc4700 1 -- 172.21.15.39:0/2967277992 wait complete. 2020-11-20T13:56:30.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2020-11-20T13:56:30.234 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-11-20T13:56:30.349 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.349+0000 7eff920e7700 1 Processor -- start 2020-11-20T13:56:30.350 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.349+0000 7eff920e7700 1 -- start start 2020-11-20T13:56:30.354 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.349+0000 7eff920e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c09fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.349+0000 7eff920e7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7eff8c13df10 0x7eff8c140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.349+0000 7eff920e7700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c0a02f0 con 0x7eff8c0a04a0 2020-11-20T13:56:30.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.349+0000 7eff920e7700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c0a0050 con 0x7eff8c13df10 2020-11-20T13:56:30.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.349+0000 7eff920e7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0a43d0 con 0x7eff8c0a74e0 2020-11-20T13:56:30.355 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.349+0000 7eff8bfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7eff8c13df10 0x7eff8c140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.349+0000 7eff8affd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7eff8c0a04a0 0x7eff8c0a4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35700/0 (socket says 172.21.15.39:35700) 2020-11-20T13:56:30.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8bfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7eff8c13df10 0x7eff8c140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45532/0 (socket says 172.21.15.39:45532) 2020-11-20T13:56:30.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8affd700 1 -- 172.21.15.39:0/2388927441 learned_addr learned my addr 172.21.15.39:0/2388927441 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:30.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8b7fe700 1 --2- 172.21.15.39:0/2388927441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c09fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.356 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8bfff700 1 -- 172.21.15.39:0/2388927441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 msgr2=0x7eff8c09fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:30.357 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8bfff700 1 --2- 172.21.15.39:0/2388927441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c09fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.357 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8bfff700 1 -- 172.21.15.39:0/2388927441 >> v1:172.21.15.39:6789/0 conn(0x7eff8c0a04a0 legacy=0x7eff8c0a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.357 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8bfff700 1 -- 172.21.15.39:0/2388927441 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0679a0 con 0x7eff8c13df10 2020-11-20T13:56:30.357 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8a7fc700 1 -- 172.21.15.39:0/2388927441 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276380973 0 0) 0x7eff8c0a02f0 con 0x7eff8c0a04a0 2020-11-20T13:56:30.357 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8b7fe700 1 --2- 172.21.15.39:0/2388927441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c09fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:30.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8bfff700 1 --2- 172.21.15.39:0/2388927441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c13df10 0x7eff8c140300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7eff7c002f30 tx=0x7eff7c006dc0).ready entity=mon.1 client_cookie=4573914936c1a7f0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8a7fc700 1 -- 172.21.15.39:0/2388927441 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7c0097f0 con 0x7eff8c13df10 2020-11-20T13:56:30.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8a7fc700 1 -- 172.21.15.39:0/2388927441 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c009950 con 0x7eff8c13df10 2020-11-20T13:56:30.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff8a7fc700 1 -- 172.21.15.39:0/2388927441 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7c009cb0 con 0x7eff8c13df10 2020-11-20T13:56:30.358 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff920e7700 1 -- 172.21.15.39:0/2388927441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c13df10 msgr2=0x7eff8c140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.350+0000 7eff920e7700 1 --2- 172.21.15.39:0/2388927441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c13df10 0x7eff8c140300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7eff7c002f30 tx=0x7eff7c006dc0).stop 2020-11-20T13:56:30.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.351+0000 7eff920e7700 1 -- 172.21.15.39:0/2388927441 shutdown_connections 2020-11-20T13:56:30.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.351+0000 7eff920e7700 1 --2- 172.21.15.39:0/2388927441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c09fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.351+0000 7eff920e7700 1 --2- 172.21.15.39:0/2388927441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c13df10 0x7eff8c140300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.359 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.351+0000 7eff920e7700 1 -- 172.21.15.39:0/2388927441 >> 172.21.15.39:0/2388927441 conn(0x7eff8c0ab870 msgr2=0x7eff8c0abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:30.360 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.351+0000 7eff920e7700 1 -- 172.21.15.39:0/2388927441 shutdown_connections 2020-11-20T13:56:30.360 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.351+0000 7eff920e7700 1 -- 172.21.15.39:0/2388927441 wait complete. 2020-11-20T13:56:30.360 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.351+0000 7eff920e7700 1 Processor -- start 2020-11-20T13:56:30.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff920e7700 1 -- start start 2020-11-20T13:56:30.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff920e7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c0a04a0 0x7eff8c08fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff920e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c090020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.363 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff920e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff8c13df10 0x7eff8c13c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff920e7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c090510 con 0x7eff8c13df10 2020-11-20T13:56:30.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff920e7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c091800 con 0x7eff8c0a04a0 2020-11-20T13:56:30.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff920e7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0a3600 con 0x7eff8c0a74e0 2020-11-20T13:56:30.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff8b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c0a04a0 0x7eff8c08fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.364 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff8b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c0a04a0 0x7eff8c08fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45534/0 (socket says 172.21.15.39:45534) 2020-11-20T13:56:30.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.352+0000 7eff8b7fe700 1 -- 172.21.15.39:0/2422757379 learned_addr learned my addr 172.21.15.39:0/2422757379 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:30.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8bfff700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff8c13df10 0x7eff8c13c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8affd700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c090020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8b7fe700 1 -- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 msgr2=0x7eff8c090020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.365 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8b7fe700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c090020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8b7fe700 1 -- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff8c13df10 msgr2=0x7eff8c13c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8b7fe700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff8c13df10 0x7eff8c13c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8b7fe700 1 -- 172.21.15.39:0/2422757379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c08f150 con 0x7eff8c0a04a0 2020-11-20T13:56:30.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8bfff700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff8c13df10 0x7eff8c13c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:30.366 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8affd700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c090020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:30.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff8b7fe700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c0a04a0 0x7eff8c08fb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7eff8c13d780 tx=0x7eff84008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff88ff9700 1 -- 172.21.15.39:0/2422757379 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff84007990 con 0x7eff8c0a04a0 2020-11-20T13:56:30.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff88ff9700 1 -- 172.21.15.39:0/2422757379 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff84007af0 con 0x7eff8c0a04a0 2020-11-20T13:56:30.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c08f3f0 con 0x7eff8c0a04a0 2020-11-20T13:56:30.367 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff88ff9700 1 -- 172.21.15.39:0/2422757379 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff84007c60 con 0x7eff8c0a04a0 2020-11-20T13:56:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.353+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c13f0d0 con 0x7eff8c0a04a0 2020-11-20T13:56:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.354+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c057050 con 0x7eff8c0a04a0 2020-11-20T13:56:30.368 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.354+0000 7eff88ff9700 1 -- 172.21.15.39:0/2422757379 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7eff84011410 con 0x7eff8c0a04a0 2020-11-20T13:56:30.369 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.354+0000 7eff88ff9700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7eff700511d0 0x7eff70053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.369 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.354+0000 7eff88ff9700 1 -- 172.21.15.39:0/2422757379 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7eff840690d0 con 0x7eff8c0a04a0 2020-11-20T13:56:30.369 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.355+0000 7eff8affd700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7eff700511d0 0x7eff70053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.370 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.355+0000 7eff8affd700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7eff700511d0 0x7eff70053690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7eff74008000 tx=0x7eff74009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.370 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.358+0000 7eff88ff9700 1 -- 172.21.15.39:0/2422757379 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7eff84041430 con 0x7eff8c0a04a0 2020-11-20T13:56:30.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.516+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7eff8c13f3e0 con 0x7eff8c0a04a0 2020-11-20T13:56:30.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.517+0000 7eff88ff9700 1 -- 172.21.15.39:0/2422757379 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff84044a50 con 0x7eff8c0a04a0 2020-11-20T13:56:30.518 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:30.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7eff700511d0 msgr2=0x7eff70053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7eff700511d0 0x7eff70053690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7eff74008000 tx=0x7eff74009040).stop 2020-11-20T13:56:30.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c0a04a0 msgr2=0x7eff8c08fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c0a04a0 0x7eff8c08fb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7eff8c13d780 tx=0x7eff84008040).stop 2020-11-20T13:56:30.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 shutdown_connections 2020-11-20T13:56:30.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7eff700511d0 0x7eff70053690 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff8c0a04a0 0x7eff8c08fb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff8c13df10 0x7eff8c13c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 --2- 172.21.15.39:0/2422757379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff8c0a74e0 0x7eff8c090020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 >> 172.21.15.39:0/2422757379 conn(0x7eff8c0ab870 msgr2=0x7eff8c0a6410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:30.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 shutdown_connections 2020-11-20T13:56:30.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.518+0000 7eff920e7700 1 -- 172.21.15.39:0/2422757379 wait complete. 2020-11-20T13:56:30.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2020-11-20T13:56:30.530 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-11-20T13:56:30.646 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.644+0000 7f0b71473700 1 Processor -- start 2020-11-20T13:56:30.647 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.644+0000 7f0b71473700 1 -- start start 2020-11-20T13:56:30.647 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b71473700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0b6c05c8c0 0x7f0b6c0a2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.647 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b71473700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c09b970 0x7f0b6c0a6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.647 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b71473700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c0a5270 con 0x7f0b6c0a3c80 2020-11-20T13:56:30.648 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b71473700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c09be20 con 0x7f0b6c05c8c0 2020-11-20T13:56:30.648 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b71473700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0a54a0 con 0x7f0b6c09b970 2020-11-20T13:56:30.648 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c09b970 0x7f0b6c0a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.648 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0b6c05c8c0 0x7f0b6c0a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0b6c05c8c0 0x7f0b6c0a2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.39:45258/0 (socket says 172.21.15.39:45258) 2020-11-20T13:56:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c09b970 0x7f0b6c0a6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.39:56002/0 (socket says 172.21.15.39:56002) 2020-11-20T13:56:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6affd700 1 -- 172.21.15.39:0/3250809531 learned_addr learned my addr 172.21.15.39:0/3250809531 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6b7fe700 1 -- 172.21.15.39:0/3250809531 >> v2:172.21.15.31:3300/0 conn(0x7f0b6c05c8c0 msgr2=0x7f0b6c0a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6b7fe700 1 --2- 172.21.15.39:0/3250809531 >> v2:172.21.15.31:3300/0 conn(0x7f0b6c05c8c0 0x7f0b6c0a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6b7fe700 1 -- 172.21.15.39:0/3250809531 >> v1:172.21.15.31:6789/0 conn(0x7f0b6c0a3c80 legacy=0x7f0b6c0a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6b7fe700 1 -- 172.21.15.39:0/3250809531 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0a4190 con 0x7f0b6c09b970 2020-11-20T13:56:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.645+0000 7f0b6affd700 1 --2- 172.21.15.39:0/3250809531 >> v2:172.21.15.31:3300/0 conn(0x7f0b6c05c8c0 0x7f0b6c0a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b6b7fe700 1 --2- 172.21.15.39:0/3250809531 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c09b970 0x7f0b6c0a6690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0b640032b0 tx=0x7f0b6400b460).ready entity=mon.2 client_cookie=5b0767631a0d313c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b69ffb700 1 -- 172.21.15.39:0/3250809531 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b64010660 con 0x7f0b6c09b970 2020-11-20T13:56:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b69ffb700 1 -- 172.21.15.39:0/3250809531 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b640107c0 con 0x7f0b6c09b970 2020-11-20T13:56:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b69ffb700 1 -- 172.21.15.39:0/3250809531 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b64010b20 con 0x7f0b6c09b970 2020-11-20T13:56:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b71473700 1 -- 172.21.15.39:0/3250809531 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c09b970 msgr2=0x7f0b6c0a6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b71473700 1 --2- 172.21.15.39:0/3250809531 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c09b970 0x7f0b6c0a6690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0b640032b0 tx=0x7f0b6400b460).stop 2020-11-20T13:56:30.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b71473700 1 -- 172.21.15.39:0/3250809531 shutdown_connections 2020-11-20T13:56:30.654 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b71473700 1 --2- 172.21.15.39:0/3250809531 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c09b970 0x7f0b6c0a6690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b71473700 1 --2- 172.21.15.39:0/3250809531 >> v2:172.21.15.31:3300/0 conn(0x7f0b6c05c8c0 0x7f0b6c0a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.655 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b71473700 1 -- 172.21.15.39:0/3250809531 >> 172.21.15.39:0/3250809531 conn(0x7f0b6c0ab870 msgr2=0x7f0b6c0abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:30.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b71473700 1 -- 172.21.15.39:0/3250809531 shutdown_connections 2020-11-20T13:56:30.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.646+0000 7f0b71473700 1 -- 172.21.15.39:0/3250809531 wait complete. 2020-11-20T13:56:30.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.647+0000 7f0b71473700 1 Processor -- start 2020-11-20T13:56:30.656 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.647+0000 7f0b71473700 1 -- start start 2020-11-20T13:56:30.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b71473700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c05c8c0 0x7f0b6c1385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b71473700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b6c09b970 0x7f0b6c1323a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b71473700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b6c0a3c80 0x7f0b6c132890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b71473700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1427a0 con 0x7f0b6c0a3c80 2020-11-20T13:56:30.657 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b71473700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c066800 con 0x7f0b6c09b970 2020-11-20T13:56:30.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b71473700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c066aa0 con 0x7f0b6c05c8c0 2020-11-20T13:56:30.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6a7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b6c09b970 0x7f0b6c1323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6a7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b6c09b970 0x7f0b6c1323a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45550/0 (socket says 172.21.15.39:45550) 2020-11-20T13:56:30.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6a7fc700 1 -- 172.21.15.39:0/2842366125 learned_addr learned my addr 172.21.15.39:0/2842366125 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:30.658 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6affd700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c05c8c0 0x7f0b6c1385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6b7fe700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b6c0a3c80 0x7f0b6c132890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6a7fc700 1 -- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c05c8c0 msgr2=0x7f0b6c1385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6a7fc700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c05c8c0 0x7f0b6c1385e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.659 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6a7fc700 1 -- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b6c0a3c80 msgr2=0x7f0b6c132890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6a7fc700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b6c0a3c80 0x7f0b6c132890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6a7fc700 1 -- 172.21.15.39:0/2842366125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c066d40 con 0x7f0b6c09b970 2020-11-20T13:56:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.648+0000 7f0b6a7fc700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b6c09b970 0x7f0b6c1323a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0b6c05d230 tx=0x7f0b5c007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.649+0000 7f0b5bfff700 1 -- 172.21.15.39:0/2842366125 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5c007030 con 0x7f0b6c09b970 2020-11-20T13:56:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.649+0000 7f0b5bfff700 1 -- 172.21.15.39:0/2842366125 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c007190 con 0x7f0b6c09b970 2020-11-20T13:56:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.649+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c066480 con 0x7f0b6c09b970 2020-11-20T13:56:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.649+0000 7f0b5bfff700 1 -- 172.21.15.39:0/2842366125 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5c0064e0 con 0x7f0b6c09b970 2020-11-20T13:56:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.649+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c1348d0 con 0x7f0b6c09b970 2020-11-20T13:56:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.650+0000 7f0b5bfff700 1 -- 172.21.15.39:0/2842366125 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f0b5c010070 con 0x7f0b6c09b970 2020-11-20T13:56:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.650+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c057050 con 0x7f0b6c09b970 2020-11-20T13:56:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.650+0000 7f0b5bfff700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0b48051270 0x7f0b48053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.650+0000 7f0b5bfff700 1 -- 172.21.15.39:0/2842366125 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b5c068860 con 0x7f0b6c09b970 2020-11-20T13:56:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.651+0000 7f0b6affd700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0b48051270 0x7f0b48053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.651+0000 7f0b6affd700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0b48051270 0x7f0b48053730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0b60008000 tx=0x7f0b60008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.663 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.654+0000 7f0b5bfff700 1 -- 172.21.15.39:0/2842366125 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f0b5c040a90 con 0x7f0b6c09b970 2020-11-20T13:56:30.815 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.814+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0b6c066660 con 0x7f0b6c09b970 2020-11-20T13:56:30.815 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.814+0000 7f0b5bfff700 1 -- 172.21.15.39:0/2842366125 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b6c066660 con 0x7f0b6c09b970 2020-11-20T13:56:30.815 INFO:teuthology.orchestra.run.smithi039.stdout:55834574854 2020-11-20T13:56:30.816 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.815+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0b48051270 msgr2=0x7f0b48053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.817 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0b48051270 0x7f0b48053730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0b60008000 tx=0x7f0b60008040).stop 2020-11-20T13:56:30.817 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b6c09b970 msgr2=0x7f0b6c1323a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.817 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b6c09b970 0x7f0b6c1323a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0b6c05d230 tx=0x7f0b5c007be0).stop 2020-11-20T13:56:30.818 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 shutdown_connections 2020-11-20T13:56:30.818 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0b48051270 0x7f0b48053730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.818 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b6c0a3c80 0x7f0b6c132890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.818 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0b6c05c8c0 0x7f0b6c1385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.818 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 --2- 172.21.15.39:0/2842366125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b6c09b970 0x7f0b6c1323a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 >> 172.21.15.39:0/2842366125 conn(0x7f0b6c0ab870 msgr2=0x7f0b6c0a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:30.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 shutdown_connections 2020-11-20T13:56:30.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.816+0000 7f0b71473700 1 -- 172.21.15.39:0/2842366125 wait complete. 2020-11-20T13:56:30.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2020-11-20T13:56:30.832 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-20T13:56:30.833 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-20T13:56:30.947 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.946+0000 7ff21348d700 1 Processor -- start 2020-11-20T13:56:30.947 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.946+0000 7ff21348d700 1 -- start start 2020-11-20T13:56:30.950 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff21348d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c13ef80 0x7ff20c141370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.950 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff21348d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c0a2d10 con 0x7ff20c05ce20 2020-11-20T13:56:30.950 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff21348d700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c0a5090 con 0x7ff20c09f5f0 2020-11-20T13:56:30.950 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff21348d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0a5330 con 0x7ff20c13ef80 2020-11-20T13:56:30.951 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff210a28700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff20c09f5f0 0x7ff20c0a1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35730/0 (socket says 172.21.15.39:35730) 2020-11-20T13:56:30.951 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff210a28700 1 -- 172.21.15.39:0/3831049911 learned_addr learned my addr 172.21.15.39:0/3831049911 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:30.951 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff211a2a700 1 --2- 172.21.15.39:0/3831049911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c13ef80 0x7ff20c141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.952 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff1fbfff700 1 -- 172.21.15.39:0/3831049911 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358720223 0 0) 0x7ff20c0a5090 con 0x7ff20c09f5f0 2020-11-20T13:56:30.952 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff1fbfff700 1 -- 172.21.15.39:0/3831049911 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f4003230 con 0x7ff20c09f5f0 2020-11-20T13:56:30.952 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff1fbfff700 1 -- 172.21.15.39:0/3831049911 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259570097 0 0) 0x7ff20c0a2d10 con 0x7ff20c05ce20 2020-11-20T13:56:30.952 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff1fbfff700 1 -- 172.21.15.39:0/3831049911 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff20c0a5090 con 0x7ff20c05ce20 2020-11-20T13:56:30.953 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff1fbfff700 1 -- 172.21.15.39:0/3831049911 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2316930127 0 0) 0x7ff1f4003230 con 0x7ff20c09f5f0 2020-11-20T13:56:30.953 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff211a2a700 1 -- 172.21.15.39:0/3831049911 >> v1:172.21.15.39:6789/0 conn(0x7ff20c09f5f0 legacy=0x7ff20c0a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.953 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff211a2a700 1 -- 172.21.15.39:0/3831049911 >> v1:172.21.15.31:6789/0 conn(0x7ff20c05ce20 legacy=0x7ff20c0a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.953 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff211a2a700 1 -- 172.21.15.39:0/3831049911 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0a2f40 con 0x7ff20c13ef80 2020-11-20T13:56:30.953 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.947+0000 7ff211a2a700 1 --2- 172.21.15.39:0/3831049911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c13ef80 0x7ff20c141370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff2080010d0 tx=0x7ff2040091a0).ready entity=mon.2 client_cookie=e90c3ea5219c4be1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff1fbfff700 1 -- 172.21.15.39:0/3831049911 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2080016d0 con 0x7ff20c13ef80 2020-11-20T13:56:30.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff1fbfff700 1 -- 172.21.15.39:0/3831049911 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20400b880 con 0x7ff20c13ef80 2020-11-20T13:56:30.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff1fbfff700 1 -- 172.21.15.39:0/3831049911 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20400b9f0 con 0x7ff20c13ef80 2020-11-20T13:56:30.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff21348d700 1 -- 172.21.15.39:0/3831049911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c13ef80 msgr2=0x7ff20c141370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.954 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff21348d700 1 --2- 172.21.15.39:0/3831049911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c13ef80 0x7ff20c141370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff2080010d0 tx=0x7ff2040091a0).stop 2020-11-20T13:56:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff21348d700 1 -- 172.21.15.39:0/3831049911 shutdown_connections 2020-11-20T13:56:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff21348d700 1 --2- 172.21.15.39:0/3831049911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c13ef80 0x7ff20c141370 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff21348d700 1 -- 172.21.15.39:0/3831049911 >> 172.21.15.39:0/3831049911 conn(0x7ff20c0ac1e0 msgr2=0x7ff20c0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff21348d700 1 -- 172.21.15.39:0/3831049911 shutdown_connections 2020-11-20T13:56:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.948+0000 7ff21348d700 1 -- 172.21.15.39:0/3831049911 wait complete. 2020-11-20T13:56:30.956 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.949+0000 7ff21348d700 1 Processor -- start 2020-11-20T13:56:30.956 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.949+0000 7ff21348d700 1 -- start start 2020-11-20T13:56:30.959 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff21348d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c05ce20 0x7ff20c062f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.959 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff21348d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c09f5f0 0x7ff20c1381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.959 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff21348d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c13ef80 0x7ff20c1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.959 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff21348d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0628f0 con 0x7ff20c09f5f0 2020-11-20T13:56:30.960 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff21348d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c062b20 con 0x7ff20c13ef80 2020-11-20T13:56:30.960 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff21348d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c13d500 con 0x7ff20c05ce20 2020-11-20T13:56:30.960 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211a2a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c13ef80 0x7ff20c1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.960 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211a2a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c13ef80 0x7ff20c1386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45564/0 (socket says 172.21.15.39:45564) 2020-11-20T13:56:30.960 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211a2a700 1 -- 172.21.15.39:0/599458270 learned_addr learned my addr 172.21.15.39:0/599458270 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:30.961 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211229700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c05ce20 0x7ff20c062f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.961 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff210a28700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c09f5f0 0x7ff20c1381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.961 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211a2a700 1 -- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c05ce20 msgr2=0x7ff20c062f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.961 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211a2a700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c05ce20 0x7ff20c062f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.961 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211a2a700 1 -- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c09f5f0 msgr2=0x7ff20c1381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:30.962 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211a2a700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c09f5f0 0x7ff20c1381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:30.962 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211a2a700 1 -- 172.21.15.39:0/599458270 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c13d7a0 con 0x7ff20c13ef80 2020-11-20T13:56:30.962 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff210a28700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c09f5f0 0x7ff20c1381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:30.963 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff211a2a700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c13ef80 0x7ff20c1386e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7ff20c13ee50 tx=0x7ff204016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.963 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff1fa7fc700 1 -- 172.21.15.39:0/599458270 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff204011c80 con 0x7ff20c13ef80 2020-11-20T13:56:30.963 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff1fa7fc700 1 -- 172.21.15.39:0/599458270 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204011de0 con 0x7ff20c13ef80 2020-11-20T13:56:30.963 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c067990 con 0x7ff20c13ef80 2020-11-20T13:56:30.963 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.950+0000 7ff1fa7fc700 1 -- 172.21.15.39:0/599458270 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2040205e0 con 0x7ff20c13ef80 2020-11-20T13:56:30.964 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.951+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c13e280 con 0x7ff20c13ef80 2020-11-20T13:56:30.964 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.952+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c0a78d0 con 0x7ff20c13ef80 2020-11-20T13:56:30.964 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.952+0000 7ff1fa7fc700 1 -- 172.21.15.39:0/599458270 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7ff20401e070 con 0x7ff20c13ef80 2020-11-20T13:56:30.964 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.952+0000 7ff1fa7fc700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1ec0511d0 0x7ff1ec053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:30.964 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.952+0000 7ff1fa7fc700 1 -- 172.21.15.39:0/599458270 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff204069b20 con 0x7ff20c13ef80 2020-11-20T13:56:30.965 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.952+0000 7ff211229700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1ec0511d0 0x7ff1ec053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:30.965 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.952+0000 7ff211229700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1ec0511d0 0x7ff1ec053690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff1fc00d000 tx=0x7ff1fc007960).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:30.965 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:30.955+0000 7ff1fa7fc700 1 -- 172.21.15.39:0/599458270 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7ff204045870 con 0x7ff20c13ef80 2020-11-20T13:56:31.114 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.113+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 --> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff20c0a25f0 con 0x7ff1ec0511d0 2020-11-20T13:56:31.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.117+0000 7ff1fa7fc700 1 -- 172.21.15.39:0/599458270 <== mgr.4104 v2:172.21.15.31:6800/21803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82261 (secure 0 0 0) 0x7ff20c0a25f0 con 0x7ff1ec0511d0 2020-11-20T13:56:31.118 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:31.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1ec0511d0 msgr2=0x7ff1ec053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1ec0511d0 0x7ff1ec053690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff1fc00d000 tx=0x7ff1fc007960).stop 2020-11-20T13:56:31.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c13ef80 msgr2=0x7ff20c1386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c13ef80 0x7ff20c1386e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7ff20c13ee50 tx=0x7ff204016000).stop 2020-11-20T13:56:31.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 shutdown_connections 2020-11-20T13:56:31.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff1ec0511d0 0x7ff1ec053690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c13ef80 0x7ff20c1386e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c05ce20 0x7ff20c062f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 --2- 172.21.15.39:0/599458270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c09f5f0 0x7ff20c1381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 >> 172.21.15.39:0/599458270 conn(0x7ff20c0ac1e0 msgr2=0x7ff20c0a9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:31.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 shutdown_connections 2020-11-20T13:56:31.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.118+0000 7ff21348d700 1 -- 172.21.15.39:0/599458270 wait complete. 2020-11-20T13:56:31.122 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2020-11-20T13:56:31.129 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2020-11-20T13:56:30.675811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6367512,"kb_used_data":743227680,"kb_used_omap":561,"kb_used_meta":0,"kb_avail":743227528,"statfs":{"total":767585320960,"available":761064988672,"internally_reserved":155648,"allocated":761065144320,"data_stored":761065144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":575001,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.940891"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.732932+0000","last_change":"2020-11-20T13:56:20.737394+0000","last_active":"2020-11-20T13:56:21.732932+0000","last_peered":"2020-11-20T13:56:21.732932+0000","last_clean":"2020-11-20T13:56:21.732932+0000","last_became_active":"2020-11-20T13:56:20.737061+0000","last_became_peered":"2020-11-20T13:56:20.737061+0000","last_unstale":"2020-11-20T13:56:21.732932+0000","last_undegraded":"2020-11-20T13:56:21.732932+0000","last_fullsized":"2020-11-20T13:56:21.732932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733006+0000","last_change":"2020-11-20T13:56:17.352632+0000","last_active":"2020-11-20T13:56:21.733006+0000","last_peered":"2020-11-20T13:56:21.733006+0000","last_clean":"2020-11-20T13:56:21.733006+0000","last_became_active":"2020-11-20T13:56:17.352223+0000","last_became_peered":"2020-11-20T13:56:17.352223+0000","last_unstale":"2020-11-20T13:56:21.733006+0000","last_undegraded":"2020-11-20T13:56:21.733006+0000","last_fullsized":"2020-11-20T13:56:21.733006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'6","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644090+0000","last_change":"2020-11-20T13:56:20.332636+0000","last_active":"2020-11-20T13:56:22.644090+0000","last_peered":"2020-11-20T13:56:22.644090+0000","last_clean":"2020-11-20T13:56:22.644090+0000","last_became_active":"2020-11-20T13:56:20.332329+0000","last_became_peered":"2020-11-20T13:56:20.332329+0000","last_unstale":"2020-11-20T13:56:22.644090+0000","last_undegraded":"2020-11-20T13:56:22.644090+0000","last_fullsized":"2020-11-20T13:56:22.644090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733044+0000","last_change":"2020-11-20T13:56:20.737490+0000","last_active":"2020-11-20T13:56:21.733044+0000","last_peered":"2020-11-20T13:56:21.733044+0000","last_clean":"2020-11-20T13:56:21.733044+0000","last_became_active":"2020-11-20T13:56:20.737148+0000","last_became_peered":"2020-11-20T13:56:20.737148+0000","last_unstale":"2020-11-20T13:56:21.733044+0000","last_undegraded":"2020-11-20T13:56:21.733044+0000","last_fullsized":"2020-11-20T13:56:21.733044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644146+0000","last_change":"2020-11-20T13:56:17.304765+0000","last_active":"2020-11-20T13:56:22.644146+0000","last_peered":"2020-11-20T13:56:22.644146+0000","last_clean":"2020-11-20T13:56:22.644146+0000","last_became_active":"2020-11-20T13:56:17.304320+0000","last_became_peered":"2020-11-20T13:56:17.304320+0000","last_unstale":"2020-11-20T13:56:22.644146+0000","last_undegraded":"2020-11-20T13:56:22.644146+0000","last_fullsized":"2020-11-20T13:56:22.644146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'5","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.335104+0000","last_change":"2020-11-20T13:56:20.332090+0000","last_active":"2020-11-20T13:56:22.335104+0000","last_peered":"2020-11-20T13:56:22.335104+0000","last_clean":"2020-11-20T13:56:22.335104+0000","last_became_active":"2020-11-20T13:56:20.331603+0000","last_became_peered":"2020-11-20T13:56:20.331603+0000","last_unstale":"2020-11-20T13:56:22.335104+0000","last_undegraded":"2020-11-20T13:56:22.335104+0000","last_fullsized":"2020-11-20T13:56:22.335104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733157+0000","last_change":"2020-11-20T13:56:20.736685+0000","last_active":"2020-11-20T13:56:21.733157+0000","last_peered":"2020-11-20T13:56:21.733157+0000","last_clean":"2020-11-20T13:56:21.733157+0000","last_became_active":"2020-11-20T13:56:20.736354+0000","last_became_peered":"2020-11-20T13:56:20.736354+0000","last_unstale":"2020-11-20T13:56:21.733157+0000","last_undegraded":"2020-11-20T13:56:21.733157+0000","last_fullsized":"2020-11-20T13:56:21.733157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.735554+0000","last_change":"2020-11-20T13:56:17.304888+0000","last_active":"2020-11-20T13:56:21.735554+0000","last_peered":"2020-11-20T13:56:21.735554+0000","last_clean":"2020-11-20T13:56:21.735554+0000","last_became_active":"2020-11-20T13:56:17.304437+0000","last_became_peered":"2020-11-20T13:56:17.304437+0000","last_unstale":"2020-11-20T13:56:21.735554+0000","last_undegraded":"2020-11-20T13:56:21.735554+0000","last_fullsized":"2020-11-20T13:56:21.735554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'8","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.732940+0000","last_change":"2020-11-20T13:56:20.330496+0000","last_active":"2020-11-20T13:56:21.732940+0000","last_peered":"2020-11-20T13:56:21.732940+0000","last_clean":"2020-11-20T13:56:21.732940+0000","last_became_active":"2020-11-20T13:56:20.330039+0000","last_became_peered":"2020-11-20T13:56:20.330039+0000","last_unstale":"2020-11-20T13:56:21.732940+0000","last_undegraded":"2020-11-20T13:56:21.732940+0000","last_fullsized":"2020-11-20T13:56:21.732940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.336923+0000","last_change":"2020-11-20T13:56:22.336620+0000","last_active":"2020-11-20T13:56:22.336923+0000","last_peered":"2020-11-20T13:56:22.336923+0000","last_clean":"2020-11-20T13:56:22.336923+0000","last_became_active":"2020-11-20T13:56:22.336226+0000","last_became_peered":"2020-11-20T13:56:22.336226+0000","last_unstale":"2020-11-20T13:56:22.336923+0000","last_undegraded":"2020-11-20T13:56:22.336923+0000","last_fullsized":"2020-11-20T13:56:22.336923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644132+0000","last_change":"2020-11-20T13:56:17.304522+0000","last_active":"2020-11-20T13:56:22.644132+0000","last_peered":"2020-11-20T13:56:22.644132+0000","last_clean":"2020-11-20T13:56:22.644132+0000","last_became_active":"2020-11-20T13:56:17.304130+0000","last_became_peered":"2020-11-20T13:56:17.304130+0000","last_unstale":"2020-11-20T13:56:22.644132+0000","last_undegraded":"2020-11-20T13:56:22.644132+0000","last_fullsized":"2020-11-20T13:56:22.644132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644150+0000","last_change":"2020-11-20T13:56:11.364828+0000","last_active":"2020-11-20T13:56:22.644150+0000","last_peered":"2020-11-20T13:56:22.644150+0000","last_clean":"2020-11-20T13:56:22.644150+0000","last_became_active":"2020-11-20T13:56:11.364431+0000","last_became_peered":"2020-11-20T13:56:11.364431+0000","last_unstale":"2020-11-20T13:56:22.644150+0000","last_undegraded":"2020-11-20T13:56:22.644150+0000","last_fullsized":"2020-11-20T13:56:22.644150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:05.341977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:05.341977+0000","last_clean_scrub_stamp":"2020-11-20T13:56:05.341977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.731442+0000","last_change":"2020-11-20T13:56:20.332101+0000","last_active":"2020-11-20T13:56:21.731442+0000","last_peered":"2020-11-20T13:56:21.731442+0000","last_clean":"2020-11-20T13:56:21.731442+0000","last_became_active":"2020-11-20T13:56:20.331694+0000","last_became_peered":"2020-11-20T13:56:20.331694+0000","last_unstale":"2020-11-20T13:56:21.731442+0000","last_undegraded":"2020-11-20T13:56:21.731442+0000","last_fullsized":"2020-11-20T13:56:21.731442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.417067+0000","last_change":"2020-11-20T13:56:20.729392+0000","last_active":"2020-11-20T13:56:22.417067+0000","last_peered":"2020-11-20T13:56:22.417067+0000","last_clean":"2020-11-20T13:56:22.417067+0000","last_became_active":"2020-11-20T13:56:20.729053+0000","last_became_peered":"2020-11-20T13:56:20.729053+0000","last_unstale":"2020-11-20T13:56:22.417067+0000","last_undegraded":"2020-11-20T13:56:22.417067+0000","last_fullsized":"2020-11-20T13:56:22.417067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644283+0000","last_change":"2020-11-20T13:56:17.300851+0000","last_active":"2020-11-20T13:56:22.644283+0000","last_peered":"2020-11-20T13:56:22.644283+0000","last_clean":"2020-11-20T13:56:22.644283+0000","last_became_active":"2020-11-20T13:56:17.300407+0000","last_became_peered":"2020-11-20T13:56:17.300407+0000","last_unstale":"2020-11-20T13:56:22.644283+0000","last_undegraded":"2020-11-20T13:56:22.644283+0000","last_fullsized":"2020-11-20T13:56:22.644283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.417006+0000","last_change":"2020-11-20T13:56:20.330436+0000","last_active":"2020-11-20T13:56:22.417006+0000","last_peered":"2020-11-20T13:56:22.417006+0000","last_clean":"2020-11-20T13:56:22.417006+0000","last_became_active":"2020-11-20T13:56:20.330053+0000","last_became_peered":"2020-11-20T13:56:20.330053+0000","last_unstale":"2020-11-20T13:56:22.417006+0000","last_undegraded":"2020-11-20T13:56:22.417006+0000","last_fullsized":"2020-11-20T13:56:22.417006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.417051+0000","last_change":"2020-11-20T13:56:20.737348+0000","last_active":"2020-11-20T13:56:22.417051+0000","last_peered":"2020-11-20T13:56:22.417051+0000","last_clean":"2020-11-20T13:56:22.417051+0000","last_became_active":"2020-11-20T13:56:20.737011+0000","last_became_peered":"2020-11-20T13:56:20.737011+0000","last_unstale":"2020-11-20T13:56:22.417051+0000","last_undegraded":"2020-11-20T13:56:22.417051+0000","last_fullsized":"2020-11-20T13:56:22.417051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644322+0000","last_change":"2020-11-20T13:56:17.352348+0000","last_active":"2020-11-20T13:56:22.644322+0000","last_peered":"2020-11-20T13:56:22.644322+0000","last_clean":"2020-11-20T13:56:22.644322+0000","last_became_active":"2020-11-20T13:56:17.351995+0000","last_became_peered":"2020-11-20T13:56:17.351995+0000","last_unstale":"2020-11-20T13:56:22.644322+0000","last_undegraded":"2020-11-20T13:56:22.644322+0000","last_fullsized":"2020-11-20T13:56:22.644322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"21'8","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733078+0000","last_change":"2020-11-20T13:56:20.335657+0000","last_active":"2020-11-20T13:56:21.733078+0000","last_peered":"2020-11-20T13:56:21.733078+0000","last_clean":"2020-11-20T13:56:21.733078+0000","last_became_active":"2020-11-20T13:56:20.335218+0000","last_became_peered":"2020-11-20T13:56:20.335218+0000","last_unstale":"2020-11-20T13:56:21.733078+0000","last_undegraded":"2020-11-20T13:56:21.733078+0000","last_fullsized":"2020-11-20T13:56:21.733078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.731435+0000","last_change":"2020-11-20T13:56:20.736118+0000","last_active":"2020-11-20T13:56:21.731435+0000","last_peered":"2020-11-20T13:56:21.731435+0000","last_clean":"2020-11-20T13:56:21.731435+0000","last_became_active":"2020-11-20T13:56:20.735368+0000","last_became_peered":"2020-11-20T13:56:20.735368+0000","last_unstale":"2020-11-20T13:56:21.731435+0000","last_undegraded":"2020-11-20T13:56:21.731435+0000","last_fullsized":"2020-11-20T13:56:21.731435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"21'7","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.731466+0000","last_change":"2020-11-20T13:56:20.335997+0000","last_active":"2020-11-20T13:56:21.731466+0000","last_peered":"2020-11-20T13:56:21.731466+0000","last_clean":"2020-11-20T13:56:21.731466+0000","last_became_active":"2020-11-20T13:56:20.335556+0000","last_became_peered":"2020-11-20T13:56:20.335556+0000","last_unstale":"2020-11-20T13:56:21.731466+0000","last_undegraded":"2020-11-20T13:56:21.731466+0000","last_fullsized":"2020-11-20T13:56:21.731466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733067+0000","last_change":"2020-11-20T13:56:17.299507+0000","last_active":"2020-11-20T13:56:21.733067+0000","last_peered":"2020-11-20T13:56:21.733067+0000","last_clean":"2020-11-20T13:56:21.733067+0000","last_became_active":"2020-11-20T13:56:17.299140+0000","last_became_peered":"2020-11-20T13:56:17.299140+0000","last_unstale":"2020-11-20T13:56:21.733067+0000","last_undegraded":"2020-11-20T13:56:21.733067+0000","last_fullsized":"2020-11-20T13:56:21.733067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.335087+0000","last_change":"2020-11-20T13:56:20.735322+0000","last_active":"2020-11-20T13:56:22.335087+0000","last_peered":"2020-11-20T13:56:22.335087+0000","last_clean":"2020-11-20T13:56:22.335087+0000","last_became_active":"2020-11-20T13:56:20.734881+0000","last_became_peered":"2020-11-20T13:56:20.734881+0000","last_unstale":"2020-11-20T13:56:22.335087+0000","last_undegraded":"2020-11-20T13:56:22.335087+0000","last_fullsized":"2020-11-20T13:56:22.335087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.737589+0000","last_change":"2020-11-20T13:56:17.300351+0000","last_active":"2020-11-20T13:56:21.737589+0000","last_peered":"2020-11-20T13:56:21.737589+0000","last_clean":"2020-11-20T13:56:21.737589+0000","last_became_active":"2020-11-20T13:56:17.299972+0000","last_became_peered":"2020-11-20T13:56:17.299972+0000","last_unstale":"2020-11-20T13:56:21.737589+0000","last_undegraded":"2020-11-20T13:56:21.737589+0000","last_fullsized":"2020-11-20T13:56:21.737589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'4","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.418422+0000","last_change":"2020-11-20T13:56:20.333241+0000","last_active":"2020-11-20T13:56:22.418422+0000","last_peered":"2020-11-20T13:56:22.418422+0000","last_clean":"2020-11-20T13:56:22.418422+0000","last_became_active":"2020-11-20T13:56:20.332321+0000","last_became_peered":"2020-11-20T13:56:20.332321+0000","last_unstale":"2020-11-20T13:56:22.418422+0000","last_undegraded":"2020-11-20T13:56:22.418422+0000","last_fullsized":"2020-11-20T13:56:22.418422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795960,"kb_used_data":92903440,"kb_used_omap":63,"kb_used_meta":0,"kb_avail":92903420,"statfs":{"total":95948165120,"available":95133102080,"internally_reserved":20480,"allocated":95133122560,"data_stored":95133122560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":64817,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795904,"kb_used_data":92903488,"kb_used_omap":46,"kb_used_meta":0,"kb_avail":92903476,"statfs":{"total":95948165120,"available":95133159424,"internally_reserved":12288,"allocated":95133171712,"data_stored":95133171712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47751,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795920,"kb_used_data":92903476,"kb_used_omap":102,"kb_used_meta":0,"kb_avail":92903460,"statfs":{"total":95948165120,"available":95133143040,"internally_reserved":16384,"allocated":95133159424,"data_stored":95133159424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104710,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795960,"kb_used_data":92903444,"kb_used_omap":81,"kb_used_meta":0,"kb_avail":92903420,"statfs":{"total":95948165120,"available":95133102080,"internally_reserved":24576,"allocated":95133126656,"data_stored":95133126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83427,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795916,"kb_used_data":92903476,"kb_used_omap":67,"kb_used_meta":0,"kb_avail":92903464,"statfs":{"total":95948165120,"available":95133147136,"internally_reserved":12288,"allocated":95133159424,"data_stored":95133159424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69625,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795920,"kb_used_data":92903472,"kb_used_omap":65,"kb_used_meta":0,"kb_avail":92903460,"statfs":{"total":95948165120,"available":95133143040,"internally_reserved":12288,"allocated":95133155328,"data_stored":95133155328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66788,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795972,"kb_used_data":92903444,"kb_used_omap":61,"kb_used_meta":0,"kb_avail":92903408,"statfs":{"total":95948165120,"available":95133089792,"internally_reserved":36864,"allocated":95133126656,"data_stored":95133126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62940,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.675}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795960,"kb_used_data":92903440,"kb_used_omap":73,"kb_used_meta":0,"kb_avail":92903420,"statfs":{"total":95948165120,"available":95133102080,"internally_reserved":20480,"allocated":95133122560,"data_stored":95133122560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74943,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]}]}]}} 2020-11-20T13:56:31.131 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-20T13:56:31.245 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.245+0000 7f424b82c700 1 Processor -- start 2020-11-20T13:56:31.246 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.245+0000 7f424b82c700 1 -- start start 2020-11-20T13:56:31.248 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.245+0000 7f424b82c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f424405ce20 0x7f42440a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.248 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.245+0000 7f424b82c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f424409f5f0 0x7f42440a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.248 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.245+0000 7f424b82c700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440a4e60 con 0x7f42440a2310 2020-11-20T13:56:31.249 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.245+0000 7f424b82c700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440a5090 con 0x7f424409f5f0 2020-11-20T13:56:31.249 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.245+0000 7f424b82c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440a5330 con 0x7f424405ce20 2020-11-20T13:56:31.249 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.245+0000 7f4248dc7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f424409f5f0 0x7f42440a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.249 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4249dc9700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f42440a2310 0x7f42440a5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35746/0 (socket says 172.21.15.39:35746) 2020-11-20T13:56:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4249dc9700 1 -- 172.21.15.39:0/3969291142 learned_addr learned my addr 172.21.15.39:0/3969291142 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f42495c8700 1 --2- 172.21.15.39:0/3969291142 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f424405ce20 0x7f42440a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4248dc7700 1 -- 172.21.15.39:0/3969291142 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f424405ce20 msgr2=0x7f42440a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4248dc7700 1 --2- 172.21.15.39:0/3969291142 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f424405ce20 0x7f42440a3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4248dc7700 1 -- 172.21.15.39:0/3969291142 >> v1:172.21.15.39:6789/0 conn(0x7f42440a2310 legacy=0x7f42440a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.251 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4233fff700 1 -- 172.21.15.39:0/3969291142 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128349658 0 0) 0x7f42440a4e60 con 0x7f42440a2310 2020-11-20T13:56:31.251 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4248dc7700 1 -- 172.21.15.39:0/3969291142 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440a2d10 con 0x7f424409f5f0 2020-11-20T13:56:31.251 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4248dc7700 1 --2- 172.21.15.39:0/3969291142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424409f5f0 0x7f42440a1e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f42400032b0 tx=0x7f424000a360).ready entity=mon.1 client_cookie=ad86b6451838be21 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:31.252 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4233fff700 1 -- 172.21.15.39:0/3969291142 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4240010410 con 0x7f424409f5f0 2020-11-20T13:56:31.252 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4233fff700 1 -- 172.21.15.39:0/3969291142 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4240010570 con 0x7f424409f5f0 2020-11-20T13:56:31.252 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f4233fff700 1 -- 172.21.15.39:0/3969291142 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42400108d0 con 0x7f424409f5f0 2020-11-20T13:56:31.252 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f424b82c700 1 -- 172.21.15.39:0/3969291142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424409f5f0 msgr2=0x7f42440a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.252 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.246+0000 7f424b82c700 1 --2- 172.21.15.39:0/3969291142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424409f5f0 0x7f42440a1e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f42400032b0 tx=0x7f424000a360).stop 2020-11-20T13:56:31.253 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.247+0000 7f424b82c700 1 -- 172.21.15.39:0/3969291142 shutdown_connections 2020-11-20T13:56:31.253 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.247+0000 7f424b82c700 1 --2- 172.21.15.39:0/3969291142 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f424405ce20 0x7f42440a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.253 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.247+0000 7f424b82c700 1 --2- 172.21.15.39:0/3969291142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424409f5f0 0x7f42440a1e20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.253 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.247+0000 7f424b82c700 1 -- 172.21.15.39:0/3969291142 >> 172.21.15.39:0/3969291142 conn(0x7f42440ac1e0 msgr2=0x7f42440a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:31.253 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.247+0000 7f424b82c700 1 -- 172.21.15.39:0/3969291142 shutdown_connections 2020-11-20T13:56:31.254 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.247+0000 7f424b82c700 1 -- 172.21.15.39:0/3969291142 wait complete. 2020-11-20T13:56:31.254 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f424b82c700 1 Processor -- start 2020-11-20T13:56:31.254 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f424b82c700 1 -- start start 2020-11-20T13:56:31.257 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f424b82c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424405ce20 0x7f4244140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.257 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f424b82c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424409f5f0 0x7f42440925e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.257 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f424b82c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42440a2310 0x7f4244146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.257 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f424b82c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244066b90 con 0x7f424409f5f0 2020-11-20T13:56:31.257 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f424b82c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244065120 con 0x7f424405ce20 2020-11-20T13:56:31.258 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f424b82c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440653c0 con 0x7f42440a2310 2020-11-20T13:56:31.258 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f42495c8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424405ce20 0x7f4244140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.258 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f42495c8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424405ce20 0x7f4244140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45576/0 (socket says 172.21.15.39:45576) 2020-11-20T13:56:31.258 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f42495c8700 1 -- 172.21.15.39:0/364079062 learned_addr learned my addr 172.21.15.39:0/364079062 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:31.259 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f4248dc7700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424409f5f0 0x7f42440925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.259 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.248+0000 7f4249dc9700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42440a2310 0x7f4244146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.259 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f42495c8700 1 -- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42440a2310 msgr2=0x7f4244146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.259 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f42495c8700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42440a2310 0x7f4244146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.259 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f42495c8700 1 -- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424409f5f0 msgr2=0x7f42440925e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.260 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f42495c8700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424409f5f0 0x7f42440925e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.260 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f42495c8700 1 -- 172.21.15.39:0/364079062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244092ad0 con 0x7f424405ce20 2020-11-20T13:56:31.260 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f42495c8700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424405ce20 0x7f4244140170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4234003070 tx=0x7f4234008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:31.260 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f42327fc700 1 -- 172.21.15.39:0/364079062 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4234009790 con 0x7f424405ce20 2020-11-20T13:56:31.260 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f42327fc700 1 -- 172.21.15.39:0/364079062 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42340098f0 con 0x7f424405ce20 2020-11-20T13:56:31.261 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4244146800 con 0x7f424405ce20 2020-11-20T13:56:31.261 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f42327fc700 1 -- 172.21.15.39:0/364079062 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4234009c50 con 0x7f424405ce20 2020-11-20T13:56:31.261 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.249+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4244065860 con 0x7f424405ce20 2020-11-20T13:56:31.262 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.250+0000 7f42327fc700 1 -- 172.21.15.39:0/364079062 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f4234013480 con 0x7f424405ce20 2020-11-20T13:56:31.262 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.250+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4244065580 con 0x7f424405ce20 2020-11-20T13:56:31.262 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.250+0000 7f42327fc700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4224051270 0x7f4224053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.262 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.250+0000 7f42327fc700 1 -- 172.21.15.39:0/364079062 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4234069510 con 0x7f424405ce20 2020-11-20T13:56:31.263 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.250+0000 7f4248dc7700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4224051270 0x7f4224053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.263 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.251+0000 7f4248dc7700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4224051270 0x7f4224053730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f424001a000 tx=0x7f424000a360).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:31.263 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.254+0000 7f42327fc700 1 -- 172.21.15.39:0/364079062 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f4234041870 con 0x7f424405ce20 2020-11-20T13:56:31.410 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.409+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 --> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4244146cc0 con 0x7f4224051270 2020-11-20T13:56:31.413 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.412+0000 7f42327fc700 1 -- 172.21.15.39:0/364079062 <== mgr.4104 v2:172.21.15.31:6800/21803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82261 (secure 0 0 0) 0x7f4244146cc0 con 0x7f4224051270 2020-11-20T13:56:31.415 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:31.416 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4224051270 msgr2=0x7f4224053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.416 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4224051270 0x7f4224053730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f424001a000 tx=0x7f424000a360).stop 2020-11-20T13:56:31.416 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424405ce20 msgr2=0x7f4244140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.416 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424405ce20 0x7f4244140170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4234003070 tx=0x7f4234008040).stop 2020-11-20T13:56:31.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 shutdown_connections 2020-11-20T13:56:31.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f4224051270 0x7f4224053730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424405ce20 0x7f4244140170 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42440a2310 0x7f4244146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 --2- 172.21.15.39:0/364079062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424409f5f0 0x7f42440925e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 >> 172.21.15.39:0/364079062 conn(0x7f42440ac1e0 msgr2=0x7f42440a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:31.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 shutdown_connections 2020-11-20T13:56:31.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.414+0000 7f424b82c700 1 -- 172.21.15.39:0/364079062 wait complete. 2020-11-20T13:56:31.419 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2020-11-20T13:56:31.425 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2020-11-20T13:56:30.675811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6367512,"kb_used_data":743227680,"kb_used_omap":561,"kb_used_meta":0,"kb_avail":743227528,"statfs":{"total":767585320960,"available":761064988672,"internally_reserved":155648,"allocated":761065144320,"data_stored":761065144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":575001,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.940891"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.732932+0000","last_change":"2020-11-20T13:56:20.737394+0000","last_active":"2020-11-20T13:56:21.732932+0000","last_peered":"2020-11-20T13:56:21.732932+0000","last_clean":"2020-11-20T13:56:21.732932+0000","last_became_active":"2020-11-20T13:56:20.737061+0000","last_became_peered":"2020-11-20T13:56:20.737061+0000","last_unstale":"2020-11-20T13:56:21.732932+0000","last_undegraded":"2020-11-20T13:56:21.732932+0000","last_fullsized":"2020-11-20T13:56:21.732932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733006+0000","last_change":"2020-11-20T13:56:17.352632+0000","last_active":"2020-11-20T13:56:21.733006+0000","last_peered":"2020-11-20T13:56:21.733006+0000","last_clean":"2020-11-20T13:56:21.733006+0000","last_became_active":"2020-11-20T13:56:17.352223+0000","last_became_peered":"2020-11-20T13:56:17.352223+0000","last_unstale":"2020-11-20T13:56:21.733006+0000","last_undegraded":"2020-11-20T13:56:21.733006+0000","last_fullsized":"2020-11-20T13:56:21.733006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'6","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644090+0000","last_change":"2020-11-20T13:56:20.332636+0000","last_active":"2020-11-20T13:56:22.644090+0000","last_peered":"2020-11-20T13:56:22.644090+0000","last_clean":"2020-11-20T13:56:22.644090+0000","last_became_active":"2020-11-20T13:56:20.332329+0000","last_became_peered":"2020-11-20T13:56:20.332329+0000","last_unstale":"2020-11-20T13:56:22.644090+0000","last_undegraded":"2020-11-20T13:56:22.644090+0000","last_fullsized":"2020-11-20T13:56:22.644090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733044+0000","last_change":"2020-11-20T13:56:20.737490+0000","last_active":"2020-11-20T13:56:21.733044+0000","last_peered":"2020-11-20T13:56:21.733044+0000","last_clean":"2020-11-20T13:56:21.733044+0000","last_became_active":"2020-11-20T13:56:20.737148+0000","last_became_peered":"2020-11-20T13:56:20.737148+0000","last_unstale":"2020-11-20T13:56:21.733044+0000","last_undegraded":"2020-11-20T13:56:21.733044+0000","last_fullsized":"2020-11-20T13:56:21.733044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644146+0000","last_change":"2020-11-20T13:56:17.304765+0000","last_active":"2020-11-20T13:56:22.644146+0000","last_peered":"2020-11-20T13:56:22.644146+0000","last_clean":"2020-11-20T13:56:22.644146+0000","last_became_active":"2020-11-20T13:56:17.304320+0000","last_became_peered":"2020-11-20T13:56:17.304320+0000","last_unstale":"2020-11-20T13:56:22.644146+0000","last_undegraded":"2020-11-20T13:56:22.644146+0000","last_fullsized":"2020-11-20T13:56:22.644146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'5","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.335104+0000","last_change":"2020-11-20T13:56:20.332090+0000","last_active":"2020-11-20T13:56:22.335104+0000","last_peered":"2020-11-20T13:56:22.335104+0000","last_clean":"2020-11-20T13:56:22.335104+0000","last_became_active":"2020-11-20T13:56:20.331603+0000","last_became_peered":"2020-11-20T13:56:20.331603+0000","last_unstale":"2020-11-20T13:56:22.335104+0000","last_undegraded":"2020-11-20T13:56:22.335104+0000","last_fullsized":"2020-11-20T13:56:22.335104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733157+0000","last_change":"2020-11-20T13:56:20.736685+0000","last_active":"2020-11-20T13:56:21.733157+0000","last_peered":"2020-11-20T13:56:21.733157+0000","last_clean":"2020-11-20T13:56:21.733157+0000","last_became_active":"2020-11-20T13:56:20.736354+0000","last_became_peered":"2020-11-20T13:56:20.736354+0000","last_unstale":"2020-11-20T13:56:21.733157+0000","last_undegraded":"2020-11-20T13:56:21.733157+0000","last_fullsized":"2020-11-20T13:56:21.733157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.735554+0000","last_change":"2020-11-20T13:56:17.304888+0000","last_active":"2020-11-20T13:56:21.735554+0000","last_peered":"2020-11-20T13:56:21.735554+0000","last_clean":"2020-11-20T13:56:21.735554+0000","last_became_active":"2020-11-20T13:56:17.304437+0000","last_became_peered":"2020-11-20T13:56:17.304437+0000","last_unstale":"2020-11-20T13:56:21.735554+0000","last_undegraded":"2020-11-20T13:56:21.735554+0000","last_fullsized":"2020-11-20T13:56:21.735554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'8","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.732940+0000","last_change":"2020-11-20T13:56:20.330496+0000","last_active":"2020-11-20T13:56:21.732940+0000","last_peered":"2020-11-20T13:56:21.732940+0000","last_clean":"2020-11-20T13:56:21.732940+0000","last_became_active":"2020-11-20T13:56:20.330039+0000","last_became_peered":"2020-11-20T13:56:20.330039+0000","last_unstale":"2020-11-20T13:56:21.732940+0000","last_undegraded":"2020-11-20T13:56:21.732940+0000","last_fullsized":"2020-11-20T13:56:21.732940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.336923+0000","last_change":"2020-11-20T13:56:22.336620+0000","last_active":"2020-11-20T13:56:22.336923+0000","last_peered":"2020-11-20T13:56:22.336923+0000","last_clean":"2020-11-20T13:56:22.336923+0000","last_became_active":"2020-11-20T13:56:22.336226+0000","last_became_peered":"2020-11-20T13:56:22.336226+0000","last_unstale":"2020-11-20T13:56:22.336923+0000","last_undegraded":"2020-11-20T13:56:22.336923+0000","last_fullsized":"2020-11-20T13:56:22.336923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644132+0000","last_change":"2020-11-20T13:56:17.304522+0000","last_active":"2020-11-20T13:56:22.644132+0000","last_peered":"2020-11-20T13:56:22.644132+0000","last_clean":"2020-11-20T13:56:22.644132+0000","last_became_active":"2020-11-20T13:56:17.304130+0000","last_became_peered":"2020-11-20T13:56:17.304130+0000","last_unstale":"2020-11-20T13:56:22.644132+0000","last_undegraded":"2020-11-20T13:56:22.644132+0000","last_fullsized":"2020-11-20T13:56:22.644132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644150+0000","last_change":"2020-11-20T13:56:11.364828+0000","last_active":"2020-11-20T13:56:22.644150+0000","last_peered":"2020-11-20T13:56:22.644150+0000","last_clean":"2020-11-20T13:56:22.644150+0000","last_became_active":"2020-11-20T13:56:11.364431+0000","last_became_peered":"2020-11-20T13:56:11.364431+0000","last_unstale":"2020-11-20T13:56:22.644150+0000","last_undegraded":"2020-11-20T13:56:22.644150+0000","last_fullsized":"2020-11-20T13:56:22.644150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:05.341977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:05.341977+0000","last_clean_scrub_stamp":"2020-11-20T13:56:05.341977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.731442+0000","last_change":"2020-11-20T13:56:20.332101+0000","last_active":"2020-11-20T13:56:21.731442+0000","last_peered":"2020-11-20T13:56:21.731442+0000","last_clean":"2020-11-20T13:56:21.731442+0000","last_became_active":"2020-11-20T13:56:20.331694+0000","last_became_peered":"2020-11-20T13:56:20.331694+0000","last_unstale":"2020-11-20T13:56:21.731442+0000","last_undegraded":"2020-11-20T13:56:21.731442+0000","last_fullsized":"2020-11-20T13:56:21.731442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.417067+0000","last_change":"2020-11-20T13:56:20.729392+0000","last_active":"2020-11-20T13:56:22.417067+0000","last_peered":"2020-11-20T13:56:22.417067+0000","last_clean":"2020-11-20T13:56:22.417067+0000","last_became_active":"2020-11-20T13:56:20.729053+0000","last_became_peered":"2020-11-20T13:56:20.729053+0000","last_unstale":"2020-11-20T13:56:22.417067+0000","last_undegraded":"2020-11-20T13:56:22.417067+0000","last_fullsized":"2020-11-20T13:56:22.417067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644283+0000","last_change":"2020-11-20T13:56:17.300851+0000","last_active":"2020-11-20T13:56:22.644283+0000","last_peered":"2020-11-20T13:56:22.644283+0000","last_clean":"2020-11-20T13:56:22.644283+0000","last_became_active":"2020-11-20T13:56:17.300407+0000","last_became_peered":"2020-11-20T13:56:17.300407+0000","last_unstale":"2020-11-20T13:56:22.644283+0000","last_undegraded":"2020-11-20T13:56:22.644283+0000","last_fullsized":"2020-11-20T13:56:22.644283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.417006+0000","last_change":"2020-11-20T13:56:20.330436+0000","last_active":"2020-11-20T13:56:22.417006+0000","last_peered":"2020-11-20T13:56:22.417006+0000","last_clean":"2020-11-20T13:56:22.417006+0000","last_became_active":"2020-11-20T13:56:20.330053+0000","last_became_peered":"2020-11-20T13:56:20.330053+0000","last_unstale":"2020-11-20T13:56:22.417006+0000","last_undegraded":"2020-11-20T13:56:22.417006+0000","last_fullsized":"2020-11-20T13:56:22.417006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.417051+0000","last_change":"2020-11-20T13:56:20.737348+0000","last_active":"2020-11-20T13:56:22.417051+0000","last_peered":"2020-11-20T13:56:22.417051+0000","last_clean":"2020-11-20T13:56:22.417051+0000","last_became_active":"2020-11-20T13:56:20.737011+0000","last_became_peered":"2020-11-20T13:56:20.737011+0000","last_unstale":"2020-11-20T13:56:22.417051+0000","last_undegraded":"2020-11-20T13:56:22.417051+0000","last_fullsized":"2020-11-20T13:56:22.417051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.644322+0000","last_change":"2020-11-20T13:56:17.352348+0000","last_active":"2020-11-20T13:56:22.644322+0000","last_peered":"2020-11-20T13:56:22.644322+0000","last_clean":"2020-11-20T13:56:22.644322+0000","last_became_active":"2020-11-20T13:56:17.351995+0000","last_became_peered":"2020-11-20T13:56:17.351995+0000","last_unstale":"2020-11-20T13:56:22.644322+0000","last_undegraded":"2020-11-20T13:56:22.644322+0000","last_fullsized":"2020-11-20T13:56:22.644322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"21'8","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733078+0000","last_change":"2020-11-20T13:56:20.335657+0000","last_active":"2020-11-20T13:56:21.733078+0000","last_peered":"2020-11-20T13:56:21.733078+0000","last_clean":"2020-11-20T13:56:21.733078+0000","last_became_active":"2020-11-20T13:56:20.335218+0000","last_became_peered":"2020-11-20T13:56:20.335218+0000","last_unstale":"2020-11-20T13:56:21.733078+0000","last_undegraded":"2020-11-20T13:56:21.733078+0000","last_fullsized":"2020-11-20T13:56:21.733078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.731435+0000","last_change":"2020-11-20T13:56:20.736118+0000","last_active":"2020-11-20T13:56:21.731435+0000","last_peered":"2020-11-20T13:56:21.731435+0000","last_clean":"2020-11-20T13:56:21.731435+0000","last_became_active":"2020-11-20T13:56:20.735368+0000","last_became_peered":"2020-11-20T13:56:20.735368+0000","last_unstale":"2020-11-20T13:56:21.731435+0000","last_undegraded":"2020-11-20T13:56:21.731435+0000","last_fullsized":"2020-11-20T13:56:21.731435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"21'7","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.731466+0000","last_change":"2020-11-20T13:56:20.335997+0000","last_active":"2020-11-20T13:56:21.731466+0000","last_peered":"2020-11-20T13:56:21.731466+0000","last_clean":"2020-11-20T13:56:21.731466+0000","last_became_active":"2020-11-20T13:56:20.335556+0000","last_became_peered":"2020-11-20T13:56:20.335556+0000","last_unstale":"2020-11-20T13:56:21.731466+0000","last_undegraded":"2020-11-20T13:56:21.731466+0000","last_fullsized":"2020-11-20T13:56:21.731466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.733067+0000","last_change":"2020-11-20T13:56:17.299507+0000","last_active":"2020-11-20T13:56:21.733067+0000","last_peered":"2020-11-20T13:56:21.733067+0000","last_clean":"2020-11-20T13:56:21.733067+0000","last_became_active":"2020-11-20T13:56:17.299140+0000","last_became_peered":"2020-11-20T13:56:17.299140+0000","last_unstale":"2020-11-20T13:56:21.733067+0000","last_undegraded":"2020-11-20T13:56:21.733067+0000","last_fullsized":"2020-11-20T13:56:21.733067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.335087+0000","last_change":"2020-11-20T13:56:20.735322+0000","last_active":"2020-11-20T13:56:22.335087+0000","last_peered":"2020-11-20T13:56:22.335087+0000","last_clean":"2020-11-20T13:56:22.335087+0000","last_became_active":"2020-11-20T13:56:20.734881+0000","last_became_peered":"2020-11-20T13:56:20.734881+0000","last_unstale":"2020-11-20T13:56:22.335087+0000","last_undegraded":"2020-11-20T13:56:22.335087+0000","last_fullsized":"2020-11-20T13:56:22.335087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:20.310855+0000","last_clean_scrub_stamp":"2020-11-20T13:56:20.310855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:21.737589+0000","last_change":"2020-11-20T13:56:17.300351+0000","last_active":"2020-11-20T13:56:21.737589+0000","last_peered":"2020-11-20T13:56:21.737589+0000","last_clean":"2020-11-20T13:56:21.737589+0000","last_became_active":"2020-11-20T13:56:17.299972+0000","last_became_peered":"2020-11-20T13:56:17.299972+0000","last_unstale":"2020-11-20T13:56:21.737589+0000","last_undegraded":"2020-11-20T13:56:21.737589+0000","last_fullsized":"2020-11-20T13:56:21.737589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:16.280029+0000","last_clean_scrub_stamp":"2020-11-20T13:56:16.280029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'4","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2020-11-20T13:56:22.418422+0000","last_change":"2020-11-20T13:56:20.333241+0000","last_active":"2020-11-20T13:56:22.418422+0000","last_peered":"2020-11-20T13:56:22.418422+0000","last_clean":"2020-11-20T13:56:22.418422+0000","last_became_active":"2020-11-20T13:56:20.332321+0000","last_became_peered":"2020-11-20T13:56:20.332321+0000","last_unstale":"2020-11-20T13:56:22.418422+0000","last_undegraded":"2020-11-20T13:56:22.418422+0000","last_fullsized":"2020-11-20T13:56:22.418422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T13:56:19.306207+0000","last_clean_scrub_stamp":"2020-11-20T13:56:19.306207+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795960,"kb_used_data":92903440,"kb_used_omap":63,"kb_used_meta":0,"kb_avail":92903420,"statfs":{"total":95948165120,"available":95133102080,"internally_reserved":20480,"allocated":95133122560,"data_stored":95133122560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":64817,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795904,"kb_used_data":92903488,"kb_used_omap":46,"kb_used_meta":0,"kb_avail":92903476,"statfs":{"total":95948165120,"available":95133159424,"internally_reserved":12288,"allocated":95133171712,"data_stored":95133171712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47751,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795920,"kb_used_data":92903476,"kb_used_omap":102,"kb_used_meta":0,"kb_avail":92903460,"statfs":{"total":95948165120,"available":95133143040,"internally_reserved":16384,"allocated":95133159424,"data_stored":95133159424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104710,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795960,"kb_used_data":92903444,"kb_used_omap":81,"kb_used_meta":0,"kb_avail":92903420,"statfs":{"total":95948165120,"available":95133102080,"internally_reserved":24576,"allocated":95133126656,"data_stored":95133126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83427,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795916,"kb_used_data":92903476,"kb_used_omap":67,"kb_used_meta":0,"kb_avail":92903464,"statfs":{"total":95948165120,"available":95133147136,"internally_reserved":12288,"allocated":95133159424,"data_stored":95133159424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69625,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795920,"kb_used_data":92903472,"kb_used_omap":65,"kb_used_meta":0,"kb_avail":92903460,"statfs":{"total":95948165120,"available":95133143040,"internally_reserved":12288,"allocated":95133155328,"data_stored":95133155328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66788,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795972,"kb_used_data":92903444,"kb_used_omap":61,"kb_used_meta":0,"kb_avail":92903408,"statfs":{"total":95948165120,"available":95133089792,"internally_reserved":36864,"allocated":95133126656,"data_stored":95133126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62940,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.675}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795960,"kb_used_data":92903440,"kb_used_omap":73,"kb_used_meta":0,"kb_avail":92903420,"statfs":{"total":95948165120,"available":95133102080,"internally_reserved":20480,"allocated":95133122560,"data_stored":95133122560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74943,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]}]}]}} 2020-11-20T13:56:31.428 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-20T13:56:31.429 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-20T13:56:31.429 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-20T13:56:31.429 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-11-20T13:56:31.544 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.543+0000 7f3ffe072700 1 Processor -- start 2020-11-20T13:56:31.544 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.543+0000 7f3ffe072700 1 -- start start 2020-11-20T13:56:31.547 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ffe072700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3ff80a8a80 0x7f3ff80a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.547 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ffe072700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3ff80a3190 0x7f3ff80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.548 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ffe072700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff80a3fa0 con 0x7f3ff80a4870 2020-11-20T13:56:31.548 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ffe072700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff80a0270 con 0x7f3ff80a3190 2020-11-20T13:56:31.548 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ffe072700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff80a59b0 con 0x7f3ff80a8a80 2020-11-20T13:56:31.548 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ff77fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3ff80a8a80 0x7f3ff80a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.549 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ff6ffd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3ff80a4870 0x7f3ff80a2a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35758/0 (socket says 172.21.15.39:35758) 2020-11-20T13:56:31.549 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ff6ffd700 1 -- 172.21.15.39:0/2108721320 learned_addr learned my addr 172.21.15.39:0/2108721320 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:31.549 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ff7fff700 1 --2- 172.21.15.39:0/2108721320 >> v2:172.21.15.31:3300/0 conn(0x7f3ff80a3190 0x7f3ff80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ff77fe700 1 -- 172.21.15.39:0/2108721320 >> v2:172.21.15.31:3300/0 conn(0x7f3ff80a3190 msgr2=0x7f3ff80a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ff77fe700 1 --2- 172.21.15.39:0/2108721320 >> v2:172.21.15.31:3300/0 conn(0x7f3ff80a3190 0x7f3ff80a35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ff77fe700 1 -- 172.21.15.39:0/2108721320 >> v1:172.21.15.39:6789/0 conn(0x7f3ff80a4870 legacy=0x7f3ff80a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ff67fc700 1 -- 172.21.15.39:0/2108721320 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263455448 0 0) 0x7f3ff80a3fa0 con 0x7f3ff80a4870 2020-11-20T13:56:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.544+0000 7f3ff77fe700 1 -- 172.21.15.39:0/2108721320 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80a41d0 con 0x7f3ff80a8a80 2020-11-20T13:56:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ff77fe700 1 --2- 172.21.15.39:0/2108721320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a8a80 0x7f3ff80a4380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3fe8002f30 tx=0x7f3fe8006dc0).ready entity=mon.1 client_cookie=19275566e612c03a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ff67fc700 1 -- 172.21.15.39:0/2108721320 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe80097f0 con 0x7f3ff80a8a80 2020-11-20T13:56:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ff67fc700 1 -- 172.21.15.39:0/2108721320 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8009950 con 0x7f3ff80a8a80 2020-11-20T13:56:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ff67fc700 1 -- 172.21.15.39:0/2108721320 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe8009cb0 con 0x7f3ff80a8a80 2020-11-20T13:56:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ffe072700 1 -- 172.21.15.39:0/2108721320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a8a80 msgr2=0x7f3ff80a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ffe072700 1 --2- 172.21.15.39:0/2108721320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a8a80 0x7f3ff80a4380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3fe8002f30 tx=0x7f3fe8006dc0).stop 2020-11-20T13:56:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ffe072700 1 -- 172.21.15.39:0/2108721320 shutdown_connections 2020-11-20T13:56:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ffe072700 1 --2- 172.21.15.39:0/2108721320 >> v2:172.21.15.31:3300/0 conn(0x7f3ff80a3190 0x7f3ff80a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ffe072700 1 --2- 172.21.15.39:0/2108721320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a8a80 0x7f3ff80a4380 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ffe072700 1 -- 172.21.15.39:0/2108721320 >> 172.21.15.39:0/2108721320 conn(0x7f3ff80ac1e0 msgr2=0x7f3ff80a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ffe072700 1 -- 172.21.15.39:0/2108721320 shutdown_connections 2020-11-20T13:56:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.545+0000 7f3ffe072700 1 -- 172.21.15.39:0/2108721320 wait complete. 2020-11-20T13:56:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.546+0000 7f3ffe072700 1 Processor -- start 2020-11-20T13:56:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.546+0000 7f3ffe072700 1 -- start start 2020-11-20T13:56:31.556 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ffe072700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a3190 0x7f3ff809cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.557 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ffe072700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ff80a4870 0x7f3ff8136440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.557 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ffe072700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ff80a8a80 0x7f3ff8136930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.557 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ffe072700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff809e320 con 0x7f3ff80a8a80 2020-11-20T13:56:31.557 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ffe072700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff809e080 con 0x7f3ff80a3190 2020-11-20T13:56:31.558 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ffe072700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80631e0 con 0x7f3ff80a4870 2020-11-20T13:56:31.558 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a3190 0x7f3ff809cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.558 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a3190 0x7f3ff809cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45590/0 (socket says 172.21.15.39:45590) 2020-11-20T13:56:31.558 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff77fe700 1 -- 172.21.15.39:0/3950642465 learned_addr learned my addr 172.21.15.39:0/3950642465 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:31.558 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff6ffd700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ff80a4870 0x7f3ff8136440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff7fff700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ff80a8a80 0x7f3ff8136930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff77fe700 1 -- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ff80a4870 msgr2=0x7f3ff8136440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff77fe700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ff80a4870 0x7f3ff8136440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff77fe700 1 -- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ff80a8a80 msgr2=0x7f3ff8136930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.559 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff77fe700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ff80a8a80 0x7f3ff8136930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.560 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff77fe700 1 -- 172.21.15.39:0/3950642465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff809d2e0 con 0x7f3ff80a3190 2020-11-20T13:56:31.560 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff6ffd700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ff80a4870 0x7f3ff8136440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:31.560 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.547+0000 7f3ff77fe700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a3190 0x7f3ff809cdf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f3fe8002f30 tx=0x7f3fe8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:31.560 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.548+0000 7f3ff4ff9700 1 -- 172.21.15.39:0/3950642465 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe8011cc0 con 0x7f3ff80a3190 2020-11-20T13:56:31.560 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.548+0000 7f3ff4ff9700 1 -- 172.21.15.39:0/3950642465 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8011e20 con 0x7f3ff80a3190 2020-11-20T13:56:31.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.548+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff805cc30 con 0x7f3ff80a3190 2020-11-20T13:56:31.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.548+0000 7f3ff4ff9700 1 -- 172.21.15.39:0/3950642465 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe801d640 con 0x7f3ff80a3190 2020-11-20T13:56:31.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.548+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff809dde0 con 0x7f3ff80a3190 2020-11-20T13:56:31.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.549+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff8057050 con 0x7f3ff80a3190 2020-11-20T13:56:31.561 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.549+0000 7f3ff4ff9700 1 -- 172.21.15.39:0/3950642465 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f3fe8024030 con 0x7f3ff80a3190 2020-11-20T13:56:31.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.549+0000 7f3ff4ff9700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3fd80511d0 0x7f3fd8053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.549+0000 7f3ff4ff9700 1 -- 172.21.15.39:0/3950642465 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3fe806a180 con 0x7f3ff80a3190 2020-11-20T13:56:31.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.549+0000 7f3ff6ffd700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3fd80511d0 0x7f3fd8053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.550+0000 7f3ff6ffd700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3fd80511d0 0x7f3fd8053690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3fec00b000 tx=0x7f3fec009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:31.562 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.553+0000 7f3ff4ff9700 1 -- 172.21.15.39:0/3950642465 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f3fe8042580 con 0x7f3ff80a3190 2020-11-20T13:56:31.776 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.775+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3ff80a56b0 con 0x7f3ff80a3190 2020-11-20T13:56:31.776 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.775+0000 7f3ff4ff9700 1 -- 172.21.15.39:0/3950642465 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f3fe8045b60 con 0x7f3ff80a3190 2020-11-20T13:56:31.777 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:31.778 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3fd80511d0 msgr2=0x7f3fd8053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.778 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3fd80511d0 0x7f3fd8053690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3fec00b000 tx=0x7f3fec009040).stop 2020-11-20T13:56:31.778 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a3190 msgr2=0x7f3ff809cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.779 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a3190 0x7f3ff809cdf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f3fe8002f30 tx=0x7f3fe8015000).stop 2020-11-20T13:56:31.779 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 shutdown_connections 2020-11-20T13:56:31.779 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3fd80511d0 0x7f3fd8053690 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.779 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ff80a3190 0x7f3ff809cdf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ff80a8a80 0x7f3ff8136930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 --2- 172.21.15.39:0/3950642465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ff80a4870 0x7f3ff8136440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 >> 172.21.15.39:0/3950642465 conn(0x7f3ff80ac1e0 msgr2=0x7f3ff8069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 shutdown_connections 2020-11-20T13:56:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.777+0000 7f3ffe072700 1 -- 172.21.15.39:0/3950642465 wait complete. 2020-11-20T13:56:31.789 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-20T13:56:31.789 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-20T13:56:31.791 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-20T13:56:31.904 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.904+0000 7f63d49d3700 1 Processor -- start 2020-11-20T13:56:31.905 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.904+0000 7f63d49d3700 1 -- start start 2020-11-20T13:56:31.907 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.904+0000 7f63d49d3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f63d00a8a80 0x7f63d00a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.907 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.904+0000 7f63d49d3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a3190 0x7f63d00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.907 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.904+0000 7f63d49d3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d00a3fa0 con 0x7f63d00a4870 2020-11-20T13:56:31.908 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.904+0000 7f63d49d3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00a0270 con 0x7f63d00a8a80 2020-11-20T13:56:31.909 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.904+0000 7f63d49d3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00a59b0 con 0x7f63d00a3190 2020-11-20T13:56:31.909 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ce59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f63d00a8a80 0x7f63d00a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.909 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ced9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a3190 0x7f63d00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.909 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ce59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f63d00a8a80 0x7f63d00a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.39:45314/0 (socket says 172.21.15.39:45314) 2020-11-20T13:56:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ced9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a3190 0x7f63d00a35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.39:56056/0 (socket says 172.21.15.39:56056) 2020-11-20T13:56:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ce59c700 1 -- 172.21.15.39:0/2364070676 learned_addr learned my addr 172.21.15.39:0/2364070676 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63cdd9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f63d00a4870 0x7f63d00a2a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.39:37428/0 (socket says 172.21.15.39:37428) 2020-11-20T13:56:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ce59c700 1 -- 172.21.15.39:0/2364070676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a3190 msgr2=0x7f63d00a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ce59c700 1 --2- 172.21.15.39:0/2364070676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a3190 0x7f63d00a35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ce59c700 1 -- 172.21.15.39:0/2364070676 >> v1:172.21.15.31:6789/0 conn(0x7f63d00a4870 legacy=0x7f63d00a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63cd59a700 1 -- 172.21.15.39:0/2364070676 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176097874 0 0) 0x7f63d00a3fa0 con 0x7f63d00a4870 2020-11-20T13:56:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ce59c700 1 -- 172.21.15.39:0/2364070676 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00a41d0 con 0x7f63d00a8a80 2020-11-20T13:56:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63ce59c700 1 --2- 172.21.15.39:0/2364070676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00a8a80 0x7f63d00a4380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f63c0002f30 tx=0x7f63c0006e80).ready entity=mon.0 client_cookie=5f3723953d2731fb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63cd59a700 1 -- 172.21.15.39:0/2364070676 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c00097f0 con 0x7f63d00a8a80 2020-11-20T13:56:31.912 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63cd59a700 1 -- 172.21.15.39:0/2364070676 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0009950 con 0x7f63d00a8a80 2020-11-20T13:56:31.912 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.905+0000 7f63cd59a700 1 -- 172.21.15.39:0/2364070676 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c0009cb0 con 0x7f63d00a8a80 2020-11-20T13:56:31.912 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.906+0000 7f63d49d3700 1 -- 172.21.15.39:0/2364070676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00a8a80 msgr2=0x7f63d00a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.912 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.906+0000 7f63d49d3700 1 --2- 172.21.15.39:0/2364070676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00a8a80 0x7f63d00a4380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f63c0002f30 tx=0x7f63c0006e80).stop 2020-11-20T13:56:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.906+0000 7f63d49d3700 1 -- 172.21.15.39:0/2364070676 shutdown_connections 2020-11-20T13:56:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.906+0000 7f63d49d3700 1 --2- 172.21.15.39:0/2364070676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a3190 0x7f63d00a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.906+0000 7f63d49d3700 1 --2- 172.21.15.39:0/2364070676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00a8a80 0x7f63d00a4380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.906+0000 7f63d49d3700 1 -- 172.21.15.39:0/2364070676 >> 172.21.15.39:0/2364070676 conn(0x7f63d00ac1e0 msgr2=0x7f63d00a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:31.914 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.906+0000 7f63d49d3700 1 -- 172.21.15.39:0/2364070676 shutdown_connections 2020-11-20T13:56:31.914 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.906+0000 7f63d49d3700 1 -- 172.21.15.39:0/2364070676 wait complete. 2020-11-20T13:56:31.916 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.907+0000 7f63d49d3700 1 Processor -- start 2020-11-20T13:56:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.907+0000 7f63d49d3700 1 -- start start 2020-11-20T13:56:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.907+0000 7f63d49d3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00a3190 0x7f63d009e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.907+0000 7f63d49d3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a4870 0x7f63d0135490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.918 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.907+0000 7f63d49d3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63d00a8a80 0x7f63d0135980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.918 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.907+0000 7f63d49d3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0138ed0 con 0x7f63d00a3190 2020-11-20T13:56:31.918 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.907+0000 7f63d49d3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d009d7b0 con 0x7f63d00a8a80 2020-11-20T13:56:31.918 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.907+0000 7f63d49d3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d009da50 con 0x7f63d00a4870 2020-11-20T13:56:31.918 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ced9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63d00a8a80 0x7f63d0135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ced9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63d00a8a80 0x7f63d0135980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45608/0 (socket says 172.21.15.39:45608) 2020-11-20T13:56:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ced9d700 1 -- 172.21.15.39:0/541886354 learned_addr learned my addr 172.21.15.39:0/541886354 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ce59c700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00a3190 0x7f63d009e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63cdd9b700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a4870 0x7f63d0135490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ced9d700 1 -- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a4870 msgr2=0x7f63d0135490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ced9d700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a4870 0x7f63d0135490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ced9d700 1 -- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00a3190 msgr2=0x7f63d009e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ced9d700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00a3190 0x7f63d009e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ced9d700 1 -- 172.21.15.39:0/541886354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d009dcf0 con 0x7f63d00a8a80 2020-11-20T13:56:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63ced9d700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63d00a8a80 0x7f63d0135980 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f63c8006dd0 tx=0x7f63c80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63bf7fe700 1 -- 172.21.15.39:0/541886354 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c800c950 con 0x7f63d00a8a80 2020-11-20T13:56:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63bf7fe700 1 -- 172.21.15.39:0/541886354 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c800cab0 con 0x7f63d00a8a80 2020-11-20T13:56:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d0138a30 con 0x7f63d00a8a80 2020-11-20T13:56:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63bf7fe700 1 -- 172.21.15.39:0/541886354 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c800ce10 con 0x7f63d00a8a80 2020-11-20T13:56:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.908+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d009e690 con 0x7f63d00a8a80 2020-11-20T13:56:31.922 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.909+0000 7f63bf7fe700 1 -- 172.21.15.39:0/541886354 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f63c8022070 con 0x7f63d00a8a80 2020-11-20T13:56:31.922 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.909+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d0137dc0 con 0x7f63d00a8a80 2020-11-20T13:56:31.922 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.910+0000 7f63bf7fe700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f63ac051270 0x7f63ac053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:31.922 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.910+0000 7f63bf7fe700 1 -- 172.21.15.39:0/541886354 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63c80695a0 con 0x7f63d00a8a80 2020-11-20T13:56:31.922 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.910+0000 7f63ce59c700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f63ac051270 0x7f63ac053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:31.923 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.910+0000 7f63ce59c700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f63ac051270 0x7f63ac053730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f63c001c000 tx=0x7f63c0015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:31.923 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:31.913+0000 7f63bf7fe700 1 -- 172.21.15.39:0/541886354 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f63c8041970 con 0x7f63d00a8a80 2020-11-20T13:56:32.074 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.073+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63d009de80 con 0x7f63d00a8a80 2020-11-20T13:56:32.075 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.074+0000 7f63bf7fe700 1 -- 172.21.15.39:0/541886354 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f63c8016020 con 0x7f63d00a8a80 2020-11-20T13:56:32.075 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:32.076 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":23,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:23.331627+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T13:56:15.768689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T13:56:18.856235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T13:56:19.656250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:32.077 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f63ac051270 msgr2=0x7f63ac053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.077 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f63ac051270 0x7f63ac053730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f63c001c000 tx=0x7f63c0015000).stop 2020-11-20T13:56:32.077 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63d00a8a80 msgr2=0x7f63d0135980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.077 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63d00a8a80 0x7f63d0135980 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f63c8006dd0 tx=0x7f63c80091a0).stop 2020-11-20T13:56:32.078 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 shutdown_connections 2020-11-20T13:56:32.078 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f63ac051270 0x7f63ac053730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.078 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63d00a8a80 0x7f63d0135980 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.078 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d00a3190 0x7f63d009e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.079 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 --2- 172.21.15.39:0/541886354 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63d00a4870 0x7f63d0135490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.079 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 >> 172.21.15.39:0/541886354 conn(0x7f63d00ac1e0 msgr2=0x7f63d00a6090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:32.079 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 shutdown_connections 2020-11-20T13:56:32.079 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.076+0000 7f63d49d3700 1 -- 172.21.15.39:0/541886354 wait complete. 2020-11-20T13:56:32.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T13:56:05.147084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T13:56:15.768689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T13:56:18.856235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T13:56:19.656250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T13:56:32.088 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-11-20T13:56:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.203+0000 7f53d317a700 1 Processor -- start 2020-11-20T13:56:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.203+0000 7f53d317a700 1 -- start start 2020-11-20T13:56:32.208 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.204+0000 7f53d317a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f53cc13fa70 0x7f53cc141e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.209 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.204+0000 7f53d317a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc0a3fa0 con 0x7f53cc0a8a80 2020-11-20T13:56:32.209 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.204+0000 7f53d317a700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc0a41d0 con 0x7f53cc13bf60 2020-11-20T13:56:32.209 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.204+0000 7f53d317a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0a02b0 con 0x7f53cc13fa70 2020-11-20T13:56:32.209 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.204+0000 7f53cbfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f53cc13bf60 0x7f53cc13e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35786/0 (socket says 172.21.15.39:35786) 2020-11-20T13:56:32.210 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.204+0000 7f53cbfff700 1 -- 172.21.15.39:0/4080781405 learned_addr learned my addr 172.21.15.39:0/4080781405 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:32.210 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.204+0000 7f53d1717700 1 --2- 172.21.15.39:0/4080781405 >> v2:172.21.15.31:3300/0 conn(0x7f53cc13fa70 0x7f53cc141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.210 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.204+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951118787 0 0) 0x7f53cc0a41d0 con 0x7f53cc13bf60 2020-11-20T13:56:32.210 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.204+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b8003230 con 0x7f53cc13bf60 2020-11-20T13:56:32.210 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1842759790 0 0) 0x7f53b8003230 con 0x7f53cc13bf60 2020-11-20T13:56:32.211 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 >> v2:172.21.15.31:3300/0 conn(0x7f53cc13fa70 msgr2=0x7f53cc141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:32.211 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 --2- 172.21.15.39:0/4080781405 >> v2:172.21.15.31:3300/0 conn(0x7f53cc13fa70 0x7f53cc141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.211 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 >> v1:172.21.15.31:6789/0 conn(0x7f53cc0a8a80 legacy=0x7f53cc0a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.211 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0a59b0 con 0x7f53cc13bf60 2020-11-20T13:56:32.211 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7f53c00016d0 con 0x7f53cc13bf60 2020-11-20T13:56:32.212 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 >> v1:172.21.15.39:6789/0 conn(0x7f53cc13bf60 legacy=0x7f53cc13e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.212 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53b8003720 0x7f53b8003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.212 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53b80044d0 0x7f53b8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.212 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b8004e40 0x7f53b800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.212 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0a02b0 con 0x7f53b8004e40 2020-11-20T13:56:32.213 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80042b0 con 0x7f53b80044d0 2020-11-20T13:56:32.213 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b800bc10 con 0x7f53b8003720 2020-11-20T13:56:32.213 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53d1717700 1 --2- 172.21.15.39:0/4080781405 >> v2:172.21.15.31:3300/0 conn(0x7f53cc13fa70 0x7f53cc141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:32.213 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cbfff700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53b80044d0 0x7f53b8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.214 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53d0f16700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53b8003720 0x7f53b8003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.214 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53d1717700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b8004e40 0x7f53b800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.214 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cbfff700 1 -- 172.21.15.39:0/4080781405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53b8003720 msgr2=0x7f53b8003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:32.214 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cbfff700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53b8003720 0x7f53b8003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.214 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cbfff700 1 -- 172.21.15.39:0/4080781405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b8004e40 msgr2=0x7f53b800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:32.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cbfff700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b8004e40 0x7f53b800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cbfff700 1 -- 172.21.15.39:0/4080781405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b8003230 con 0x7f53b80044d0 2020-11-20T13:56:32.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53d1717700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b8004e40 0x7f53b800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:32.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53d1717700 1 -- 172.21.15.39:0/4080781405 reap_dead start 2020-11-20T13:56:32.215 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cbfff700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53b80044d0 0x7f53b8004950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f53c00013e0 tx=0x7f53cc0a5b40).ready entity=mon.1 client_cookie=36cc8b7d82824649 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:32.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.205+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c00070d0 con 0x7f53b80044d0 2020-11-20T13:56:32.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.206+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0007230 con 0x7f53b80044d0 2020-11-20T13:56:32.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.206+0000 7f53cb7fe700 1 -- 172.21.15.39:0/4080781405 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c00055e0 con 0x7f53b80044d0 2020-11-20T13:56:32.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.206+0000 7f53d317a700 1 -- 172.21.15.39:0/4080781405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53b80044d0 msgr2=0x7f53b8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.216 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.206+0000 7f53d317a700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53b80044d0 0x7f53b8004950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f53c00013e0 tx=0x7f53cc0a5b40).stop 2020-11-20T13:56:32.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.206+0000 7f53d317a700 1 -- 172.21.15.39:0/4080781405 shutdown_connections 2020-11-20T13:56:32.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.206+0000 7f53d317a700 1 --2- 172.21.15.39:0/4080781405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53b80044d0 0x7f53b8004950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.206+0000 7f53d317a700 1 -- 172.21.15.39:0/4080781405 >> 172.21.15.39:0/4080781405 conn(0x7f53cc0ac1e0 msgr2=0x7f53cc0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:32.217 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.206+0000 7f53d317a700 1 -- 172.21.15.39:0/4080781405 shutdown_connections 2020-11-20T13:56:32.218 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.206+0000 7f53d317a700 1 -- 172.21.15.39:0/4080781405 wait complete. 2020-11-20T13:56:32.218 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.207+0000 7f53d317a700 1 Processor -- start 2020-11-20T13:56:32.218 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.207+0000 7f53d317a700 1 -- start start 2020-11-20T13:56:32.220 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d317a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b80044d0 0x7f53cc09be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d317a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53cc13bab0 0x7f53cc09c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d317a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53cc1342e0 0x7f53cc134790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d317a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc09db00 con 0x7f53b80044d0 2020-11-20T13:56:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d317a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc05ccb0 con 0x7f53cc1342e0 2020-11-20T13:56:32.221 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d317a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0a5db0 con 0x7f53cc13bab0 2020-11-20T13:56:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d1717700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53cc1342e0 0x7f53cc134790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d1717700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53cc1342e0 0x7f53cc134790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45628/0 (socket says 172.21.15.39:45628) 2020-11-20T13:56:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d1717700 1 -- 172.21.15.39:0/2240444194 learned_addr learned my addr 172.21.15.39:0/2240444194 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:32.222 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d0f16700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b80044d0 0x7f53cc09be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53cbfff700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53cc13bab0 0x7f53cc09c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d1717700 1 -- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53cc13bab0 msgr2=0x7f53cc09c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d1717700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53cc13bab0 0x7f53cc09c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d1717700 1 -- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b80044d0 msgr2=0x7f53cc09be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.223 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d1717700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b80044d0 0x7f53cc09be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d1717700 1 -- 172.21.15.39:0/2240444194 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc09dd10 con 0x7f53cc1342e0 2020-11-20T13:56:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53cbfff700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53cc13bab0 0x7f53cc09c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d1717700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53cc1342e0 0x7f53cc134790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f53c400b000 tx=0x7f53c4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53c9ffb700 1 -- 172.21.15.39:0/2240444194 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c400ebf0 con 0x7f53cc1342e0 2020-11-20T13:56:32.224 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53c9ffb700 1 -- 172.21.15.39:0/2240444194 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c400ed50 con 0x7f53cc1342e0 2020-11-20T13:56:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc09e140 con 0x7f53cc1342e0 2020-11-20T13:56:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53c9ffb700 1 -- 172.21.15.39:0/2240444194 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c4014620 con 0x7f53cc1342e0 2020-11-20T13:56:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.208+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc09e680 con 0x7f53cc1342e0 2020-11-20T13:56:32.225 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.209+0000 7f53c9ffb700 1 -- 172.21.15.39:0/2240444194 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f53c4023070 con 0x7f53cc1342e0 2020-11-20T13:56:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.209+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc09bb90 con 0x7f53cc1342e0 2020-11-20T13:56:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.210+0000 7f53c9ffb700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f53ac0512f0 0x7f53ac0537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.210+0000 7f53c9ffb700 1 -- 172.21.15.39:0/2240444194 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f53c4069710 con 0x7f53cc1342e0 2020-11-20T13:56:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.210+0000 7f53d0f16700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f53ac0512f0 0x7f53ac0537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.226 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.210+0000 7f53d0f16700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f53ac0512f0 0x7f53ac0537b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f53bc003000 tx=0x7f53bc007ab0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:32.227 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.213+0000 7f53c9ffb700 1 -- 172.21.15.39:0/2240444194 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f53c4041ad0 con 0x7f53cc1342e0 2020-11-20T13:56:32.375 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.375+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f53cc057050 con 0x7f53cc1342e0 2020-11-20T13:56:32.376 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.375+0000 7f53c9ffb700 1 -- 172.21.15.39:0/2240444194 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f53c40450f0 con 0x7f53cc1342e0 2020-11-20T13:56:32.376 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2020-11-20T13:56:32.380 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f53ac0512f0 msgr2=0x7f53ac0537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.380 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f53ac0512f0 0x7f53ac0537b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f53bc003000 tx=0x7f53bc007ab0).stop 2020-11-20T13:56:32.380 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53cc1342e0 msgr2=0x7f53cc134790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.380 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53cc1342e0 0x7f53cc134790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f53c400b000 tx=0x7f53c4008040).stop 2020-11-20T13:56:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 shutdown_connections 2020-11-20T13:56:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f53ac0512f0 0x7f53ac0537b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53cc1342e0 0x7f53cc134790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.381 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53b80044d0 0x7f53cc09be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.382 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 --2- 172.21.15.39:0/2240444194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53cc13bab0 0x7f53cc09c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.382 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 >> 172.21.15.39:0/2240444194 conn(0x7f53cc0ac1e0 msgr2=0x7f53cc0a4920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:32.382 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 shutdown_connections 2020-11-20T13:56:32.382 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.377+0000 7f53d317a700 1 -- 172.21.15.39:0/2240444194 wait complete. 2020-11-20T13:56:32.388 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-11-20T13:56:32.506 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.505+0000 7f94f9619700 1 Processor -- start 2020-11-20T13:56:32.506 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.505+0000 7f94f9619700 1 -- start start 2020-11-20T13:56:32.508 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f9619700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f94f405ce20 0x7f94f40a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.508 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f9619700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f413df70 0x7f94f4140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.508 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f9619700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f40a2d10 con 0x7f94f409f5f0 2020-11-20T13:56:32.509 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f9619700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f40a5090 con 0x7f94f405ce20 2020-11-20T13:56:32.509 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f9619700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40a5330 con 0x7f94f413df70 2020-11-20T13:56:32.509 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f2ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f94f405ce20 0x7f94f40a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.509 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f27fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f94f409f5f0 0x7f94f40a1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35806/0 (socket says 172.21.15.39:35806) 2020-11-20T13:56:32.509 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f27fc700 1 -- 172.21.15.39:0/2474447553 learned_addr learned my addr 172.21.15.39:0/2474447553 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:32.510 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f37fe700 1 --2- 172.21.15.39:0/2474447553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f413df70 0x7f94f4140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.510 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f2ffd700 1 -- 172.21.15.39:0/2474447553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f413df70 msgr2=0x7f94f4140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:32.510 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f2ffd700 1 --2- 172.21.15.39:0/2474447553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f413df70 0x7f94f4140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.510 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f2ffd700 1 -- 172.21.15.39:0/2474447553 >> v1:172.21.15.39:6789/0 conn(0x7f94f409f5f0 legacy=0x7f94f40a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f2ffd700 1 -- 172.21.15.39:0/2474447553 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40a2f40 con 0x7f94f405ce20 2020-11-20T13:56:32.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f1ffb700 1 -- 172.21.15.39:0/2474447553 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832902910 0 0) 0x7f94f40a2d10 con 0x7f94f409f5f0 2020-11-20T13:56:32.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f37fe700 1 --2- 172.21.15.39:0/2474447553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f413df70 0x7f94f4140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:32.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f2ffd700 1 --2- 172.21.15.39:0/2474447553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 0x7f94f40a3df0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f94e8002f30 tx=0x7f94e8006dc0).ready entity=mon.1 client_cookie=d989cc9ee58df297 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:32.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f1ffb700 1 -- 172.21.15.39:0/2474447553 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e80097f0 con 0x7f94f405ce20 2020-11-20T13:56:32.511 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f1ffb700 1 -- 172.21.15.39:0/2474447553 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e8009950 con 0x7f94f405ce20 2020-11-20T13:56:32.512 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f1ffb700 1 -- 172.21.15.39:0/2474447553 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e8009cb0 con 0x7f94f405ce20 2020-11-20T13:56:32.512 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f9619700 1 -- 172.21.15.39:0/2474447553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 msgr2=0x7f94f40a3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.512 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.506+0000 7f94f9619700 1 --2- 172.21.15.39:0/2474447553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 0x7f94f40a3df0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f94e8002f30 tx=0x7f94e8006dc0).stop 2020-11-20T13:56:32.512 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.507+0000 7f94f9619700 1 -- 172.21.15.39:0/2474447553 shutdown_connections 2020-11-20T13:56:32.512 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.507+0000 7f94f9619700 1 --2- 172.21.15.39:0/2474447553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f413df70 0x7f94f4140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.507+0000 7f94f9619700 1 --2- 172.21.15.39:0/2474447553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 0x7f94f40a3df0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.507+0000 7f94f9619700 1 -- 172.21.15.39:0/2474447553 >> 172.21.15.39:0/2474447553 conn(0x7f94f40ac1e0 msgr2=0x7f94f40a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:32.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.507+0000 7f94f9619700 1 -- 172.21.15.39:0/2474447553 shutdown_connections 2020-11-20T13:56:32.513 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.507+0000 7f94f9619700 1 -- 172.21.15.39:0/2474447553 wait complete. 2020-11-20T13:56:32.516 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.508+0000 7f94f9619700 1 Processor -- start 2020-11-20T13:56:32.516 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.508+0000 7f94f9619700 1 -- start start 2020-11-20T13:56:32.516 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.508+0000 7f94f9619700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 0x7f94f408f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.516 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.508+0000 7f94f9619700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f409f5f0 0x7f94f409ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.508+0000 7f94f9619700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f413df70 0x7f94f413a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.508+0000 7f94f9619700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4092000 con 0x7f94f413df70 2020-11-20T13:56:32.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.508+0000 7f94f9619700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40918c0 con 0x7f94f405ce20 2020-11-20T13:56:32.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.508+0000 7f94f9619700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4091b60 con 0x7f94f409f5f0 2020-11-20T13:56:32.517 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 0x7f94f408f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 0x7f94f408f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45638/0 (socket says 172.21.15.39:45638) 2020-11-20T13:56:32.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f2ffd700 1 -- 172.21.15.39:0/440656617 learned_addr learned my addr 172.21.15.39:0/440656617 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:32.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f2ffd700 1 -- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f409f5f0 msgr2=0x7f94f409ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f2ffd700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f409f5f0 0x7f94f409ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T13:56:32.518 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f37fe700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f413df70 0x7f94f413a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f2ffd700 1 -- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f413df70 msgr2=0x7f94f413a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f2ffd700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f413df70 0x7f94f413a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f2ffd700 1 -- 172.21.15.39:0/440656617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f4066b10 con 0x7f94f405ce20 2020-11-20T13:56:32.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f2ffd700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 0x7f94f408f040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f94e8002f30 tx=0x7f94e8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:32.519 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94e3fff700 1 -- 172.21.15.39:0/440656617 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e8011db0 con 0x7f94f405ce20 2020-11-20T13:56:32.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94e3fff700 1 -- 172.21.15.39:0/440656617 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e801d450 con 0x7f94f405ce20 2020-11-20T13:56:32.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f40903c0 con 0x7f94f405ce20 2020-11-20T13:56:32.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94e3fff700 1 -- 172.21.15.39:0/440656617 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e801d7b0 con 0x7f94f405ce20 2020-11-20T13:56:32.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.509+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f408ff20 con 0x7f94f405ce20 2020-11-20T13:56:32.520 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.510+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f4090230 con 0x7f94f405ce20 2020-11-20T13:56:32.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.510+0000 7f94e3fff700 1 -- 172.21.15.39:0/440656617 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f94e8024030 con 0x7f94f405ce20 2020-11-20T13:56:32.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.510+0000 7f94e3fff700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f94d0051270 0x7f94d0053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.510+0000 7f94e3fff700 1 -- 172.21.15.39:0/440656617 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f94e806a260 con 0x7f94f405ce20 2020-11-20T13:56:32.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.511+0000 7f94f27fc700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f94d0051270 0x7f94d0053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.521 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.511+0000 7f94f27fc700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f94d0051270 0x7f94d0053730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f94e4000e90 tx=0x7f94e4007710).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:32.522 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.514+0000 7f94e3fff700 1 -- 172.21.15.39:0/440656617 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f94e8042620 con 0x7f94f405ce20 2020-11-20T13:56:32.675 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.674+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f94f4091d20 con 0x7f94f405ce20 2020-11-20T13:56:32.676 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.675+0000 7f94e3fff700 1 -- 172.21.15.39:0/440656617 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f94e8022020 con 0x7f94f405ce20 2020-11-20T13:56:32.676 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:32.677 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f94d0051270 msgr2=0x7f94d0053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.677 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f94d0051270 0x7f94d0053730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f94e4000e90 tx=0x7f94e4007710).stop 2020-11-20T13:56:32.678 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 msgr2=0x7f94f408f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.678 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 0x7f94f408f040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f94e8002f30 tx=0x7f94e8015000).stop 2020-11-20T13:56:32.678 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 shutdown_connections 2020-11-20T13:56:32.678 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f94d0051270 0x7f94d0053730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.678 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94f405ce20 0x7f94f408f040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.679 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94f413df70 0x7f94f413a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.679 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 --2- 172.21.15.39:0/440656617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94f409f5f0 0x7f94f409ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T13:56:32.679 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 >> 172.21.15.39:0/440656617 conn(0x7f94f40ac1e0 msgr2=0x7f94f40aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:32.679 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 shutdown_connections 2020-11-20T13:56:32.680 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.676+0000 7f94f9619700 1 -- 172.21.15.39:0/440656617 wait complete. 2020-11-20T13:56:32.687 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-11-20T13:56:32.804 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.803+0000 7ff80f7f7700 1 Processor -- start 2020-11-20T13:56:32.805 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.804+0000 7ff80f7f7700 1 -- start start 2020-11-20T13:56:32.807 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.804+0000 7ff80f7f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff80813bf60 0x7ff80813e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.807 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.804+0000 7ff80f7f7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff80813e840 0x7ff808140c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.807 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.804+0000 7ff80f7f7700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8080a3fa0 con 0x7ff8080a8a80 2020-11-20T13:56:32.808 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.804+0000 7ff80f7f7700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8080a0270 con 0x7ff80813e840 2020-11-20T13:56:32.808 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.804+0000 7ff80f7f7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8080a59b0 con 0x7ff80813bf60 2020-11-20T13:56:32.808 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.804+0000 7ff80dd94700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff80813e840 0x7ff808140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.808 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.804+0000 7ff80d593700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff8080a8a80 0x7ff8080a4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35818/0 (socket says 172.21.15.39:35818) 2020-11-20T13:56:32.808 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.804+0000 7ff80d593700 1 -- 172.21.15.39:0/3781881904 learned_addr learned my addr 172.21.15.39:0/3781881904 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:32.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff80cd92700 1 --2- 172.21.15.39:0/3781881904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff80813bf60 0x7ff80813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff80dd94700 1 -- 172.21.15.39:0/3781881904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff80813bf60 msgr2=0x7ff80813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:32.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff80dd94700 1 --2- 172.21.15.39:0/3781881904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff80813bf60 0x7ff80813e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff80dd94700 1 -- 172.21.15.39:0/3781881904 >> v1:172.21.15.39:6789/0 conn(0x7ff8080a8a80 legacy=0x7ff8080a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.809 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff80dd94700 1 -- 172.21.15.39:0/3781881904 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8080a41d0 con 0x7ff80813e840 2020-11-20T13:56:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff7fbfff700 1 -- 172.21.15.39:0/3781881904 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712383610 0 0) 0x7ff8080a3fa0 con 0x7ff8080a8a80 2020-11-20T13:56:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff80cd92700 1 --2- 172.21.15.39:0/3781881904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff80813bf60 0x7ff80813e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff80dd94700 1 --2- 172.21.15.39:0/3781881904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 0x7ff808140c30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ff8000032b0 tx=0x7ff8000091a0).ready entity=mon.1 client_cookie=756e31fe55716fc4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff7fbfff700 1 -- 172.21.15.39:0/3781881904 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80000ba50 con 0x7ff80813e840 2020-11-20T13:56:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff7fbfff700 1 -- 172.21.15.39:0/3781881904 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80000bbb0 con 0x7ff80813e840 2020-11-20T13:56:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff7fbfff700 1 -- 172.21.15.39:0/3781881904 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80000bd20 con 0x7ff80813e840 2020-11-20T13:56:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff80f7f7700 1 -- 172.21.15.39:0/3781881904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 msgr2=0x7ff808140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.805+0000 7ff80f7f7700 1 --2- 172.21.15.39:0/3781881904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 0x7ff808140c30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ff8000032b0 tx=0x7ff8000091a0).stop 2020-11-20T13:56:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.806+0000 7ff80f7f7700 1 -- 172.21.15.39:0/3781881904 shutdown_connections 2020-11-20T13:56:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.806+0000 7ff80f7f7700 1 --2- 172.21.15.39:0/3781881904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 0x7ff808140c30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.812 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.806+0000 7ff80f7f7700 1 --2- 172.21.15.39:0/3781881904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff80813bf60 0x7ff80813e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.812 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.806+0000 7ff80f7f7700 1 -- 172.21.15.39:0/3781881904 >> 172.21.15.39:0/3781881904 conn(0x7ff8080ac1e0 msgr2=0x7ff8080a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:32.812 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.806+0000 7ff80f7f7700 1 -- 172.21.15.39:0/3781881904 shutdown_connections 2020-11-20T13:56:32.813 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.806+0000 7ff80f7f7700 1 -- 172.21.15.39:0/3781881904 wait complete. 2020-11-20T13:56:32.813 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.806+0000 7ff80f7f7700 1 Processor -- start 2020-11-20T13:56:32.813 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80f7f7700 1 -- start start 2020-11-20T13:56:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80f7f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8080a8a80 0x7ff808065510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80f7f7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80813bf60 0x7ff8080a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80f7f7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 0x7ff8080a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80f7f7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80809abc0 con 0x7ff80813bf60 2020-11-20T13:56:32.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80f7f7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80809b630 con 0x7ff80813e840 2020-11-20T13:56:32.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80f7f7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80809a760 con 0x7ff8080a8a80 2020-11-20T13:56:32.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80dd94700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 0x7ff8080a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.819 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80dd94700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 0x7ff8080a65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45656/0 (socket says 172.21.15.39:45656) 2020-11-20T13:56:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80dd94700 1 -- 172.21.15.39:0/4288548919 learned_addr learned my addr 172.21.15.39:0/4288548919 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80d593700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8080a8a80 0x7ff808065510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80cd92700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80813bf60 0x7ff8080a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80dd94700 1 -- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8080a8a80 msgr2=0x7ff808065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.807+0000 7ff80dd94700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8080a8a80 0x7ff808065510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.821 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff80dd94700 1 -- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80813bf60 msgr2=0x7ff8080a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.821 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff80dd94700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80813bf60 0x7ff8080a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.821 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff80dd94700 1 -- 172.21.15.39:0/4288548919 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80809adf0 con 0x7ff80813e840 2020-11-20T13:56:32.821 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff80cd92700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80813bf60 0x7ff8080a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:32.821 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff80dd94700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 0x7ff8080a65a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff8000032b0 tx=0x7ff800016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:32.822 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff7fa7fc700 1 -- 172.21.15.39:0/4288548919 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8000107a0 con 0x7ff80813e840 2020-11-20T13:56:32.822 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff7fa7fc700 1 -- 172.21.15.39:0/4288548919 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff800010900 con 0x7ff80813e840 2020-11-20T13:56:32.822 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff808063a50 con 0x7ff80813e840 2020-11-20T13:56:32.822 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff7fa7fc700 1 -- 172.21.15.39:0/4288548919 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff800010c60 con 0x7ff80813e840 2020-11-20T13:56:32.822 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.808+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80813e3e0 con 0x7ff80813e840 2020-11-20T13:56:32.823 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.809+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80809a5c0 con 0x7ff80813e840 2020-11-20T13:56:32.823 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.809+0000 7ff7fa7fc700 1 -- 172.21.15.39:0/4288548919 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7ff800027030 con 0x7ff80813e840 2020-11-20T13:56:32.823 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.809+0000 7ff7fa7fc700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff7e80511d0 0x7ff7e8053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:32.824 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.809+0000 7ff7fa7fc700 1 -- 172.21.15.39:0/4288548919 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff80006a280 con 0x7ff80813e840 2020-11-20T13:56:32.824 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.810+0000 7ff80d593700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff7e80511d0 0x7ff7e8053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:32.824 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.810+0000 7ff80d593700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff7e80511d0 0x7ff7e8053690 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff7fc00b000 tx=0x7ff7fc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:32.824 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.813+0000 7ff7fa7fc700 1 -- 172.21.15.39:0/4288548919 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7ff80809a5c0 con 0x7ff80813e840 2020-11-20T13:56:32.972 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.971+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff80809a5c0 con 0x7ff80813e840 2020-11-20T13:56:32.973 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.972+0000 7ff7fa7fc700 1 -- 172.21.15.39:0/4288548919 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff80809a5c0 con 0x7ff80813e840 2020-11-20T13:56:32.973 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:32.974 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff7e80511d0 msgr2=0x7ff7e8053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.974 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff7e80511d0 0x7ff7e8053690 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff7fc00b000 tx=0x7ff7fc009040).stop 2020-11-20T13:56:32.975 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 msgr2=0x7ff8080a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:32.975 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 0x7ff8080a65a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff8000032b0 tx=0x7ff800016000).stop 2020-11-20T13:56:32.975 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 shutdown_connections 2020-11-20T13:56:32.975 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7ff7e80511d0 0x7ff7e8053690 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.975 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff80813e840 0x7ff8080a65a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.976 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8080a8a80 0x7ff808065510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.976 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 --2- 172.21.15.39:0/4288548919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80813bf60 0x7ff8080a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:32.976 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 >> 172.21.15.39:0/4288548919 conn(0x7ff8080ac1e0 msgr2=0x7ff8080a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:32.976 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 shutdown_connections 2020-11-20T13:56:32.976 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:32.973+0000 7ff80f7f7700 1 -- 172.21.15.39:0/4288548919 wait complete. 2020-11-20T13:56:32.984 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-11-20T13:56:33.101 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.100+0000 7f393ebc8700 1 Processor -- start 2020-11-20T13:56:33.101 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.100+0000 7f393ebc8700 1 -- start start 2020-11-20T13:56:33.104 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393ebc8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813bf60 0x7f393813e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.104 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393ebc8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f393813e840 0x7f3938140c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.104 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393ebc8700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380a3fa0 con 0x7f39380a8a80 2020-11-20T13:56:33.104 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393ebc8700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39380a0270 con 0x7f393813e840 2020-11-20T13:56:33.105 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393ebc8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380a59b0 con 0x7f393813bf60 2020-11-20T13:56:33.105 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393c964700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f39380a8a80 0x7f39380a4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35832/0 (socket says 172.21.15.39:35832) 2020-11-20T13:56:33.105 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393c964700 1 -- 172.21.15.39:0/1068791269 learned_addr learned my addr 172.21.15.39:0/1068791269 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:33.106 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393d165700 1 --2- 172.21.15.39:0/1068791269 >> v2:172.21.15.39:3300/0 conn(0x7f393813e840 0x7f3938140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.106 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f39377fe700 1 -- 172.21.15.39:0/1068791269 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166628364 0 0) 0x7f39380a3fa0 con 0x7f39380a8a80 2020-11-20T13:56:33.106 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f39377fe700 1 -- 172.21.15.39:0/1068791269 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3924003230 con 0x7f39380a8a80 2020-11-20T13:56:33.106 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f3937fff700 1 --2- 172.21.15.39:0/1068791269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813bf60 0x7f393813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393d165700 1 -- 172.21.15.39:0/1068791269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813bf60 msgr2=0x7f393813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393d165700 1 --2- 172.21.15.39:0/1068791269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813bf60 0x7f393813e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393d165700 1 -- 172.21.15.39:0/1068791269 >> v1:172.21.15.39:6789/0 conn(0x7f39380a8a80 legacy=0x7f39380a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393d165700 1 -- 172.21.15.39:0/1068791269 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380a41d0 con 0x7f393813e840 2020-11-20T13:56:33.110 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f3937fff700 1 --2- 172.21.15.39:0/1068791269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813bf60 0x7f393813e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393d165700 1 --2- 172.21.15.39:0/1068791269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813e840 0x7f3938140c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3928002f30 tx=0x7f3928006dc0).ready entity=mon.1 client_cookie=6b1213413317d8c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f39377fe700 1 -- 172.21.15.39:0/1068791269 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3928009760 con 0x7f393813e840 2020-11-20T13:56:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f39377fe700 1 -- 172.21.15.39:0/1068791269 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39280098c0 con 0x7f393813e840 2020-11-20T13:56:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f39377fe700 1 -- 172.21.15.39:0/1068791269 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3928009c20 con 0x7f393813e840 2020-11-20T13:56:33.111 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393ebc8700 1 -- 172.21.15.39:0/1068791269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813e840 msgr2=0x7f3938140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.101+0000 7f393ebc8700 1 --2- 172.21.15.39:0/1068791269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813e840 0x7f3938140c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3928002f30 tx=0x7f3928006dc0).stop 2020-11-20T13:56:33.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.102+0000 7f393ebc8700 1 -- 172.21.15.39:0/1068791269 shutdown_connections 2020-11-20T13:56:33.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.102+0000 7f393ebc8700 1 --2- 172.21.15.39:0/1068791269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813e840 0x7f3938140c30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.102+0000 7f393ebc8700 1 --2- 172.21.15.39:0/1068791269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813bf60 0x7f393813e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.112 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.102+0000 7f393ebc8700 1 -- 172.21.15.39:0/1068791269 >> 172.21.15.39:0/1068791269 conn(0x7f39380ac1e0 msgr2=0x7f39380a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:33.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.102+0000 7f393ebc8700 1 -- 172.21.15.39:0/1068791269 shutdown_connections 2020-11-20T13:56:33.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.102+0000 7f393ebc8700 1 -- 172.21.15.39:0/1068791269 wait complete. 2020-11-20T13:56:33.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.103+0000 7f393ebc8700 1 Processor -- start 2020-11-20T13:56:33.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.103+0000 7f393ebc8700 1 -- start start 2020-11-20T13:56:33.116 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393ebc8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380a8a80 0x7f393808fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.116 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393ebc8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813bf60 0x7f39380901f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.116 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393ebc8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813e840 0x7f3938066210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.116 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393ebc8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380914f0 con 0x7f39380a8a80 2020-11-20T13:56:33.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393ebc8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393813ba90 con 0x7f393813bf60 2020-11-20T13:56:33.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393ebc8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393813bd30 con 0x7f393813e840 2020-11-20T13:56:33.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3937fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813bf60 0x7f39380901f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3937fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813bf60 0x7f39380901f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45668/0 (socket says 172.21.15.39:45668) 2020-11-20T13:56:33.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3937fff700 1 -- 172.21.15.39:0/3995017282 learned_addr learned my addr 172.21.15.39:0/3995017282 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:33.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393c964700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380a8a80 0x7f393808fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393d165700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813e840 0x7f3938066210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3937fff700 1 -- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813e840 msgr2=0x7f3938066210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3937fff700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813e840 0x7f3938066210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3937fff700 1 -- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380a8a80 msgr2=0x7f393808fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3937fff700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380a8a80 0x7f393808fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3937fff700 1 -- 172.21.15.39:0/3995017282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393809e270 con 0x7f393813bf60 2020-11-20T13:56:33.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3937fff700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813bf60 0x7f39380901f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f392c007000 tx=0x7f392c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:33.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3935ffb700 1 -- 172.21.15.39:0/3995017282 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f392c007750 con 0x7f393813bf60 2020-11-20T13:56:33.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3935ffb700 1 -- 172.21.15.39:0/3995017282 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c0078b0 con 0x7f393813bf60 2020-11-20T13:56:33.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393809e510 con 0x7f393813bf60 2020-11-20T13:56:33.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f3935ffb700 1 -- 172.21.15.39:0/3995017282 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f392c007c10 con 0x7f393813bf60 2020-11-20T13:56:33.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.104+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3938091910 con 0x7f393813bf60 2020-11-20T13:56:33.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.105+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393809e6a0 con 0x7f393813bf60 2020-11-20T13:56:33.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.105+0000 7f3935ffb700 1 -- 172.21.15.39:0/3995017282 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f392c007d70 con 0x7f393813bf60 2020-11-20T13:56:33.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.106+0000 7f3935ffb700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3918051270 0x7f3918053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.106+0000 7f3935ffb700 1 -- 172.21.15.39:0/3995017282 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f392c0692e0 con 0x7f393813bf60 2020-11-20T13:56:33.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.106+0000 7f393c964700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3918051270 0x7f3918053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.106+0000 7f393c964700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3918051270 0x7f3918053730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3930008000 tx=0x7f3930009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:33.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.109+0000 7f3935ffb700 1 -- 172.21.15.39:0/3995017282 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f392c041530 con 0x7f393813bf60 2020-11-20T13:56:33.273 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.272+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3938057050 con 0x7f393813bf60 2020-11-20T13:56:33.273 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.272+0000 7f3935ffb700 1 -- 172.21.15.39:0/3995017282 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f392c044b50 con 0x7f393813bf60 2020-11-20T13:56:33.274 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:33.275 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3918051270 msgr2=0x7f3918053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.276 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3918051270 0x7f3918053730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3930008000 tx=0x7f3930009040).stop 2020-11-20T13:56:33.276 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813bf60 msgr2=0x7f39380901f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.276 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813bf60 0x7f39380901f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f392c007000 tx=0x7f392c008040).stop 2020-11-20T13:56:33.276 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 shutdown_connections 2020-11-20T13:56:33.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f3918051270 0x7f3918053730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f393813e840 0x7f3938066210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39380a8a80 0x7f393808fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 --2- 172.21.15.39:0/3995017282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f393813bf60 0x7f39380901f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.277 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 >> 172.21.15.39:0/3995017282 conn(0x7f39380ac1e0 msgr2=0x7f39380aa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:33.278 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 shutdown_connections 2020-11-20T13:56:33.278 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.274+0000 7f393ebc8700 1 -- 172.21.15.39:0/3995017282 wait complete. 2020-11-20T13:56:33.286 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-11-20T13:56:33.404 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.401+0000 7fdb2cdb0700 1 Processor -- start 2020-11-20T13:56:33.404 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.401+0000 7fdb2cdb0700 1 -- start start 2020-11-20T13:56:33.404 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb2cdb0700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdb28066ed0 0x7fdb280a31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.409 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb2cdb0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a36d0 0x7fdb2805c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.409 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb2cdb0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb280a7440 con 0x7fdb280a5e20 2020-11-20T13:56:33.409 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb2cdb0700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb280a2b10 con 0x7fdb28066ed0 2020-11-20T13:56:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb2cdb0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280a2db0 con 0x7fdb280a36d0 2020-11-20T13:56:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb277fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdb28066ed0 0x7fdb280a31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb277fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdb28066ed0 0x7fdb280a31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45674/0 (socket says 172.21.15.39:45674) 2020-11-20T13:56:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb277fe700 1 -- 172.21.15.39:0/1570058303 learned_addr learned my addr 172.21.15.39:0/1570058303 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb27fff700 1 --2- 172.21.15.39:0/1570058303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a36d0 0x7fdb2805c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb277fe700 1 -- 172.21.15.39:0/1570058303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a36d0 msgr2=0x7fdb2805c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb277fe700 1 --2- 172.21.15.39:0/1570058303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a36d0 0x7fdb2805c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb277fe700 1 -- 172.21.15.39:0/1570058303 >> v1:172.21.15.31:6789/0 conn(0x7fdb280a5e20 legacy=0x7fdb2805ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb277fe700 1 -- 172.21.15.39:0/1570058303 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb280a6a60 con 0x7fdb28066ed0 2020-11-20T13:56:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb27fff700 1 --2- 172.21.15.39:0/1570058303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a36d0 0x7fdb2805c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb277fe700 1 --2- 172.21.15.39:0/1570058303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb28066ed0 0x7fdb280a31e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fdb28067370 tx=0x7fdb18006e80).ready entity=mon.1 client_cookie=4a91292956077595 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb26ffd700 1 -- 172.21.15.39:0/1570058303 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb180097b0 con 0x7fdb28066ed0 2020-11-20T13:56:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb26ffd700 1 -- 172.21.15.39:0/1570058303 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb18009910 con 0x7fdb28066ed0 2020-11-20T13:56:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb26ffd700 1 -- 172.21.15.39:0/1570058303 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb18009ac0 con 0x7fdb28066ed0 2020-11-20T13:56:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/1570058303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb28066ed0 msgr2=0x7fdb280a31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.402+0000 7fdb2cdb0700 1 --2- 172.21.15.39:0/1570058303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb28066ed0 0x7fdb280a31e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fdb28067370 tx=0x7fdb18006e80).stop 2020-11-20T13:56:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.403+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/1570058303 shutdown_connections 2020-11-20T13:56:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.403+0000 7fdb2cdb0700 1 --2- 172.21.15.39:0/1570058303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a36d0 0x7fdb2805c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.403+0000 7fdb2cdb0700 1 --2- 172.21.15.39:0/1570058303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb28066ed0 0x7fdb280a31e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.403+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/1570058303 >> 172.21.15.39:0/1570058303 conn(0x7fdb28061f10 msgr2=0x7fdb280ab550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.403+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/1570058303 shutdown_connections 2020-11-20T13:56:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.403+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/1570058303 wait complete. 2020-11-20T13:56:33.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.404+0000 7fdb2cdb0700 1 Processor -- start 2020-11-20T13:56:33.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.404+0000 7fdb2cdb0700 1 -- start start 2020-11-20T13:56:33.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.404+0000 7fdb2cdb0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb28066ed0 0x7fdb28148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.404+0000 7fdb2cdb0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb280a36d0 0x7fdb28148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.404+0000 7fdb2cdb0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a5e20 0x7fdb280a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.404+0000 7fdb2cdb0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2809c4b0 con 0x7fdb28066ed0 2020-11-20T13:56:33.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.404+0000 7fdb2cdb0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28148b70 con 0x7fdb280a36d0 2020-11-20T13:56:33.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.404+0000 7fdb2cdb0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280a5560 con 0x7fdb280a5e20 2020-11-20T13:56:33.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb1ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb280a36d0 0x7fdb28148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.421 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb1ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb280a36d0 0x7fdb28148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45680/0 (socket says 172.21.15.39:45680) 2020-11-20T13:56:33.421 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb1ffff700 1 -- 172.21.15.39:0/2591169224 learned_addr learned my addr 172.21.15.39:0/2591169224 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:33.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb277fe700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb28066ed0 0x7fdb28148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb27fff700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a5e20 0x7fdb280a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb1ffff700 1 -- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a5e20 msgr2=0x7fdb280a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb1ffff700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a5e20 0x7fdb280a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb1ffff700 1 -- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb28066ed0 msgr2=0x7fdb28148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb1ffff700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb28066ed0 0x7fdb28148190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb1ffff700 1 -- 172.21.15.39:0/2591169224 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2813d4f0 con 0x7fdb280a36d0 2020-11-20T13:56:33.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb1ffff700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb280a36d0 0x7fdb28148680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdb10001f50 tx=0x7fdb10007b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:33.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb257fa700 1 -- 172.21.15.39:0/2591169224 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1000e4a0 con 0x7fdb280a36d0 2020-11-20T13:56:33.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb257fa700 1 -- 172.21.15.39:0/2591169224 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1000e600 con 0x7fdb280a36d0 2020-11-20T13:56:33.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb280a1750 con 0x7fdb280a36d0 2020-11-20T13:56:33.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb257fa700 1 -- 172.21.15.39:0/2591169224 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1000e770 con 0x7fdb280a36d0 2020-11-20T13:56:33.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.405+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2813cbb0 con 0x7fdb280a36d0 2020-11-20T13:56:33.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.406+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb28057050 con 0x7fdb280a36d0 2020-11-20T13:56:33.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.406+0000 7fdb257fa700 1 -- 172.21.15.39:0/2591169224 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fdb10010030 con 0x7fdb280a36d0 2020-11-20T13:56:33.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.407+0000 7fdb257fa700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fdb0c051390 0x7fdb0c053850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:33.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.407+0000 7fdb257fa700 1 -- 172.21.15.39:0/2591169224 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdb10068b80 con 0x7fdb280a36d0 2020-11-20T13:56:33.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.407+0000 7fdb277fe700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fdb0c051390 0x7fdb0c053850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:33.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.407+0000 7fdb277fe700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fdb0c051390 0x7fdb0c053850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdb1801b000 tx=0x7fdb18016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:33.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.410+0000 7fdb257fa700 1 -- 172.21.15.39:0/2591169224 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fdb10040f40 con 0x7fdb280a36d0 2020-11-20T13:56:33.627 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.625+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb2806a4a0 con 0x7fdb280a36d0 2020-11-20T13:56:33.627 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.626+0000 7fdb257fa700 1 -- 172.21.15.39:0/2591169224 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2129 (secure 0 0 0) 0x7fdb10044560 con 0x7fdb280a36d0 2020-11-20T13:56:33.628 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:33.628 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/3919208998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3919208998},{"type":"v1","addr":"172.21.15.31:6835","nonce":3919208998}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T13:56:20.721257+0000","modified":"2020-11-20T13:56:22.730017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.39:6833/38159747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":38159747},{"type":"v1","addr":"172.21.15.39:6833","nonce":38159747}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T13:56:33.629 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.627+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fdb0c051390 msgr2=0x7fdb0c053850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.629 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.627+0000 7fdb2cdb0700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fdb0c051390 0x7fdb0c053850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdb1801b000 tx=0x7fdb18016000).stop 2020-11-20T13:56:33.629 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.627+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb280a36d0 msgr2=0x7fdb28148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:33.630 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.627+0000 7fdb2cdb0700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb280a36d0 0x7fdb28148680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdb10001f50 tx=0x7fdb10007b70).stop 2020-11-20T13:56:33.630 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.627+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 shutdown_connections 2020-11-20T13:56:33.630 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.627+0000 7fdb2cdb0700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fdb0c051390 0x7fdb0c053850 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.630 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.627+0000 7fdb2cdb0700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb280a5e20 0x7fdb280a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.630 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.627+0000 7fdb2cdb0700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb28066ed0 0x7fdb28148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.631 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.627+0000 7fdb2cdb0700 1 --2- 172.21.15.39:0/2591169224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb280a36d0 0x7fdb28148680 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:33.631 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.628+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 >> 172.21.15.39:0/2591169224 conn(0x7fdb28061f10 msgr2=0x7fdb280ab550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:33.631 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.628+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 shutdown_connections 2020-11-20T13:56:33.631 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:33.628+0000 7fdb2cdb0700 1 -- 172.21.15.39:0/2591169224 wait complete. 2020-11-20T13:56:33.631 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 5 2020-11-20T13:56:33.844 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T13:56:20.721257+0000', 'modified': '2020-11-20T13:56:22.730017+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4243}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4243': {'gid': 4243, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.39:6833/38159747', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6832', 'nonce': 38159747}, {'type': 'v1', 'addr': '172.21.15.39:6833', 'nonce': 38159747}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T13:56:33.845 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T13:56:33.845 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-11-20T13:56:33.981 INFO:teuthology.orchestra.run.smithi039.stdout:{"cluster_fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","whoami":0,"id":4243,"want_state":"up:active","state":"up:active","rank_uptime":13.249794601,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":22,"uptime":16.559019352} 2020-11-20T13:56:33.982 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "52a00615-6ac7-45c8-8003-8fe417b7b412", "id": 4243, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 22, "rank_uptime": 13.249794601, "state": "up:active", "uptime": 16.559019352, "want_state": "up:active", "whoami": 0 } 2020-11-20T13:56:33.982 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-11-20T13:56:33.998 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-11-20T13:56:33.998 INFO:tasks.ceph_fuse:config is None 2020-11-20T13:56:33.999 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-11-20T13:56:33.999 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-11-20T13:56:33.999 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-20T13:56:34.113 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f2212ab7700 1 Processor -- start 2020-11-20T13:56:34.114 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f2212ab7700 1 -- start start 2020-11-20T13:56:34.116 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f2212ab7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f220c0a8a80 0x7f220c0a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.116 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f2212ab7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a3190 0x7f220c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f2212ab7700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c0a3fa0 con 0x7f220c0a4870 2020-11-20T13:56:34.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f2212ab7700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c0a0270 con 0x7f220c0a8a80 2020-11-20T13:56:34.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f2212ab7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0a59b0 con 0x7f220c0a3190 2020-11-20T13:56:34.117 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f2210853700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f220c0a8a80 0x7f220c0a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f220bfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f220c0a4870 0x7f220c0a2a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35862/0 (socket says 172.21.15.39:35862) 2020-11-20T13:56:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.113+0000 7f220bfff700 1 -- 172.21.15.39:0/3633992398 learned_addr learned my addr 172.21.15.39:0/3633992398 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f2211054700 1 --2- 172.21.15.39:0/3633992398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a3190 0x7f220c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f2210853700 1 -- 172.21.15.39:0/3633992398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a3190 msgr2=0x7f220c0a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f2210853700 1 --2- 172.21.15.39:0/3633992398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a3190 0x7f220c0a35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f2210853700 1 -- 172.21.15.39:0/3633992398 >> v1:172.21.15.39:6789/0 conn(0x7f220c0a4870 legacy=0x7f220c0a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f2210853700 1 -- 172.21.15.39:0/3633992398 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0a41d0 con 0x7f220c0a8a80 2020-11-20T13:56:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f220b7fe700 1 -- 172.21.15.39:0/3633992398 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691952358 0 0) 0x7f220c0a3fa0 con 0x7f220c0a4870 2020-11-20T13:56:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f2210853700 1 --2- 172.21.15.39:0/3633992398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a8a80 0x7f220c0a4380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f21f4002f30 tx=0x7f21f4006dc0).ready entity=mon.1 client_cookie=9bb697a872657b79 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f220b7fe700 1 -- 172.21.15.39:0/3633992398 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21f40097f0 con 0x7f220c0a8a80 2020-11-20T13:56:34.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f220b7fe700 1 -- 172.21.15.39:0/3633992398 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4009950 con 0x7f220c0a8a80 2020-11-20T13:56:34.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f220b7fe700 1 -- 172.21.15.39:0/3633992398 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21f4009cb0 con 0x7f220c0a8a80 2020-11-20T13:56:34.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f2212ab7700 1 -- 172.21.15.39:0/3633992398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a8a80 msgr2=0x7f220c0a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.114+0000 7f2212ab7700 1 --2- 172.21.15.39:0/3633992398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a8a80 0x7f220c0a4380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f21f4002f30 tx=0x7f21f4006dc0).stop 2020-11-20T13:56:34.120 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.115+0000 7f2212ab7700 1 -- 172.21.15.39:0/3633992398 shutdown_connections 2020-11-20T13:56:34.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.115+0000 7f2212ab7700 1 --2- 172.21.15.39:0/3633992398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a3190 0x7f220c0a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.115+0000 7f2212ab7700 1 --2- 172.21.15.39:0/3633992398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a8a80 0x7f220c0a4380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.115+0000 7f2212ab7700 1 -- 172.21.15.39:0/3633992398 >> 172.21.15.39:0/3633992398 conn(0x7f220c0ac1e0 msgr2=0x7f220c0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:34.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.115+0000 7f2212ab7700 1 -- 172.21.15.39:0/3633992398 shutdown_connections 2020-11-20T13:56:34.121 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.115+0000 7f2212ab7700 1 -- 172.21.15.39:0/3633992398 wait complete. 2020-11-20T13:56:34.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.115+0000 7f2212ab7700 1 Processor -- start 2020-11-20T13:56:34.122 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f2212ab7700 1 -- start start 2020-11-20T13:56:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f2212ab7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f220c0a3190 0x7f220c1480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f2212ab7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a4870 0x7f220c09be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f2212ab7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a8a80 0x7f220c13a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f2212ab7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c09dbf0 con 0x7f220c0a3190 2020-11-20T13:56:34.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f2212ab7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c09de90 con 0x7f220c0a4870 2020-11-20T13:56:34.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f2212ab7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c09b9d0 con 0x7f220c0a8a80 2020-11-20T13:56:34.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f220bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a4870 0x7f220c09be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f220bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a4870 0x7f220c09be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45696/0 (socket says 172.21.15.39:45696) 2020-11-20T13:56:34.131 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.116+0000 7f220bfff700 1 -- 172.21.15.39:0/3126423024 learned_addr learned my addr 172.21.15.39:0/3126423024 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:34.132 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f220bfff700 1 -- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a8a80 msgr2=0x7f220c13a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.132 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f2211054700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a8a80 0x7f220c13a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.132 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f220bfff700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a8a80 0x7f220c13a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.132 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f2210853700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f220c0a3190 0x7f220c1480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.133 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f220bfff700 1 -- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f220c0a3190 msgr2=0x7f220c1480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.133 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f220bfff700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f220c0a3190 0x7f220c1480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.133 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f220bfff700 1 -- 172.21.15.39:0/3126423024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c066210 con 0x7f220c0a4870 2020-11-20T13:56:34.133 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f220bfff700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a4870 0x7f220c09be70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f21fc000e90 tx=0x7f21fc007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:34.134 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f2209ffb700 1 -- 172.21.15.39:0/3126423024 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21fc007320 con 0x7f220c0a4870 2020-11-20T13:56:34.134 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f2209ffb700 1 -- 172.21.15.39:0/3126423024 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc007480 con 0x7f220c0a4870 2020-11-20T13:56:34.134 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f2209ffb700 1 -- 172.21.15.39:0/3126423024 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21fc0057d0 con 0x7f220c0a4870 2020-11-20T13:56:34.134 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c09e610 con 0x7f220c0a4870 2020-11-20T13:56:34.134 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.117+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c138c20 con 0x7f220c0a4870 2020-11-20T13:56:34.135 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.118+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c09da60 con 0x7f220c0a4870 2020-11-20T13:56:34.135 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.118+0000 7f2209ffb700 1 -- 172.21.15.39:0/3126423024 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f21fc010030 con 0x7f220c0a4870 2020-11-20T13:56:34.135 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.118+0000 7f2209ffb700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f21f0051270 0x7f21f0053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.135 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.118+0000 7f2209ffb700 1 -- 172.21.15.39:0/3126423024 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f21fc068c60 con 0x7f220c0a4870 2020-11-20T13:56:34.135 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.119+0000 7f2210853700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f21f0051270 0x7f21f0053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.136 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.119+0000 7f2210853700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f21f0051270 0x7f21f0053730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f21f4016000 tx=0x7f21f4015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:34.137 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.122+0000 7f2209ffb700 1 -- 172.21.15.39:0/3126423024 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f21fc041020 con 0x7f220c0a4870 2020-11-20T13:56:34.284 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.283+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f220c09bb90 con 0x7f220c0a4870 2020-11-20T13:56:34.285 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.284+0000 7f2209ffb700 1 -- 172.21.15.39:0/3126423024 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f21fc044640 con 0x7f220c0a4870 2020-11-20T13:56:34.285 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:34.286 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":23,"fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","created":"2020-11-20T13:56:01.298058+0000","modified":"2020-11-20T13:56:23.331627+0000","last_up_change":"2020-11-20T13:56:10.208719+0000","last_in_change":"2020-11-20T13:56:10.208719+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T13:56:05.147084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T13:56:15.768689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T13:56:18.856235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T13:56:19.656250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70258e98-258a-42f9-be42-3d27596f28ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":22475},{"type":"v1","addr":"172.21.15.39:6801","nonce":22475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":22475},{"type":"v1","addr":"172.21.15.39:6803","nonce":22475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6807","nonce":22475},{"type":"v1","addr":"172.21.15.39:6809","nonce":22475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":22475},{"type":"v1","addr":"172.21.15.39:6805","nonce":22475}]},"public_addr":"172.21.15.39:6801/22475","cluster_addr":"172.21.15.39:6803/22475","heartbeat_back_addr":"172.21.15.39:6809/22475","heartbeat_front_addr":"172.21.15.39:6805/22475","state":["exists","up"]},{"osd":1,"uuid":"af7acda6-6b94-47d7-b6f8-adbc029495f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":22477},{"type":"v1","addr":"172.21.15.39:6817","nonce":22477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":22477},{"type":"v1","addr":"172.21.15.39:6819","nonce":22477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":22477},{"type":"v1","addr":"172.21.15.39:6823","nonce":22477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":22477},{"type":"v1","addr":"172.21.15.39:6821","nonce":22477}]},"public_addr":"172.21.15.39:6817/22477","cluster_addr":"172.21.15.39:6819/22477","heartbeat_back_addr":"172.21.15.39:6823/22477","heartbeat_front_addr":"172.21.15.39:6821/22477","state":["exists","up"]},{"osd":2,"uuid":"2d80a994-2822-41e6-a77a-cd3f42925956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":22476},{"type":"v1","addr":"172.21.15.39:6808","nonce":22476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":22476},{"type":"v1","addr":"172.21.15.39:6811","nonce":22476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":22476},{"type":"v1","addr":"172.21.15.39:6815","nonce":22476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":22476},{"type":"v1","addr":"172.21.15.39:6813","nonce":22476}]},"public_addr":"172.21.15.39:6808/22476","cluster_addr":"172.21.15.39:6811/22476","heartbeat_back_addr":"172.21.15.39:6815/22476","heartbeat_front_addr":"172.21.15.39:6813/22476","state":["exists","up"]},{"osd":3,"uuid":"bdab1d0e-f2a2-4531-a8a6-9bc20089f59b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":22479},{"type":"v1","addr":"172.21.15.39:6825","nonce":22479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":22479},{"type":"v1","addr":"172.21.15.39:6827","nonce":22479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":22479},{"type":"v1","addr":"172.21.15.39:6831","nonce":22479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":22479},{"type":"v1","addr":"172.21.15.39:6829","nonce":22479}]},"public_addr":"172.21.15.39:6825/22479","cluster_addr":"172.21.15.39:6827/22479","heartbeat_back_addr":"172.21.15.39:6831/22479","heartbeat_front_addr":"172.21.15.39:6829/22479","state":["exists","up"]},{"osd":4,"uuid":"4ed27863-a55d-431c-b59d-1cb548279143","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":22791},{"type":"v1","addr":"172.21.15.31:6803","nonce":22791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":22791},{"type":"v1","addr":"172.21.15.31:6805","nonce":22791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":22791},{"type":"v1","addr":"172.21.15.31:6809","nonce":22791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":22791},{"type":"v1","addr":"172.21.15.31:6807","nonce":22791}]},"public_addr":"172.21.15.31:6803/22791","cluster_addr":"172.21.15.31:6805/22791","heartbeat_back_addr":"172.21.15.31:6809/22791","heartbeat_front_addr":"172.21.15.31:6807/22791","state":["exists","up"]},{"osd":5,"uuid":"2acfbfc2-ad2e-4c66-a3da-67d806e4c69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":22848},{"type":"v1","addr":"172.21.15.31:6819","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":22848},{"type":"v1","addr":"172.21.15.31:6821","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":22848},{"type":"v1","addr":"172.21.15.31:6825","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":22848},{"type":"v1","addr":"172.21.15.31:6823","nonce":22848}]},"public_addr":"172.21.15.31:6819/22848","cluster_addr":"172.21.15.31:6821/22848","heartbeat_back_addr":"172.21.15.31:6825/22848","heartbeat_front_addr":"172.21.15.31:6823/22848","state":["exists","up"]},{"osd":6,"uuid":"952daddd-927b-4859-a149-d0128b4106f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":22792},{"type":"v1","addr":"172.21.15.31:6811","nonce":22792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":22792},{"type":"v1","addr":"172.21.15.31:6813","nonce":22792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":22792},{"type":"v1","addr":"172.21.15.31:6817","nonce":22792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":22792},{"type":"v1","addr":"172.21.15.31:6815","nonce":22792}]},"public_addr":"172.21.15.31:6811/22792","cluster_addr":"172.21.15.31:6813/22792","heartbeat_back_addr":"172.21.15.31:6817/22792","heartbeat_front_addr":"172.21.15.31:6815/22792","state":["exists","up"]},{"osd":7,"uuid":"2bf29e2c-70b0-44b6-8414-e8efcd0a43e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":22898},{"type":"v1","addr":"172.21.15.31:6827","nonce":22898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":22898},{"type":"v1","addr":"172.21.15.31:6829","nonce":22898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":22898},{"type":"v1","addr":"172.21.15.31:6833","nonce":22898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":22898},{"type":"v1","addr":"172.21.15.31:6831","nonce":22898}]},"public_addr":"172.21.15.31:6827/22898","cluster_addr":"172.21.15.31:6829/22898","heartbeat_back_addr":"172.21.15.31:6833/22898","heartbeat_front_addr":"172.21.15.31:6831/22898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.310476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.399010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.338327+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.348423+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.317489+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.397742+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.319756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T13:56:08.336584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-20T13:56:34.287 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f21f0051270 msgr2=0x7f21f0053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.287 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f21f0051270 0x7f21f0053730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f21f4016000 tx=0x7f21f4015000).stop 2020-11-20T13:56:34.287 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a4870 msgr2=0x7f220c09be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.288 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a4870 0x7f220c09be70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f21fc000e90 tx=0x7f21fc007a90).stop 2020-11-20T13:56:34.288 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 shutdown_connections 2020-11-20T13:56:34.288 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f21f0051270 0x7f21f0053730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.288 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f220c0a8a80 0x7f220c13a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.288 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f220c0a3190 0x7f220c1480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.289 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 --2- 172.21.15.39:0/3126423024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f220c0a4870 0x7f220c09be70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.289 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 >> 172.21.15.39:0/3126423024 conn(0x7f220c0ac1e0 msgr2=0x7f220c0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:34.289 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 shutdown_connections 2020-11-20T13:56:34.290 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.286+0000 7f2212ab7700 1 -- 172.21.15.39:0/3126423024 wait complete. 2020-11-20T13:56:34.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T13:56:05.147084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T13:56:15.768689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T13:56:18.856235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T13:56:19.656250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T13:56:34.298 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-11-20T13:56:34.414 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.413+0000 7fcd7f9eb700 1 Processor -- start 2020-11-20T13:56:34.414 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.414+0000 7fcd7f9eb700 1 -- start start 2020-11-20T13:56:34.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.414+0000 7fcd7f9eb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd7809f5f0 0x7fcd780a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.414+0000 7fcd7f9eb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7813ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.414+0000 7fcd7f9eb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd780a4e60 con 0x7fcd7805ce20 2020-11-20T13:56:34.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.414+0000 7fcd7f9eb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd780a5090 con 0x7fcd7809f5f0 2020-11-20T13:56:34.417 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.414+0000 7fcd7f9eb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd780a5330 con 0x7fcd780a2310 2020-11-20T13:56:34.418 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.414+0000 7fcd7df88700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7813ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.414+0000 7fcd7df88700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7813ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.39:56162/0 (socket says 172.21.15.39:56162) 2020-11-20T13:56:34.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.414+0000 7fcd7df88700 1 -- 172.21.15.39:0/598559363 learned_addr learned my addr 172.21.15.39:0/598559363 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:34.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd7cf86700 1 --2- 172.21.15.39:0/598559363 >> v2:172.21.15.31:3300/0 conn(0x7fcd7809f5f0 0x7fcd780a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.419 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd7df88700 1 -- 172.21.15.39:0/598559363 >> v2:172.21.15.31:3300/0 conn(0x7fcd7809f5f0 msgr2=0x7fcd780a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:34.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd7df88700 1 --2- 172.21.15.39:0/598559363 >> v2:172.21.15.31:3300/0 conn(0x7fcd7809f5f0 0x7fcd780a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd7df88700 1 -- 172.21.15.39:0/598559363 >> v1:172.21.15.31:6789/0 conn(0x7fcd7805ce20 legacy=0x7fcd780a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd7df88700 1 -- 172.21.15.39:0/598559363 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd780a2d10 con 0x7fcd780a2310 2020-11-20T13:56:34.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd7df88700 1 --2- 172.21.15.39:0/598559363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7813ff80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fcd70002f30 tx=0x7fcd70006e80).ready entity=mon.2 client_cookie=dac28f924bb8e8bb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:34.420 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd67fff700 1 -- 172.21.15.39:0/598559363 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd70014070 con 0x7fcd780a2310 2020-11-20T13:56:34.421 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd67fff700 1 -- 172.21.15.39:0/598559363 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd700098f0 con 0x7fcd780a2310 2020-11-20T13:56:34.421 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd67fff700 1 -- 172.21.15.39:0/598559363 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd70009c50 con 0x7fcd780a2310 2020-11-20T13:56:34.421 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/598559363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 msgr2=0x7fcd7813ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.421 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.415+0000 7fcd7f9eb700 1 --2- 172.21.15.39:0/598559363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7813ff80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fcd70002f30 tx=0x7fcd70006e80).stop 2020-11-20T13:56:34.421 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.416+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/598559363 shutdown_connections 2020-11-20T13:56:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.416+0000 7fcd7f9eb700 1 --2- 172.21.15.39:0/598559363 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7813ff80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.416+0000 7fcd7f9eb700 1 --2- 172.21.15.39:0/598559363 >> v2:172.21.15.31:3300/0 conn(0x7fcd7809f5f0 0x7fcd780a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.416+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/598559363 >> 172.21.15.39:0/598559363 conn(0x7fcd780ac1e0 msgr2=0x7fcd780a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.416+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/598559363 shutdown_connections 2020-11-20T13:56:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.416+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/598559363 wait complete. 2020-11-20T13:56:34.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7f9eb700 1 Processor -- start 2020-11-20T13:56:34.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7f9eb700 1 -- start start 2020-11-20T13:56:34.425 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7f9eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7805ce20 0x7fcd7809e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7f9eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd7809f5f0 0x7fcd781361f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7f9eb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7809c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7f9eb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7809f130 con 0x7fcd7809f5f0 2020-11-20T13:56:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7f9eb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7809c330 con 0x7fcd7805ce20 2020-11-20T13:56:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7f9eb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd78138b80 con 0x7fcd780a2310 2020-11-20T13:56:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7d787700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7805ce20 0x7fcd7809e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7d787700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7805ce20 0x7fcd7809e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45708/0 (socket says 172.21.15.39:45708) 2020-11-20T13:56:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7d787700 1 -- 172.21.15.39:0/92839153 learned_addr learned my addr 172.21.15.39:0/92839153 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7cf86700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd7809f5f0 0x7fcd781361f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.417+0000 7fcd7df88700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7809c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd7d787700 1 -- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 msgr2=0x7fcd7809c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd7d787700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7809c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd7d787700 1 -- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd7809f5f0 msgr2=0x7fcd781361f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd7d787700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd7809f5f0 0x7fcd781361f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd7d787700 1 -- 172.21.15.39:0/92839153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78138d40 con 0x7fcd7805ce20 2020-11-20T13:56:34.429 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd7cf86700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd7809f5f0 0x7fcd781361f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T13:56:34.429 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd7d787700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7805ce20 0x7fcd7809e500 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fcd78060a40 tx=0x7fcd68007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:34.429 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd667fc700 1 -- 172.21.15.39:0/92839153 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6800e4a0 con 0x7fcd7805ce20 2020-11-20T13:56:34.429 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd667fc700 1 -- 172.21.15.39:0/92839153 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6800e600 con 0x7fcd7805ce20 2020-11-20T13:56:34.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7809ea20 con 0x7fcd7805ce20 2020-11-20T13:56:34.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd667fc700 1 -- 172.21.15.39:0/92839153 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6800e960 con 0x7fcd7805ce20 2020-11-20T13:56:34.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.418+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd78135260 con 0x7fcd7805ce20 2020-11-20T13:56:34.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.419+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7809ef90 con 0x7fcd7805ce20 2020-11-20T13:56:34.430 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.419+0000 7fcd667fc700 1 -- 172.21.15.39:0/92839153 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fcd68019030 con 0x7fcd7805ce20 2020-11-20T13:56:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.420+0000 7fcd667fc700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fcd580511d0 0x7fcd58053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.420+0000 7fcd667fc700 1 -- 172.21.15.39:0/92839153 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcd68068400 con 0x7fcd7805ce20 2020-11-20T13:56:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.420+0000 7fcd7cf86700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fcd580511d0 0x7fcd58053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.420+0000 7fcd7cf86700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fcd580511d0 0x7fcd58053690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcd7400b000 tx=0x7fcd740091a0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.423+0000 7fcd667fc700 1 -- 172.21.15.39:0/92839153 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fcd7809ef90 con 0x7fcd7805ce20 2020-11-20T13:56:34.582 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.581+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcd7809ef90 con 0x7fcd7805ce20 2020-11-20T13:56:34.583 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.582+0000 7fcd667fc700 1 -- 172.21.15.39:0/92839153 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcd7809ef90 con 0x7fcd7805ce20 2020-11-20T13:56:34.583 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2020-11-20T13:56:34.584 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fcd580511d0 msgr2=0x7fcd58053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.585 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fcd580511d0 0x7fcd58053690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcd7400b000 tx=0x7fcd740091a0).stop 2020-11-20T13:56:34.585 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7805ce20 msgr2=0x7fcd7809e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.585 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7805ce20 0x7fcd7809e500 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fcd78060a40 tx=0x7fcd68007b90).stop 2020-11-20T13:56:34.585 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 shutdown_connections 2020-11-20T13:56:34.585 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fcd580511d0 0x7fcd58053690 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.586 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7805ce20 0x7fcd7809e500 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.586 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcd780a2310 0x7fcd7809c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.586 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 --2- 172.21.15.39:0/92839153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd7809f5f0 0x7fcd781361f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.586 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.583+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 >> 172.21.15.39:0/92839153 conn(0x7fcd780ac1e0 msgr2=0x7fcd780aaeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:34.587 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.584+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 shutdown_connections 2020-11-20T13:56:34.587 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.584+0000 7fcd7f9eb700 1 -- 172.21.15.39:0/92839153 wait complete. 2020-11-20T13:56:34.594 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-11-20T13:56:34.711 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.710+0000 7f0641135700 1 Processor -- start 2020-11-20T13:56:34.711 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.710+0000 7f0641135700 1 -- start start 2020-11-20T13:56:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f0641135700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 0x7f063c0a5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f0641135700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f063c0a5fe0 0x7f063c13b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f0641135700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0a06c0 con 0x7f063c09f5f0 2020-11-20T13:56:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f0641135700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0a04b0 con 0x7f063c0a5fe0 2020-11-20T13:56:34.714 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f0641135700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0a0ee0 con 0x7f063c0a8c40 2020-11-20T13:56:34.715 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f063b59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f063c0a5fe0 0x7f063c13b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.715 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f063a59c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f063c09f5f0 0x7f063c13af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35888/0 (socket says 172.21.15.39:35888) 2020-11-20T13:56:34.715 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f063a59c700 1 -- 172.21.15.39:0/1104904973 learned_addr learned my addr 172.21.15.39:0/1104904973 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:34.715 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f063ad9d700 1 --2- 172.21.15.39:0/1104904973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 0x7f063c0a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.716 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f063b59e700 1 -- 172.21.15.39:0/1104904973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 msgr2=0x7f063c0a5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:34.716 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f063b59e700 1 --2- 172.21.15.39:0/1104904973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 0x7f063c0a5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.716 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f063b59e700 1 -- 172.21.15.39:0/1104904973 >> v1:172.21.15.39:6789/0 conn(0x7f063c09f5f0 legacy=0x7f063c13af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.717 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f063b59e700 1 -- 172.21.15.39:0/1104904973 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0a1180 con 0x7f063c0a5fe0 2020-11-20T13:56:34.717 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.711+0000 7f0639d9b700 1 -- 172.21.15.39:0/1104904973 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527405664 0 0) 0x7f063c0a06c0 con 0x7f063c09f5f0 2020-11-20T13:56:34.717 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f063b59e700 1 --2- 172.21.15.39:0/1104904973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c0a5fe0 0x7f063c13b670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f06340032b0 tx=0x7f06340091a0).ready entity=mon.1 client_cookie=f1d4cb87cbad3782 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:34.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0639d9b700 1 -- 172.21.15.39:0/1104904973 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063400ba30 con 0x7f063c0a5fe0 2020-11-20T13:56:34.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0639d9b700 1 -- 172.21.15.39:0/1104904973 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400bb90 con 0x7f063c0a5fe0 2020-11-20T13:56:34.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0639d9b700 1 -- 172.21.15.39:0/1104904973 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063400bd00 con 0x7f063c0a5fe0 2020-11-20T13:56:34.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0641135700 1 -- 172.21.15.39:0/1104904973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c0a5fe0 msgr2=0x7f063c13b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.718 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0641135700 1 --2- 172.21.15.39:0/1104904973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c0a5fe0 0x7f063c13b670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f06340032b0 tx=0x7f06340091a0).stop 2020-11-20T13:56:34.719 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0641135700 1 -- 172.21.15.39:0/1104904973 shutdown_connections 2020-11-20T13:56:34.719 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0641135700 1 --2- 172.21.15.39:0/1104904973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 0x7f063c0a5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.719 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0641135700 1 --2- 172.21.15.39:0/1104904973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c0a5fe0 0x7f063c13b670 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.719 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0641135700 1 -- 172.21.15.39:0/1104904973 >> 172.21.15.39:0/1104904973 conn(0x7f063c0ac1e0 msgr2=0x7f063c0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:34.719 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0641135700 1 -- 172.21.15.39:0/1104904973 shutdown_connections 2020-11-20T13:56:34.720 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.712+0000 7f0641135700 1 -- 172.21.15.39:0/1104904973 wait complete. 2020-11-20T13:56:34.720 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.713+0000 7f0641135700 1 Processor -- start 2020-11-20T13:56:34.720 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.713+0000 7f0641135700 1 -- start start 2020-11-20T13:56:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f0641135700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c09f5f0 0x7f063c08fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.722 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f0641135700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f063c0a5fe0 0x7f063c139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f0641135700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 0x7f063c139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f0641135700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0a3fc0 con 0x7f063c0a5fe0 2020-11-20T13:56:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f0641135700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0a4260 con 0x7f063c09f5f0 2020-11-20T13:56:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f0641135700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c139d10 con 0x7f063c0a8c40 2020-11-20T13:56:34.723 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c09f5f0 0x7f063c08fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c09f5f0 0x7f063c08fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45722/0 (socket says 172.21.15.39:45722) 2020-11-20T13:56:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063ad9d700 1 -- 172.21.15.39:0/1732806594 learned_addr learned my addr 172.21.15.39:0/1732806594 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063b59e700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 0x7f063c139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063a59c700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f063c0a5fe0 0x7f063c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063ad9d700 1 -- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 msgr2=0x7f063c139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063ad9d700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 0x7f063c139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063ad9d700 1 -- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f063c0a5fe0 msgr2=0x7f063c139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063ad9d700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f063c0a5fe0 0x7f063c139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063ad9d700 1 -- 172.21.15.39:0/1732806594 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0901b0 con 0x7f063c09f5f0 2020-11-20T13:56:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063a59c700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f063c0a5fe0 0x7f063c139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063b59e700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 0x7f063c139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T13:56:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f063ad9d700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c09f5f0 0x7f063c08fcc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f063000c000 tx=0x7f0630006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f062bfff700 1 -- 172.21.15.39:0/1732806594 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063000ca80 con 0x7f063c09f5f0 2020-11-20T13:56:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f062bfff700 1 -- 172.21.15.39:0/1732806594 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063000cbe0 con 0x7f063c09f5f0 2020-11-20T13:56:34.726 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f062bfff700 1 -- 172.21.15.39:0/1732806594 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06300123f0 con 0x7f063c09f5f0 2020-11-20T13:56:34.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c0a3800 con 0x7f063c09f5f0 2020-11-20T13:56:34.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.714+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c09ac40 con 0x7f063c09f5f0 2020-11-20T13:56:34.727 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.715+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c0a3c90 con 0x7f063c09f5f0 2020-11-20T13:56:34.728 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.715+0000 7f062bfff700 1 -- 172.21.15.39:0/1732806594 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f0630012550 con 0x7f063c09f5f0 2020-11-20T13:56:34.728 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.716+0000 7f062bfff700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0618051270 0x7f0618053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:34.728 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.716+0000 7f062bfff700 1 -- 172.21.15.39:0/1732806594 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f06300693a0 con 0x7f063c09f5f0 2020-11-20T13:56:34.728 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.716+0000 7f063a59c700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0618051270 0x7f0618053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:34.728 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.716+0000 7f063a59c700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0618051270 0x7f0618053730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f062c008000 tx=0x7f062c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:34.729 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.719+0000 7f062bfff700 1 -- 172.21.15.39:0/1732806594 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f0630041700 con 0x7f063c09f5f0 2020-11-20T13:56:34.879 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.878+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f063c057050 con 0x7f063c09f5f0 2020-11-20T13:56:34.879 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.879+0000 7f062bfff700 1 -- 172.21.15.39:0/1732806594 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0630044d20 con 0x7f063c09f5f0 2020-11-20T13:56:34.880 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0618051270 msgr2=0x7f0618053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0618051270 0x7f0618053730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f062c008000 tx=0x7f062c009040).stop 2020-11-20T13:56:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c09f5f0 msgr2=0x7f063c08fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:34.881 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c09f5f0 0x7f063c08fcc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f063000c000 tx=0x7f0630006dc0).stop 2020-11-20T13:56:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 shutdown_connections 2020-11-20T13:56:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f0618051270 0x7f0618053730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063c09f5f0 0x7f063c08fcc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f063c0a8c40 0x7f063c139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.882 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 --2- 172.21.15.39:0/1732806594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f063c0a5fe0 0x7f063c139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 >> 172.21.15.39:0/1732806594 conn(0x7f063c0ac1e0 msgr2=0x7f063c0aa330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 shutdown_connections 2020-11-20T13:56:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:34.880+0000 7f0641135700 1 -- 172.21.15.39:0/1732806594 wait complete. 2020-11-20T13:56:34.891 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-11-20T13:56:35.011 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.007+0000 7fc6a98ad700 1 Processor -- start 2020-11-20T13:56:35.011 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.007+0000 7fc6a98ad700 1 -- start start 2020-11-20T13:56:35.011 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.008+0000 7fc6a98ad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 0x7fc6a4141e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.011 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.008+0000 7fc6a98ad700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40a3fa0 con 0x7fc6a40a8a80 2020-11-20T13:56:35.012 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.008+0000 7fc6a98ad700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40a41d0 con 0x7fc6a413bf60 2020-11-20T13:56:35.012 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.008+0000 7fc6a98ad700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40a0270 con 0x7fc6a413fa70 2020-11-20T13:56:35.012 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.008+0000 7fc6a27fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc6a413bf60 0x7fc6a413e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35902/0 (socket says 172.21.15.39:35902) 2020-11-20T13:56:35.012 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.008+0000 7fc6a27fc700 1 -- 172.21.15.39:0/3058366061 learned_addr learned my addr 172.21.15.39:0/3058366061 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:35.013 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a37fe700 1 --2- 172.21.15.39:0/3058366061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 0x7fc6a4141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.013 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a1ffb700 1 -- 172.21.15.39:0/3058366061 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917934662 0 0) 0x7fc6a40a41d0 con 0x7fc6a413bf60 2020-11-20T13:56:35.013 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a1ffb700 1 -- 172.21.15.39:0/3058366061 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc684003230 con 0x7fc6a413bf60 2020-11-20T13:56:35.014 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a1ffb700 1 -- 172.21.15.39:0/3058366061 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544993645 0 0) 0x7fc6a40a3fa0 con 0x7fc6a40a8a80 2020-11-20T13:56:35.014 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a1ffb700 1 -- 172.21.15.39:0/3058366061 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a40a41d0 con 0x7fc6a40a8a80 2020-11-20T13:56:35.014 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a37fe700 1 -- 172.21.15.39:0/3058366061 >> v1:172.21.15.39:6789/0 conn(0x7fc6a413bf60 legacy=0x7fc6a413e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.014 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a37fe700 1 -- 172.21.15.39:0/3058366061 >> v1:172.21.15.31:6789/0 conn(0x7fc6a40a8a80 legacy=0x7fc6a40a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.014 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a37fe700 1 -- 172.21.15.39:0/3058366061 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40a59b0 con 0x7fc6a413fa70 2020-11-20T13:56:35.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a37fe700 1 --2- 172.21.15.39:0/3058366061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 0x7fc6a4141e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc69c0032b0 tx=0x7fc69c0091a0).ready entity=mon.2 client_cookie=2960b054f02f2550 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:35.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a1ffb700 1 -- 172.21.15.39:0/3058366061 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69c00b940 con 0x7fc6a413fa70 2020-11-20T13:56:35.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a1ffb700 1 -- 172.21.15.39:0/3058366061 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00baa0 con 0x7fc6a413fa70 2020-11-20T13:56:35.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a1ffb700 1 -- 172.21.15.39:0/3058366061 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69c00bc10 con 0x7fc6a413fa70 2020-11-20T13:56:35.015 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3058366061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 msgr2=0x7fc6a4141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.009+0000 7fc6a98ad700 1 --2- 172.21.15.39:0/3058366061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 0x7fc6a4141e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc69c0032b0 tx=0x7fc69c0091a0).stop 2020-11-20T13:56:35.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.010+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3058366061 shutdown_connections 2020-11-20T13:56:35.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.010+0000 7fc6a98ad700 1 --2- 172.21.15.39:0/3058366061 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 0x7fc6a4141e60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.010+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3058366061 >> 172.21.15.39:0/3058366061 conn(0x7fc6a40ac1e0 msgr2=0x7fc6a40a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:35.016 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.010+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3058366061 shutdown_connections 2020-11-20T13:56:35.017 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.010+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3058366061 wait complete. 2020-11-20T13:56:35.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a98ad700 1 Processor -- start 2020-11-20T13:56:35.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a98ad700 1 -- start start 2020-11-20T13:56:35.020 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a98ad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40a8a80 0x7fc6a413d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.021 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a98ad700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a413bf60 0x7fc6a4149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.021 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a98ad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 0x7fc6a4149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.021 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a98ad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a413ea30 con 0x7fc6a40a8a80 2020-11-20T13:56:35.021 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a98ad700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a413cf00 con 0x7fc6a413bf60 2020-11-20T13:56:35.023 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a98ad700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a413d160 con 0x7fc6a413fa70 2020-11-20T13:56:35.024 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a413bf60 0x7fc6a4149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.024 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a413bf60 0x7fc6a4149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45736/0 (socket says 172.21.15.39:45736) 2020-11-20T13:56:35.024 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.011+0000 7fc6a27fc700 1 -- 172.21.15.39:0/3485414055 learned_addr learned my addr 172.21.15.39:0/3485414055 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:35.024 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a37fe700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 0x7fc6a4149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.025 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a2ffd700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40a8a80 0x7fc6a413d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.025 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a27fc700 1 -- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 msgr2=0x7fc6a4149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.025 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a27fc700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 0x7fc6a4149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.025 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a27fc700 1 -- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40a8a80 msgr2=0x7fc6a413d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.025 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a27fc700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40a8a80 0x7fc6a413d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.026 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a27fc700 1 -- 172.21.15.39:0/3485414055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a413ec40 con 0x7fc6a413bf60 2020-11-20T13:56:35.026 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a2ffd700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40a8a80 0x7fc6a413d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T13:56:35.026 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a27fc700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a413bf60 0x7fc6a4149830 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fc6940010d0 tx=0x7fc694007a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:35.026 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc69bfff700 1 -- 172.21.15.39:0/3485414055 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6940072e0 con 0x7fc6a413bf60 2020-11-20T13:56:35.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc69bfff700 1 -- 172.21.15.39:0/3485414055 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694007440 con 0x7fc6a413bf60 2020-11-20T13:56:35.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a413c3e0 con 0x7fc6a413bf60 2020-11-20T13:56:35.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc69bfff700 1 -- 172.21.15.39:0/3485414055 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6940057d0 con 0x7fc6a413bf60 2020-11-20T13:56:35.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.012+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a413f070 con 0x7fc6a413bf60 2020-11-20T13:56:35.027 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.013+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a413fea0 con 0x7fc6a413bf60 2020-11-20T13:56:35.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.013+0000 7fc69bfff700 1 -- 172.21.15.39:0/3485414055 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fc694010070 con 0x7fc6a413bf60 2020-11-20T13:56:35.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.014+0000 7fc69bfff700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fc6880511d0 0x7fc688053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.014+0000 7fc69bfff700 1 -- 172.21.15.39:0/3485414055 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc694068640 con 0x7fc6a413bf60 2020-11-20T13:56:35.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.014+0000 7fc6a2ffd700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fc6880511d0 0x7fc688053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.014+0000 7fc6a2ffd700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fc6880511d0 0x7fc688053690 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc68c00b000 tx=0x7fc68c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:35.028 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.017+0000 7fc69bfff700 1 -- 172.21.15.39:0/3485414055 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fc6a413fea0 con 0x7fc6a413bf60 2020-11-20T13:56:35.178 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.177+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6a413fea0 con 0x7fc6a413bf60 2020-11-20T13:56:35.179 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.178+0000 7fc69bfff700 1 -- 172.21.15.39:0/3485414055 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc6a413fea0 con 0x7fc6a413bf60 2020-11-20T13:56:35.179 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:35.180 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fc6880511d0 msgr2=0x7fc688053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.181 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fc6880511d0 0x7fc688053690 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc68c00b000 tx=0x7fc68c009040).stop 2020-11-20T13:56:35.181 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a413bf60 msgr2=0x7fc6a4149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.181 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a413bf60 0x7fc6a4149830 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fc6940010d0 tx=0x7fc694007a50).stop 2020-11-20T13:56:35.181 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 shutdown_connections 2020-11-20T13:56:35.182 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fc6880511d0 0x7fc688053690 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.182 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6a413fa70 0x7fc6a4149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.182 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40a8a80 0x7fc6a413d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.182 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 --2- 172.21.15.39:0/3485414055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a413bf60 0x7fc6a4149830 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.182 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.179+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 >> 172.21.15.39:0/3485414055 conn(0x7fc6a40ac1e0 msgr2=0x7fc6a40a6090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:35.183 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.180+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 shutdown_connections 2020-11-20T13:56:35.183 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.180+0000 7fc6a98ad700 1 -- 172.21.15.39:0/3485414055 wait complete. 2020-11-20T13:56:35.191 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-11-20T13:56:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.306+0000 7fd35ddb3700 1 Processor -- start 2020-11-20T13:56:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.306+0000 7fd35ddb3700 1 -- start start 2020-11-20T13:56:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.306+0000 7fd35ddb3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd35805ce20 0x7fd3580a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.310 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd35ddb3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd35813df70 0x7fd358140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.310 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd35ddb3700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580a2d10 con 0x7fd35809f5f0 2020-11-20T13:56:35.310 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd35ddb3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580a5090 con 0x7fd35813df70 2020-11-20T13:56:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd35ddb3700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580a5330 con 0x7fd35805ce20 2020-11-20T13:56:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3577fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd35805ce20 0x7fd3580a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.312 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd356ffd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd35809f5f0 0x7fd3580a1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35914/0 (socket says 172.21.15.39:35914) 2020-11-20T13:56:35.312 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3577fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd35805ce20 0x7fd3580a3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45742/0 (socket says 172.21.15.39:45742) 2020-11-20T13:56:35.313 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd356ffd700 1 -- 172.21.15.39:0/1565889956 learned_addr learned my addr 172.21.15.39:0/1565889956 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:35.313 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd357fff700 1 --2- 172.21.15.39:0/1565889956 >> v2:172.21.15.31:3300/0 conn(0x7fd35813df70 0x7fd358140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3577fe700 1 -- 172.21.15.39:0/1565889956 >> v2:172.21.15.31:3300/0 conn(0x7fd35813df70 msgr2=0x7fd358140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:35.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3577fe700 1 --2- 172.21.15.39:0/1565889956 >> v2:172.21.15.31:3300/0 conn(0x7fd35813df70 0x7fd358140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3577fe700 1 -- 172.21.15.39:0/1565889956 >> v1:172.21.15.39:6789/0 conn(0x7fd35809f5f0 legacy=0x7fd3580a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3577fe700 1 -- 172.21.15.39:0/1565889956 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580a2f40 con 0x7fd35805ce20 2020-11-20T13:56:35.314 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3567fc700 1 -- 172.21.15.39:0/1565889956 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252700832 0 0) 0x7fd3580a2d10 con 0x7fd35809f5f0 2020-11-20T13:56:35.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3577fe700 1 --2- 172.21.15.39:0/1565889956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35805ce20 0x7fd3580a3df0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fd348002f30 tx=0x7fd348006dc0).ready entity=mon.1 client_cookie=f7eff783f709e89d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:35.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3567fc700 1 -- 172.21.15.39:0/1565889956 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3480097f0 con 0x7fd35805ce20 2020-11-20T13:56:35.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3567fc700 1 -- 172.21.15.39:0/1565889956 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348009950 con 0x7fd35805ce20 2020-11-20T13:56:35.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd3567fc700 1 -- 172.21.15.39:0/1565889956 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd348009cb0 con 0x7fd35805ce20 2020-11-20T13:56:35.315 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd35ddb3700 1 -- 172.21.15.39:0/1565889956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35805ce20 msgr2=0x7fd3580a3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.307+0000 7fd35ddb3700 1 --2- 172.21.15.39:0/1565889956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35805ce20 0x7fd3580a3df0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fd348002f30 tx=0x7fd348006dc0).stop 2020-11-20T13:56:35.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.308+0000 7fd35ddb3700 1 -- 172.21.15.39:0/1565889956 shutdown_connections 2020-11-20T13:56:35.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.308+0000 7fd35ddb3700 1 --2- 172.21.15.39:0/1565889956 >> v2:172.21.15.31:3300/0 conn(0x7fd35813df70 0x7fd358140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.316 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.308+0000 7fd35ddb3700 1 --2- 172.21.15.39:0/1565889956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35805ce20 0x7fd3580a3df0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.308+0000 7fd35ddb3700 1 -- 172.21.15.39:0/1565889956 >> 172.21.15.39:0/1565889956 conn(0x7fd3580ac1e0 msgr2=0x7fd3580a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:35.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.308+0000 7fd35ddb3700 1 -- 172.21.15.39:0/1565889956 shutdown_connections 2020-11-20T13:56:35.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.308+0000 7fd35ddb3700 1 -- 172.21.15.39:0/1565889956 wait complete. 2020-11-20T13:56:35.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.309+0000 7fd35ddb3700 1 Processor -- start 2020-11-20T13:56:35.317 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.309+0000 7fd35ddb3700 1 -- start start 2020-11-20T13:56:35.320 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.309+0000 7fd35ddb3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd35805ce20 0x7fd35813c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.320 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.309+0000 7fd35ddb3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd35809f5f0 0x7fd35813ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.320 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.309+0000 7fd35ddb3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35813df70 0x7fd3581374b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.309+0000 7fd35ddb3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35813da60 con 0x7fd35809f5f0 2020-11-20T13:56:35.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.309+0000 7fd35ddb3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358067990 con 0x7fd35813df70 2020-11-20T13:56:35.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.309+0000 7fd35ddb3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35813bf60 con 0x7fd35805ce20 2020-11-20T13:56:35.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd357fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35813df70 0x7fd3581374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.321 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd357fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35813df70 0x7fd3581374b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45750/0 (socket says 172.21.15.39:45750) 2020-11-20T13:56:35.322 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd357fff700 1 -- 172.21.15.39:0/984686628 learned_addr learned my addr 172.21.15.39:0/984686628 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:35.322 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd3577fe700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd35805ce20 0x7fd35813c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.322 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd356ffd700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd35809f5f0 0x7fd35813ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.322 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd357fff700 1 -- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd35805ce20 msgr2=0x7fd35813c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.322 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd357fff700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd35805ce20 0x7fd35813c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd357fff700 1 -- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd35809f5f0 msgr2=0x7fd35813ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd357fff700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd35809f5f0 0x7fd35813ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd357fff700 1 -- 172.21.15.39:0/984686628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580a70a0 con 0x7fd35813df70 2020-11-20T13:56:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd357fff700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35813df70 0x7fd3581374b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fd35813d430 tx=0x7fd350008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:35.323 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd354ff9700 1 -- 172.21.15.39:0/984686628 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd350007710 con 0x7fd35813df70 2020-11-20T13:56:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd354ff9700 1 -- 172.21.15.39:0/984686628 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350007870 con 0x7fd35813df70 2020-11-20T13:56:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd358138230 con 0x7fd35813df70 2020-11-20T13:56:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd354ff9700 1 -- 172.21.15.39:0/984686628 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd350007bd0 con 0x7fd35813df70 2020-11-20T13:56:35.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.310+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd358062180 con 0x7fd35813df70 2020-11-20T13:56:35.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.311+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358062430 con 0x7fd35813df70 2020-11-20T13:56:35.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.311+0000 7fd354ff9700 1 -- 172.21.15.39:0/984686628 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7fd350007d30 con 0x7fd35813df70 2020-11-20T13:56:35.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.312+0000 7fd354ff9700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fd3380511d0 0x7fd338053690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.325 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.312+0000 7fd354ff9700 1 -- 172.21.15.39:0/984686628 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd350069250 con 0x7fd35813df70 2020-11-20T13:56:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.312+0000 7fd3577fe700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fd3380511d0 0x7fd338053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.312+0000 7fd3577fe700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fd3380511d0 0x7fd338053690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fd34801b000 tx=0x7fd348015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.315+0000 7fd354ff9700 1 -- 172.21.15.39:0/984686628 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7fd350041610 con 0x7fd35813df70 2020-11-20T13:56:35.476 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.475+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd35813c350 con 0x7fd35813df70 2020-11-20T13:56:35.477 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.475+0000 7fd354ff9700 1 -- 172.21.15.39:0/984686628 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd350044c30 con 0x7fd35813df70 2020-11-20T13:56:35.477 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2020-11-20T13:56:35.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fd3380511d0 msgr2=0x7fd338053690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.478 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fd3380511d0 0x7fd338053690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fd34801b000 tx=0x7fd348015000).stop 2020-11-20T13:56:35.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35813df70 msgr2=0x7fd3581374b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35813df70 0x7fd3581374b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fd35813d430 tx=0x7fd350008040).stop 2020-11-20T13:56:35.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 shutdown_connections 2020-11-20T13:56:35.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7fd3380511d0 0x7fd338053690 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.479 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd35813df70 0x7fd3581374b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd35805ce20 0x7fd35813c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 --2- 172.21.15.39:0/984686628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd35809f5f0 0x7fd35813ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.476+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 >> 172.21.15.39:0/984686628 conn(0x7fd3580ac1e0 msgr2=0x7fd3580aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:35.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.477+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 shutdown_connections 2020-11-20T13:56:35.480 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.477+0000 7fd35ddb3700 1 -- 172.21.15.39:0/984686628 wait complete. 2020-11-20T13:56:35.489 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-11-20T13:56:35.489 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-11-20T13:56:35.603 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.602+0000 7f60c2953700 1 Processor -- start 2020-11-20T13:56:35.603 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.602+0000 7f60c2953700 1 -- start start 2020-11-20T13:56:35.609 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.603+0000 7f60c2953700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc13fa70 0x7f60bc141e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.610 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.603+0000 7f60c2953700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc0a3fa0 con 0x7f60bc13bf60 2020-11-20T13:56:35.610 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.603+0000 7f60c2953700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc0a41d0 con 0x7f60bc0a8a80 2020-11-20T13:56:35.610 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.603+0000 7f60c2953700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0a0270 con 0x7f60bc13fa70 2020-11-20T13:56:35.610 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.603+0000 7f60bbfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f60bc0a8a80 0x7f60bc0a4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35926/0 (socket says 172.21.15.39:35926) 2020-11-20T13:56:35.611 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.603+0000 7f60bbfff700 1 -- 172.21.15.39:0/1015863941 learned_addr learned my addr 172.21.15.39:0/1015863941 (peer_addr_for_me v1:172.21.15.39:0/0) 2020-11-20T13:56:35.611 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.603+0000 7f60c0ef0700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc13fa70 0x7f60bc141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.611 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.603+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 <== mon.1 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221232915 0 0) 0x7f60bc0a41d0 con 0x7f60bc0a8a80 2020-11-20T13:56:35.612 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.603+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a8003230 con 0x7f60bc0a8a80 2020-11-20T13:56:35.612 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 <== mon.1 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1184046497 0 0) 0x7f60a8003230 con 0x7f60bc0a8a80 2020-11-20T13:56:35.612 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc13fa70 msgr2=0x7f60bc141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc13fa70 0x7f60bc141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 >> v1:172.21.15.31:6789/0 conn(0x7f60bc13bf60 legacy=0x7f60bc13e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc0a59b0 con 0x7f60bc0a8a80 2020-11-20T13:56:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 <== mon.1 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3154946830 0 0) 0x7f60ac0016d0 con 0x7f60bc0a8a80 2020-11-20T13:56:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 >> v1:172.21.15.39:6789/0 conn(0x7f60bc0a8a80 legacy=0x7f60bc0a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.615 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60a8003720 0x7f60a8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.615 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc13fa70 0x7f60a80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.615 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60a80049c0 0x7f60a8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.615 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0a0270 con 0x7f60a8003720 2020-11-20T13:56:35.615 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80041c0 con 0x7f60a80049c0 2020-11-20T13:56:35.616 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a800b720 con 0x7f60bc13fa70 2020-11-20T13:56:35.616 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c0ef0700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60a80049c0 0x7f60a8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.616 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60bbfff700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60a8003720 0x7f60a8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.616 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60bb7fe700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc13fa70 0x7f60a80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.616 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c0ef0700 1 -- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc13fa70 msgr2=0x7f60a80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:35.617 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c0ef0700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc13fa70 0x7f60a80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.617 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c0ef0700 1 -- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60a8003720 msgr2=0x7f60a8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T13:56:35.617 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c0ef0700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60a8003720 0x7f60a8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.617 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c0ef0700 1 -- 172.21.15.39:0/1015863941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8003230 con 0x7f60a80049c0 2020-11-20T13:56:35.618 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c0ef0700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60a80049c0 0x7f60a8004e40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f60b400c000 tx=0x7f60b40091a0).ready entity=mon.1 client_cookie=c8e840296bfb2711 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:35.618 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b400eb80 con 0x7f60a80049c0 2020-11-20T13:56:35.618 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b400ece0 con 0x7f60a80049c0 2020-11-20T13:56:35.618 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60baffd700 1 -- 172.21.15.39:0/1015863941 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b40125e0 con 0x7f60a80049c0 2020-11-20T13:56:35.618 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c2953700 1 -- 172.21.15.39:0/1015863941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60a80049c0 msgr2=0x7f60a8004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.619 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c2953700 1 --2- 172.21.15.39:0/1015863941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60a80049c0 0x7f60a8004e40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f60b400c000 tx=0x7f60b40091a0).stop 2020-11-20T13:56:35.619 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.604+0000 7f60c0ef0700 1 -- 172.21.15.39:0/1015863941 reap_dead start 2020-11-20T13:56:35.619 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.605+0000 7f60c2953700 1 -- 172.21.15.39:0/1015863941 shutdown_connections 2020-11-20T13:56:35.619 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.605+0000 7f60c2953700 1 -- 172.21.15.39:0/1015863941 >> 172.21.15.39:0/1015863941 conn(0x7f60bc0ac1e0 msgr2=0x7f60bc0a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:35.619 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.605+0000 7f60c2953700 1 -- 172.21.15.39:0/1015863941 shutdown_connections 2020-11-20T13:56:35.620 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.605+0000 7f60c2953700 1 -- 172.21.15.39:0/1015863941 wait complete. 2020-11-20T13:56:35.620 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.606+0000 7f60c2953700 1 Processor -- start 2020-11-20T13:56:35.620 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.606+0000 7f60c2953700 1 -- start start 2020-11-20T13:56:35.620 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60c2953700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc09e390 0x7f60bc1401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.620 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60c2953700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60bc142f20 0x7f60bc143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.621 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60c2953700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc143a10 0x7f60bc149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.621 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60c2953700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc05ccb0 con 0x7f60bc143a10 2020-11-20T13:56:35.622 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60c2953700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc1406c0 con 0x7f60bc142f20 2020-11-20T13:56:35.622 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60c2953700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc1428d0 con 0x7f60bc09e390 2020-11-20T13:56:35.622 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60bc142f20 0x7f60bc143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.622 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60bc142f20 0x7f60bc143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45768/0 (socket says 172.21.15.39:45768) 2020-11-20T13:56:35.623 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bb7fe700 1 -- 172.21.15.39:0/1862183399 learned_addr learned my addr 172.21.15.39:0/1862183399 (peer_addr_for_me v2:172.21.15.39:0/0) 2020-11-20T13:56:35.623 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60c0ef0700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc143a10 0x7f60bc149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.623 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bbfff700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc09e390 0x7f60bc1401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.623 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bb7fe700 1 -- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc09e390 msgr2=0x7f60bc1401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bb7fe700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc09e390 0x7f60bc1401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bb7fe700 1 -- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc143a10 msgr2=0x7f60bc149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bb7fe700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc143a10 0x7f60bc149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bb7fe700 1 -- 172.21.15.39:0/1862183399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc142b70 con 0x7f60bc142f20 2020-11-20T13:56:35.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60bb7fe700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60bc142f20 0x7f60bc143520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f60b000d000 tx=0x7f60b0007b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:35.624 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60b97fa700 1 -- 172.21.15.39:0/1862183399 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b0007310 con 0x7f60bc142f20 2020-11-20T13:56:35.625 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60b97fa700 1 -- 172.21.15.39:0/1862183399 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b00064e0 con 0x7f60bc142f20 2020-11-20T13:56:35.625 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc09d4c0 con 0x7f60bc142f20 2020-11-20T13:56:35.625 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60b97fa700 1 -- 172.21.15.39:0/1862183399 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b0006840 con 0x7f60bc142f20 2020-11-20T13:56:35.625 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.607+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc1424e0 con 0x7f60bc142f20 2020-11-20T13:56:35.626 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.608+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc142d00 con 0x7f60bc142f20 2020-11-20T13:56:35.626 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.608+0000 7f60b97fa700 1 -- 172.21.15.39:0/1862183399 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 63306+0+0 (secure 0 0 0) 0x7f60b00069a0 con 0x7f60bc142f20 2020-11-20T13:56:35.626 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.609+0000 7f60b97fa700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f609c051390 0x7f609c053850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T13:56:35.626 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.609+0000 7f60b97fa700 1 -- 172.21.15.39:0/1862183399 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f60b0069200 con 0x7f60bc142f20 2020-11-20T13:56:35.626 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.609+0000 7f60bbfff700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f609c051390 0x7f609c053850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T13:56:35.627 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.609+0000 7f60bbfff700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f609c051390 0x7f609c053850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f60ac005000 tx=0x7f60bc0a7520).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T13:56:35.627 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.612+0000 7f60b97fa700 1 -- 172.21.15.39:0/1862183399 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+133711 (secure 0 0 0) 0x7f60b00415c0 con 0x7f60bc142f20 2020-11-20T13:56:35.828 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.825+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60bc057050 con 0x7f60bc142f20 2020-11-20T13:56:35.828 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.825+0000 7f60b97fa700 1 -- 172.21.15.39:0/1862183399 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2129 (secure 0 0 0) 0x7f60b0044be0 con 0x7f60bc142f20 2020-11-20T13:56:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f609c051390 msgr2=0x7f609c053850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f609c051390 0x7f609c053850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f60ac005000 tx=0x7f60bc0a7520).stop 2020-11-20T13:56:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60bc142f20 msgr2=0x7f60bc143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T13:56:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60bc142f20 0x7f60bc143520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f60b000d000 tx=0x7f60b0007b60).stop 2020-11-20T13:56:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 shutdown_connections 2020-11-20T13:56:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:6800/21803,v1:172.21.15.31:6801/21803] conn(0x7f609c051390 0x7f609c053850 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60bc143a10 0x7f60bc149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60bc09e390 0x7f60bc1401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 --2- 172.21.15.39:0/1862183399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60bc142f20 0x7f60bc143520 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T13:56:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 >> 172.21.15.39:0/1862183399 conn(0x7f60bc0ac1e0 msgr2=0x7f60bc0a3630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T13:56:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 shutdown_connections 2020-11-20T13:56:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:2020-11-20T13:56:35.827+0000 7f60c2953700 1 -- 172.21.15.39:0/1862183399 wait complete. 2020-11-20T13:56:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 5 2020-11-20T13:56:35.831 INFO:teuthology.orchestra.run.smithi039.stdout: 2020-11-20T13:56:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6835/3919208998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3919208998},{"type":"v1","addr":"172.21.15.31:6835","nonce":3919208998}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T13:56:20.721257+0000","modified":"2020-11-20T13:56:22.730017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.39:6833/38159747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":38159747},{"type":"v1","addr":"172.21.15.39:6833","nonce":38159747}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T13:56:36.040 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T13:56:20.721257+0000', 'modified': '2020-11-20T13:56:22.730017+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4243}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4243': {'gid': 4243, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.39:6833/38159747', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6832', 'nonce': 38159747}, {'type': 'v1', 'addr': '172.21.15.39:6833', 'nonce': 38159747}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T13:56:36.041 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T13:56:36.041 INFO:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-11-20T13:56:36.180 INFO:teuthology.orchestra.run.smithi039.stdout:{"cluster_fsid":"52a00615-6ac7-45c8-8003-8fe417b7b412","whoami":0,"id":4243,"want_state":"up:active","state":"up:active","rank_uptime":15.446435387999999,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":22,"uptime":18.755660096} 2020-11-20T13:56:36.180 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "52a00615-6ac7-45c8-8003-8fe417b7b412", "id": 4243, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 22, "rank_uptime": 15.446435388, "state": "up:active", "uptime": 18.755660096, "want_state": "up:active", "whoami": 0 } 2020-11-20T13:56:36.181 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-11-20T13:56:36.181 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-11-20T13:56:36.182 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi039.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-11-20T13:56:36.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T13:56:36.183 INFO:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-11-20T13:56:36.199 INFO:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2020-11-20T13:56:36.299 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-11-20T13:56:36.300 INFO:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-11-20T13:56:36.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T13:56:36.334 INFO:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2020-11-20T13:56:36.388 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-11-20T13:56:36.389 INFO:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-11-20T13:56:36.432 INFO:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2020-11-20T13:56:36.463 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-11-20T13:56:36.464 INFO:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-11-20T13:56:36.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:2020-11-20T13:56:36.511+0000 7fd6a8c1b1c0 -1 init, newargv = 0x555b0d5c4080 newargc=9 2020-11-20T13:56:36.512 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:ceph-fuse[25562]: starting ceph client 2020-11-20T13:56:36.516 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:ceph-fuse[25562]: starting fuse 2020-11-20T13:56:36.537 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-11-20T13:56:36.538 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-11-20T13:56:36.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T13:56:36.539 INFO:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2020-11-20T13:56:36.593 INFO:teuthology.orchestra.run.smithi039.stdout:47 2020-11-20T13:56:36.593 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-11-20T13:56:36.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T13:56:36.594 INFO:teuthology.orchestra.run.smithi039:> sudo python3 -c ' 2020-11-20T13:56:36.594 INFO:teuthology.orchestra.run.smithi039:> import glob 2020-11-20T13:56:36.595 INFO:teuthology.orchestra.run.smithi039:> import re 2020-11-20T13:56:36.595 INFO:teuthology.orchestra.run.smithi039:> import os 2020-11-20T13:56:36.595 INFO:teuthology.orchestra.run.smithi039:> import subprocess 2020-11-20T13:56:36.607 INFO:teuthology.orchestra.run.smithi039:> 2020-11-20T13:56:36.608 INFO:teuthology.orchestra.run.smithi039:> def find_socket(client_name): 2020-11-20T13:56:36.609 INFO:teuthology.orchestra.run.smithi039:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-11-20T13:56:36.609 INFO:teuthology.orchestra.run.smithi039:> files = glob.glob(asok_path) 2020-11-20T13:56:36.609 INFO:teuthology.orchestra.run.smithi039:> 2020-11-20T13:56:36.610 INFO:teuthology.orchestra.run.smithi039:> # Given a non-glob path, it better be there 2020-11-20T13:56:36.610 INFO:teuthology.orchestra.run.smithi039:> if "*" not in asok_path: 2020-11-20T13:56:36.610 INFO:teuthology.orchestra.run.smithi039:> assert(len(files) == 1) 2020-11-20T13:56:36.611 INFO:teuthology.orchestra.run.smithi039:> return files[0] 2020-11-20T13:56:36.611 INFO:teuthology.orchestra.run.smithi039:> 2020-11-20T13:56:36.611 INFO:teuthology.orchestra.run.smithi039:> for f in files: 2020-11-20T13:56:36.612 INFO:teuthology.orchestra.run.smithi039:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-11-20T13:56:36.613 INFO:teuthology.orchestra.run.smithi039:> if os.path.exists("/proc/{0}".format(pid)): 2020-11-20T13:56:36.614 INFO:teuthology.orchestra.run.smithi039:> return f 2020-11-20T13:56:36.614 INFO:teuthology.orchestra.run.smithi039:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-11-20T13:56:36.615 INFO:teuthology.orchestra.run.smithi039:> 2020-11-20T13:56:36.615 INFO:teuthology.orchestra.run.smithi039:> print(find_socket("client.0")) 2020-11-20T13:56:36.616 INFO:teuthology.orchestra.run.smithi039:> ' 2020-11-20T13:56:36.689 INFO:teuthology.orchestra.run.smithi039.stdout:/var/run/ceph/ceph-client.0.25562.asok 2020-11-20T13:56:36.693 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.25562.asok 2020-11-20T13:56:36.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T13:56:36.693 INFO:teuthology.orchestra.run.smithi039:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.25562.asok status 2020-11-20T13:56:36.805 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2020-11-20T13:56:36.805 INFO:teuthology.orchestra.run.smithi039.stdout: "metadata": { 2020-11-20T13:56:36.806 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_sha1": "a7b62340ad27b26642bb54ec916a97c7e1f07a34", 2020-11-20T13:56:36.806 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 15.2.5-588-ga7b62340 (a7b62340ad27b26642bb54ec916a97c7e1f07a34) octopus (stable)", 2020-11-20T13:56:36.806 INFO:teuthology.orchestra.run.smithi039.stdout: "entity_id": "0", 2020-11-20T13:56:36.806 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": "smithi039", 2020-11-20T13:56:36.807 INFO:teuthology.orchestra.run.smithi039.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-11-20T13:56:36.807 INFO:teuthology.orchestra.run.smithi039.stdout: "pid": "25562", 2020-11-20T13:56:36.807 INFO:teuthology.orchestra.run.smithi039.stdout: "root": "/" 2020-11-20T13:56:36.807 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2020-11-20T13:56:36.807 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_count": 0, 2020-11-20T13:56:36.808 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_pinned_count": 0, 2020-11-20T13:56:36.808 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4609, 2020-11-20T13:56:36.808 INFO:teuthology.orchestra.run.smithi039.stdout: "inst": { 2020-11-20T13:56:36.808 INFO:teuthology.orchestra.run.smithi039.stdout: "name": { 2020-11-20T13:56:36.808 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "client", 2020-11-20T13:56:36.809 INFO:teuthology.orchestra.run.smithi039.stdout: "num": 4609 2020-11-20T13:56:36.809 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2020-11-20T13:56:36.809 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2020-11-20T13:56:36.809 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2020-11-20T13:56:36.809 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2020-11-20T13:56:36.810 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 2710002566 2020-11-20T13:56:36.810 INFO:teuthology.orchestra.run.smithi039.stdout: } 2020-11-20T13:56:36.810 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2020-11-20T13:56:36.810 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2020-11-20T13:56:36.810 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2020-11-20T13:56:36.810 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2020-11-20T13:56:36.811 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 2710002566 2020-11-20T13:56:36.811 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2020-11-20T13:56:36.811 INFO:teuthology.orchestra.run.smithi039.stdout: "inst_str": "client.4609 172.21.15.39:0/2710002566", 2020-11-20T13:56:36.811 INFO:teuthology.orchestra.run.smithi039.stdout: "addr_str": "172.21.15.39:0/2710002566", 2020-11-20T13:56:36.811 INFO:teuthology.orchestra.run.smithi039.stdout: "inode_count": 1, 2020-11-20T13:56:36.812 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_epoch": 5, 2020-11-20T13:56:36.812 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch": 23, 2020-11-20T13:56:36.812 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch_barrier": 0, 2020-11-20T13:56:36.812 INFO:teuthology.orchestra.run.smithi039.stdout: "blacklisted": false 2020-11-20T13:56:36.812 INFO:teuthology.orchestra.run.smithi039.stdout:} 2020-11-20T13:56:36.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T13:56:36.814 INFO:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-11-20T13:56:36.814 INFO:teuthology.orchestra.run.smithi039:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T13:56:36.830 INFO:teuthology.orchestra.run.smithi039.stdout:fuseblk 2020-11-20T13:56:36.830 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-11-20T13:56:36.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T13:56:36.831 INFO:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-11-20T13:56:36.895 INFO:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T13:56:36.899 INFO:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T13:56:36.902 INFO:teuthology.run_tasks:Running task check-counter... 2020-11-20T13:56:36.917 INFO:teuthology.run_tasks:Running task workunit... 2020-11-20T13:56:36.941 INFO:tasks.workunit:Pulling workunits from ref a7b62340ad27b26642bb54ec916a97c7e1f07a34 2020-11-20T13:56:36.942 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-11-20T13:56:36.942 INFO:tasks.workunit:timeout=3h 2020-11-20T13:56:36.943 INFO:tasks.workunit:cleanup=True 2020-11-20T13:56:36.943 INFO:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2020-11-20T13:56:36.959 INFO:teuthology.orchestra.run.smithi039.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-11-20T13:56:36.960 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-11-20T13:56:36.960 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 2fh/47d Inode: 1 Links: 2 2020-11-20T13:56:36.960 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T13:56:36.960 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:fusefs_t:s0 2020-11-20T13:56:36.960 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-11-20T13:56:36.961 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2020-11-20 13:56:20.723760324 +0000 2020-11-20T13:56:36.961 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2020-11-20 13:56:36.900833367 +0000 2020-11-20T13:56:36.961 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2020-11-20T13:56:36.961 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-11-20T13:56:36.962 INFO:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-11-20T13:56:37.035 INFO:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a7b62340ad27b26642bb54ec916a97c7e1f07a34 2020-11-20T13:56:37.146 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'...