<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: ONTAP Mediator 1.9.1 installation hangs on RHEL 8.2 (Azure VM) with &amp;quot;writing RSA key&amp;quot; in ONTAP Discussions</title>
    <link>https://community.netapp.com/t5/ONTAP-Discussions/ONTAP-Mediator-1-9-1-installation-hangs-on-RHEL-8-2-Azure-VM-with-quot-writing/m-p/461777#M45048</link>
    <description>&lt;P&gt;Hi all,&lt;/P&gt;&lt;P&gt;I'd like to share detailed findings and progress on the ONTAP Mediator 1.9.1 installation issue I previously posted about, where the installer was hanging indefinitely during RSA key generation on a RHEL 8.2 Azure VM.&lt;BR /&gt;&lt;BR /&gt;&lt;STRONG&gt;Root Issue Observed:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;The installation process repeatedly hangs at the &lt;STRONG&gt;openssl genrsa&lt;/STRONG&gt; phase, specifically:&lt;/P&gt;&lt;P&gt;"Generating a RSA private key&lt;BR /&gt;................................................................................++++&lt;BR /&gt;.....................................++++&lt;BR /&gt;writing new private key to 'ontap_mediator_server.key'"&lt;/P&gt;&lt;P&gt;During this time, system CPU usage spikes, and the following processes run continuously:&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;cat&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;tr&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;fold&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;These are related to the certificate-generation logic in &lt;STRONG&gt;make_self_signed_certs.sh.&lt;/STRONG&gt;&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;System Environment:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;Fresh RHEL 8.2 Azure VM&lt;/P&gt;&lt;P&gt;OpenSSL version: OpenSSL 1.1.1c FIPS 28 May 2019&lt;/P&gt;&lt;P&gt;Python 3.9 and dependencies installed manually via RPMs (offline install)&lt;/P&gt;&lt;P&gt;SELinux set to enforcing=0 before installation&lt;/P&gt;&lt;P&gt;No active entropy starvation; confirmed key generation works outside installer&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Steps Taken Before Final Success:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;Removed all previous mediator remnants:&lt;/P&gt;&lt;P&gt;rm -rf /opt/netapp /opt/ontap&lt;/P&gt;&lt;P&gt;sudo /usr/local/bin/uninstall_ontap_mediator&amp;nbsp;&lt;/P&gt;&lt;P&gt;Rebooted VM&lt;/P&gt;&lt;P&gt;Re-ran the installer with:&lt;/P&gt;&lt;P&gt;./ontap-mediator-1.9.1 --skip-code-signature-check --skip-yum-dependencies -y&lt;/P&gt;&lt;P&gt;Installer initially reported ontap_mediator.service failure, but auto-retries eventually started the service successfully.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Final State:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;ontap_mediator.service: running&lt;/P&gt;&lt;P&gt;mediator-scst.service: running&lt;/P&gt;&lt;P&gt;Web server started (uWSGI logs present)&lt;/P&gt;&lt;P&gt;Installer finished and moved logs to:&lt;BR /&gt;/opt/netapp/lib/ontap_mediator/log/install_&amp;lt;timestamp&amp;gt;.log&lt;/P&gt;&lt;P&gt;RSA certificate generation eventually passed (possibly due to retries)&lt;BR /&gt;&lt;BR /&gt;&lt;STRONG&gt;Workaround:&lt;/STRONG&gt;&lt;BR /&gt;Observed and discovered running processes which was stuck during installation with "&lt;STRONG&gt;top&lt;/STRONG&gt;" command&amp;nbsp;&lt;BR /&gt;Retrieved and terminated processes &amp;amp; installation script continued with next installation steps&lt;BR /&gt;ps aux | grep -E 'cat|fold|tr'&lt;BR /&gt;kill -9 &amp;lt;PID&amp;gt;&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Remaining Concerns:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;The fact that the installation hangs for indefinitely with high CPU usage indicates a potential bug or inefficiency in &lt;STRONG&gt;make_self_signed_certs.sh&lt;/STRONG&gt; — especially the handling of I/O with cat | tr | fold pipe chains.&lt;/P&gt;&lt;P&gt;The script does not fail gracefully, making it hard to debug without killing and re-attempting the installation.&lt;/P&gt;&lt;P&gt;This issue is reproducible across freshly provisioned RHEL 8.2 Azure VMs.&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Request:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;I’d appreciate if a NetApp engineer could:&lt;/P&gt;&lt;P&gt;Confirm whether this is a known bug in 1.9.1 (and fixed in a later version).&lt;/P&gt;&lt;P&gt;Suggest a clean workaround to avoid the hang without manual intervention.&lt;/P&gt;&lt;P&gt;Clarify whether the certificate generation script could be pre-patched or executed independently prior to install.&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;Thanks to anyone who reads this.&lt;/P&gt;</description>
    <pubDate>Fri, 27 Jun 2025 13:31:09 GMT</pubDate>
    <dc:creator>Samet</dc:creator>
    <dc:date>2025-06-27T13:31:09Z</dc:date>
    <item>
      <title>ONTAP Mediator 1.9.1 installation hangs on RHEL 8.2 (Azure VM) with "writing RSA key"</title>
      <link>https://community.netapp.com/t5/ONTAP-Discussions/ONTAP-Mediator-1-9-1-installation-hangs-on-RHEL-8-2-Azure-VM-with-quot-writing/m-p/461765#M45046</link>
      <description>&lt;P&gt;Hello,&amp;nbsp;&lt;BR /&gt;I am having installation hang problem while installing ONTAP Mediator 1.9.1&lt;BR /&gt;&lt;BR /&gt;How I try to install:&lt;BR /&gt;Extracted installer archive /opt/ontap/&lt;BR /&gt;and on&amp;nbsp;/opt/ontap/ontap-mediator-1.9.1 run:&lt;BR /&gt;./ontap-mediator-1.9.1&lt;BR /&gt;&lt;BR /&gt;last part of the installation log:&lt;/P&gt;
&lt;LI-CODE lang="markup"&gt;[2025-06-26 12:37:53]
[2025-06-26 12:37:53] If you want SCST to start automatically at boot time, run the following command:
[2025-06-26 12:37:53] systemctl enable scst.service
[2025-06-26 12:37:53]
[2025-06-26 12:37:53] make[1]: Leaving directory '/opt/ontap/ontap-mediator-1.9.1/ontap_mediator.Y5g7HJ/ontap-mediator-1.9.1/ontap-mediator-1.9.1/dist/scst/scst-3.8.0/scstadmin'
[2025-06-26 12:37:56] Saving SCST mod keys
[2025-06-26 12:37:56] Installing ONTAP Mediator server packages
[2025-06-26 12:37:56] Installing dist/rpm/ontap-mediator-*el8*
[2025-06-26 12:37:56] Preparing packages...
[2025-06-26 12:37:56] ontap-mediator-1.9.1-16.el8.noarch
[2025-06-26 12:38:25] Finalizing ontap_mediator module
[2025-06-26 12:38:25] Creating mediator service acount + group: netapp:netapp
[2025-06-26 12:38:25] Modifying ownership and permissions to mediator service acount + group: netapp:netapp
[2025-06-26 12:38:25] Configuring and setting ownership for mailbox_directory: /mnt/iscsi_space
[2025-06-26 12:38:26] Checking for pre-existing modification to pyenv/bin/uwsgi SElinux context...
[2025-06-26 12:38:26] No pre-existing modification found. Modifying context...
[2025-06-26 12:38:29] pyenv/bin/uwsgi context modified!
[2025-06-26 12:38:29] Adding Subject Alternative Names to the self-signed server certificate
[2025-06-26 12:38:29] #
[2025-06-26 12:38:29] # OpenSSL example configuration file.
[2025-06-26 12:38:29] Generating self-signed certificates
[2025-06-26 12:38:29] For root_ca.key:
[2025-06-26 12:38:29] Generating RSA private key, 4096 bit long modulus (2 primes)
[2025-06-26 12:38:30] .................................................................................................................++++
[2025-06-26 12:38:30] .........................................++++
[2025-06-26 12:38:30] e is 65537 (0x010001)
[2025-06-26 12:38:30] writing RSA key
[2025-06-26 12:38:30] For intermediate.key:
[2025-06-26 12:38:30] Generating RSA private key, 4096 bit long modulus (2 primes)
[2025-06-26 12:38:30] ..................++++
[2025-06-26 12:38:30] ..........................................................................................................................++++
[2025-06-26 12:38:30] e is 65537 (0x010001)
[2025-06-26 12:38:30] writing RSA key&lt;/LI-CODE&gt;
&lt;P&gt;&lt;BR /&gt;What I've Already Tried&lt;/P&gt;
&lt;UL&gt;
&lt;LI&gt;
&lt;P&gt;Fresh RHEL 8.2 Azure VM deployment (multiple times)&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;Installed all pre-req RPMs offline:&lt;/P&gt;
&lt;UL&gt;
&lt;LI&gt;
&lt;P&gt;python39, python39-libs, python39-devel&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;python39-pip-wheel, python39-setuptools-wheel&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;chkconfig-1.19.2 (since alternatives was a missing dep)&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;Verified entropy is &lt;STRONG&gt;not&lt;/STRONG&gt; the issue (e.g., /dev/random, getrandom() syscall monitored via strace)&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;getenforce was set to Enforcing, later changed to Permissive&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;Still, full installer &lt;STRONG&gt;hangs again&lt;/STRONG&gt; during the &lt;STRONG&gt;"writing RSA key"&lt;/STRONG&gt; phase&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;H3&gt;&amp;nbsp;Questions for the Community&lt;/H3&gt;
&lt;UL&gt;
&lt;LI&gt;
&lt;P&gt;Has anyone else seen the &lt;STRONG&gt;RSA generation hang&lt;/STRONG&gt; on RHEL 8.2 / Azure specifically?&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;Is there a known bug in Mediator 1.9.1 related to the cert gen script?&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;Could there be an issue with OpenSSL or Azure's VM entropy model, even though it's not /dev/random related?&lt;/P&gt;
&lt;/LI&gt;
&lt;LI&gt;
&lt;P&gt;Is there a fully manual install method that bypasses the RSA keygen part?&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;Thank you in advance.&lt;/P&gt;</description>
      <pubDate>Thu, 26 Jun 2025 17:24:38 GMT</pubDate>
      <guid>https://community.netapp.com/t5/ONTAP-Discussions/ONTAP-Mediator-1-9-1-installation-hangs-on-RHEL-8-2-Azure-VM-with-quot-writing/m-p/461765#M45046</guid>
      <dc:creator>Samet</dc:creator>
      <dc:date>2025-06-26T17:24:38Z</dc:date>
    </item>
    <item>
      <title>Re: ONTAP Mediator 1.9.1 installation hangs on RHEL 8.2 (Azure VM) with "writing RSA key"</title>
      <link>https://community.netapp.com/t5/ONTAP-Discussions/ONTAP-Mediator-1-9-1-installation-hangs-on-RHEL-8-2-Azure-VM-with-quot-writing/m-p/461777#M45048</link>
      <description>&lt;P&gt;Hi all,&lt;/P&gt;&lt;P&gt;I'd like to share detailed findings and progress on the ONTAP Mediator 1.9.1 installation issue I previously posted about, where the installer was hanging indefinitely during RSA key generation on a RHEL 8.2 Azure VM.&lt;BR /&gt;&lt;BR /&gt;&lt;STRONG&gt;Root Issue Observed:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;The installation process repeatedly hangs at the &lt;STRONG&gt;openssl genrsa&lt;/STRONG&gt; phase, specifically:&lt;/P&gt;&lt;P&gt;"Generating a RSA private key&lt;BR /&gt;................................................................................++++&lt;BR /&gt;.....................................++++&lt;BR /&gt;writing new private key to 'ontap_mediator_server.key'"&lt;/P&gt;&lt;P&gt;During this time, system CPU usage spikes, and the following processes run continuously:&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;cat&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;tr&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;fold&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;These are related to the certificate-generation logic in &lt;STRONG&gt;make_self_signed_certs.sh.&lt;/STRONG&gt;&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;System Environment:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;Fresh RHEL 8.2 Azure VM&lt;/P&gt;&lt;P&gt;OpenSSL version: OpenSSL 1.1.1c FIPS 28 May 2019&lt;/P&gt;&lt;P&gt;Python 3.9 and dependencies installed manually via RPMs (offline install)&lt;/P&gt;&lt;P&gt;SELinux set to enforcing=0 before installation&lt;/P&gt;&lt;P&gt;No active entropy starvation; confirmed key generation works outside installer&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Steps Taken Before Final Success:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;Removed all previous mediator remnants:&lt;/P&gt;&lt;P&gt;rm -rf /opt/netapp /opt/ontap&lt;/P&gt;&lt;P&gt;sudo /usr/local/bin/uninstall_ontap_mediator&amp;nbsp;&lt;/P&gt;&lt;P&gt;Rebooted VM&lt;/P&gt;&lt;P&gt;Re-ran the installer with:&lt;/P&gt;&lt;P&gt;./ontap-mediator-1.9.1 --skip-code-signature-check --skip-yum-dependencies -y&lt;/P&gt;&lt;P&gt;Installer initially reported ontap_mediator.service failure, but auto-retries eventually started the service successfully.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Final State:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;ontap_mediator.service: running&lt;/P&gt;&lt;P&gt;mediator-scst.service: running&lt;/P&gt;&lt;P&gt;Web server started (uWSGI logs present)&lt;/P&gt;&lt;P&gt;Installer finished and moved logs to:&lt;BR /&gt;/opt/netapp/lib/ontap_mediator/log/install_&amp;lt;timestamp&amp;gt;.log&lt;/P&gt;&lt;P&gt;RSA certificate generation eventually passed (possibly due to retries)&lt;BR /&gt;&lt;BR /&gt;&lt;STRONG&gt;Workaround:&lt;/STRONG&gt;&lt;BR /&gt;Observed and discovered running processes which was stuck during installation with "&lt;STRONG&gt;top&lt;/STRONG&gt;" command&amp;nbsp;&lt;BR /&gt;Retrieved and terminated processes &amp;amp; installation script continued with next installation steps&lt;BR /&gt;ps aux | grep -E 'cat|fold|tr'&lt;BR /&gt;kill -9 &amp;lt;PID&amp;gt;&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Remaining Concerns:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;The fact that the installation hangs for indefinitely with high CPU usage indicates a potential bug or inefficiency in &lt;STRONG&gt;make_self_signed_certs.sh&lt;/STRONG&gt; — especially the handling of I/O with cat | tr | fold pipe chains.&lt;/P&gt;&lt;P&gt;The script does not fail gracefully, making it hard to debug without killing and re-attempting the installation.&lt;/P&gt;&lt;P&gt;This issue is reproducible across freshly provisioned RHEL 8.2 Azure VMs.&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Request:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;I’d appreciate if a NetApp engineer could:&lt;/P&gt;&lt;P&gt;Confirm whether this is a known bug in 1.9.1 (and fixed in a later version).&lt;/P&gt;&lt;P&gt;Suggest a clean workaround to avoid the hang without manual intervention.&lt;/P&gt;&lt;P&gt;Clarify whether the certificate generation script could be pre-patched or executed independently prior to install.&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;Thanks to anyone who reads this.&lt;/P&gt;</description>
      <pubDate>Fri, 27 Jun 2025 13:31:09 GMT</pubDate>
      <guid>https://community.netapp.com/t5/ONTAP-Discussions/ONTAP-Mediator-1-9-1-installation-hangs-on-RHEL-8-2-Azure-VM-with-quot-writing/m-p/461777#M45048</guid>
      <dc:creator>Samet</dc:creator>
      <dc:date>2025-06-27T13:31:09Z</dc:date>
    </item>
  </channel>
</rss>

