Cloudstack wizard is getting stuck storage traffic on version 4.20

[verendrakalsi]

Ubuntu 22.04.5 LTS
Cloustack version :- 4.20

we have install cloudstack agent on 4 hosts and 1 hosts with cloudstack mgmt. After installing when we are trying to run the cloudstack mgmt wizard, it is getting stuck on the storage traffic section.

The Section creates the zone, pod, cluster, add the host, & Primary and secondary storage but after that nothing and it keep spinnig on the wizard at storage traffic section.

[verendrakalsi]

its getting stuck here.

[verendrakalsi]

looks like some issue with monuting the secondary storage
Failed to create netfs mount: 10.10.10.12:/KVMSecondary1/template/tmpl/1/3 org.libvirt.LibvirtException: internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec 10.10.10.12:/KVMSecondary1/template/tmpl/1/3 /mnt/d702e2f4-ecde-318b-b04e-a3cf1bab9afd) unexpected exit status 32: mount.nfs: mounting 10.10.10.12:/KVMSecondary1/template/tmpl/1/3 failed, reason given by server: No such file or directory

[Pearl1594]

@verendrakalsi Does /KVMSecondary1/ path exist on the secondary store: 10.10.10.12?

[verendrakalsi]

yes, it does. now this issue is resolved.

but now i am getting this error

2025-03-10 20:32:02,961 ERROR [cloud.agent.AgentShell] (main:[]) (logid:) Unable to start agent: javax.naming.ConfigurationException: Unable to configure LibvirtComputingResource
at com.cloud.agent.Agent.(Agent.java:196)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:453)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:432)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:416)
at com.cloud.agent.AgentShell.start(AgentShell.java:512)
at com.cloud.agent.AgentShell.main(AgentShell.java:542)

[Pearl1594]

Can you please share the entire stacktrace. Thanks

[DaanHoogland]

@verendrakalsi , the stacktrace as a "Cause", this is what @Pearl1594 is interested in.

Also can you add the log lines leading up to this stacktrace. Especially the ones containing LibvirtComputingResource or AgentShell?

[verendrakalsi]

this is what you are looking for ?

2025-03-11 14:11:17,825 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Agent started
2025-03-11 14:11:17,830 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Implementation Version is 4.20.0.0
2025-03-11 14:11:17,831 INFO [cloud.agent.AgentShell] (main:[]) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
2025-03-11 14:11:17,870 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Defaulting to using properties file for storage
2025-03-11 14:11:17,871 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Defaulting to the constant time backoff algorithm
2025-03-11 14:11:17,895 INFO [cloud.utils.LogUtils] (main:[]) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2025-03-11 14:11:17,895 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Using default Java settings for IPv6 preference for agent connection
2025-03-11 14:11:17,948 INFO [cloud.agent.Agent] (main:[]) (logid:) id is 0
2025-03-11 14:11:17,953 WARN [kvm.resource.LibvirtComputingResource] (main:[]) (logid:) Incorrect details for private Nic during initialization of ServerResourceBase
2025-03-11 14:11:17,953 ERROR [cloud.agent.AgentShell] (main:[]) (logid:) Unable to start agent: javax.naming.ConfigurationException: Unable to configure LibvirtComputingResource
at com.cloud.agent.Agent.(Agent.java:196)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:453)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:432)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:416)
at com.cloud.agent.AgentShell.start(AgentShell.java:512)
at com.cloud.agent.AgentShell.main(AgentShell.java:542)

[verendrakalsi]

2025-03-11T20:53:36,178 WARN [cloud.agent.Agent] (agentRequest-Handler-1:[]) Caught: com.cloud.utils.exception.CloudRuntimeException: Failed to get root directory from secondary storage URL [nfs://10.10.10.12/KVMSecondary1], using NFS version [null], due to [Unable to mount 10.10.10.12:/KVMSecondary1 at /mnt/SecStorage/bd7fe518-f806-3eee-92f9-0819535406ae due to mount.nfs: Connection timed out].
at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.getRootDir(NfsSecondaryStorageResource.java:2675)
at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.execute(NfsSecondaryStorageResource.java:2407)
at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.executeRequest(NfsSecondaryStorageResource.java:298)
at com.cloud.storage.resource.PremiumSecondaryStorageResource.defaultAction(PremiumSecondaryStorageResource.java:62)
at com.cloud.storage.resource.PremiumSecondaryStorageResource.executeRequest(PremiumSecondaryStorageResource.java:58)
at com.cloud.agent.Agent.processRequest(Agent.java:686)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1109)
at com.cloud.utils.nio.Task.call(Task.java:83)
at com.cloud.utils.nio.Task.call(Task.java:29)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to mount 10.10.10.12:/KVMSecondary1 at /mnt/SecStorage/bd7fe518-f806-3eee-92f9-0819535406ae due to mount.nfs: Connection timed out
at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.attemptMount(NfsSecondaryStorageResource.java:3081)
at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.mount(NfsSecondaryStorageResource.java:3032)
at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.mountUri(NfsSecondaryStorageResource.java:3020)
at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.getRootDir(NfsSecondaryStorageResource.java:2671)
... 12 more

2025-03-11T20:54:36,351 INFO [storage.resource.NfsSecondaryStorageResource] (agentRequest-Handler-2:[]) Determined host 10.10.10.12 corresponds to IP 10.10.10.12

[DaanHoogland]

@verendrakalsi , there still seems to be an issue with your NFS mount ; "Unable to mount 10.10.10.12:/KVMSecondary1 at /mnt/SecStorage/bd7fe518-f806-3eee-92f9-0819535406ae due to mount.nfs: Connection timed out"