DataFeeds Periodically Gets Recovering Status

Asset ID:	1-72-1980663.1
Update Date:	2017-11-05
Keywords:

Solution Type Problem Resolution Sure

Solution 1980663.1 : DataFeeds Periodically Gets Recovering Status

Applies to:

Oracle Communications Performance Intelligence Center (PIC) Software - Version 10.1.0 and later
Information in this document applies to any platform.

Symptoms

Some Datafeed configured to export data to customer export server are not working. DataExport process is unable to mount the nfs share:

[root@ixp0001-1a ~]# tail -f /var/TKLC/log/dataexport/dataexport.log
2015-02-06 13:22:09,978|ERROR|FileFeed-43351|FileExporter: Can't create mount path. Probable causes: 1. Export server (ES) IP_ADDRES is down. 2. NFS service on ES is not running. 3. Mount point can not be read locally.; cause:
2015-02-06 13:23:09,963|INFO|FileFeed-43351|FileExporter: Activated
2015-02-06 13:23:09,963|INFO|FileFeed-43351|FlexibleExportStatusProxy: Feed(43351): STATUS: InProgress: EXPORTING; lastExport: FAILURE -> OK;
2015-02-06 13:23:09,969|INFO|FileFeed-43351|FlexibleExporter: Config = NFS; ID=43351; MountDir=/xxx/xxxc; RemoteDir=xxxxx; RemoteServer=IP_ADDRESS; maxReconnect=0; maxProtocolError=0; maxFiles=0;
2015-02-06 13:24:10,495|INFO|FileFeed-41541|MountManager: mount() : Reachability test = OK; path = Can't translate path! NFS service is down.
2015-02-06 13:24:10,496|INFO|FileFeed-41541|FlexibleExportStatusProxy: Feed(41541): STATUS: InProgress: EXPORTING; lastExport: OK -> FAILURE;
2015-02-06 13:24:10,497|ERROR|FileFeed-41541|FileExporter: Can't create mount path. Probable causes: 1. Export server (ES) IP_ADDRESS is down. 2. NFS service on ES is not running. 3. Mount point can not be read locally.; cause:
2015-02-06 13:25:10,496|INFO|FileFeed-41541|FileExporter: Activated
2015-02-06 13:25:10,497|INFO|FileFeed-41541|FlexibleExportStatusProxy: Feed(41541): STATUS: InProgress: EXPORTING; lastExport: FAILURE -> OK;
2015-02-06 13:25:10,504|INFO|FileFeed-41541|FlexibleExporter: Config = NFS; ID=41541; MountDir=/xxx/xxxc; RemoteDir=GN; RemoteServer=IP_ADDRES; maxReconnect=0; maxProtocolError=0; maxFiles=0;
2015-02-06 13:26:10,661|INFO|FileFeed-43351|MountManager: mount() : Reachability test = OK; path = Can't translate path! NFS service is down.
2015-02-06 13:26:10,661|INFO|FileFeed-43351|FlexibleExportStatusProxy: Feed(43351): STATUS: InProgress: EXPORTING; lastExport: OK -> FAILURE;
2015-02-06 13:26:10,663|ERROR|FileFeed-43351|FileExporter: Can't create mount path. Probable causes: 1. Export server (ES) IP_ADDRES is down. 2. NFS service on ES is not running. 3. Mount point can not be read locally.; cause:

Cause

THe following error in the log /var/TKLC/log/dataexport/dataexport.log : "Reachability test = OK; path = Can't translate path! NFS service is down." is triggered when the mounted NFS share cannot be tested with showmount command. This means the showmount command fails when testing the customer export server, here is the command user by dataexport:

[cfguser@ixp0001-1a ~]$ sudo /usr/sbin/showmount -e IP_Address
clnt_create: RPC: Port mapper failure - Timed out
[cfguser@ixp0001-1a ~]$

Solution

The "clnt_create: RPC: Port mapper failure - Timed out" error is triggered when showmount is not allowed to test the nfs share this is usually caused by port 111 blocked by customer firewall.

Customer needs to modify firewall rules to allow port 111.

[root@ixp-0001a ~]# nmap -sU -Pn IP_ADDRESS -p111
Nmap scan report for 10.9.2.1
Host is up.
PORT STATE SERVICE
111/udp open|filtered rpcbind

References

<BUG:20528676> - IP PORT 111 MUST BE OPENED BETWEEN IXP AND EXPORT SERVER

Attachments

This solution has no attachment