PostgreSQL cluster resoruce type backup is failing

[sarita_yadav]

Hello,

I am getting error in taking a PostgreSQL cluster data backup in SnapCenter. I have installed the plugin on the host, added the resource type cluster and tried backing up. I have mentioned the parameters(USER, PATH etc) in .profile on the host. I have created a Run as credential for postgres OS user and I am using that for backup. Please let me know if I am missing anything.

Plugin location on the host: /opt/NetApp/snapcenter/scc/plugins/perl/PostgreSQL/PostgreSQL.pm

Environment variables on the host: export USER=postgres
export PSQL_CMD=/usr/pgsql-11/bin
export NO_PASSWORD_OPTION=Y
export ARCHIVE_LOGGING_ENABLED=N

PATH=/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/postgres/.local/bin:/home/postgres/bin:/usr/pgsql-11/bin:/usr/pgsql-11/lib:/usr/pgsql-11/bin:/usr/pgsql-11/lib:/usr/pgsql-11/bin:/usr/pgsql-11/lib

PGDATA=/pgdata/db01/data/pgdata

I am getting the below error:

SCC-00164: Application quiesce for plug-in [PostgreSQL] failed with exit code [-1] and with
error :
Invalid/No user details provided for dd0001abca
SCC-00161: Application unquiesce for plug-in [PostgreSQL] failed with exit code [-1] and error :
Invalid/No user details provided for dd0001abca
SCC-00185: Cleanup for plug-in [PostgreSQL] failed with exit code [102] and error:
Status
SnapCenter Backup Detail Report
08/

Thanks!

[sarita_yadav]

Can someone please help in resolving the issue.

Thanks!

[Narendere · Accepted solution]

try to change 

PSQL_CMD: to full path, in my case its 

PSQL_CMD= /usr/pgsql-10/bin/psql

attached resource parameters for reference 

[sarita_yadav]

Thanks very much for the solution. I am not getting invalid user error after modifying the resource settings.

But the backup is still giving error and it keeps on running without failing. Please see the attached screenshots and below error log:

2019-09-06T05:10:07.0000552-04:00 TRACE [pool-4-thread-382] 114 com.netapp.snapcreator.agent.nextgen.operationmanager.OperationManagerImpl -getOperationResult() - operation={quiesce}, type={class com.netapp.snapcreator.agent.nextgen.common.result.Result}
2019-09-06T05:10:07.0000552-04:00 ERROR [pool-4-thread-382] 171 com.netapp.snapcreator.workflow.util.TaskUtil -Operation failed. Reason: The watchdog killed the running operation. Verify that plugins/wrapper/wrapper binary has execute permission set. Increase the WRAPPER_TIMEOUT_IN_MSEC value in agent.properties if operations require more time to complete.
2019-09-06T05:10:07.0000552-04:00 ERROR [pool-4-thread-382] 252 com.netapp.snapcreator.workflow.Task -Operation failed. Reason: The watchdog killed the running operation. Verify that plugins/wrapper/wrapper binary has execute permission set. Increase the WRAPPER_TIMEOUT_IN_MSEC value in agent.properties if operations require more time to complete.
2019-09-06T05:10:07.0000552-04:00 ERROR [pool-4-thread-382] 100 com.netapp.snapcreator.workflow.task.Quiesce -SCC-00164: Application quiesce for plug-in [PostgreSQL] failed with exit code [102] and with error :
2019-09-06T05:10:07.0000552-04:00 DEBUG [pool-4-thread-382] 133 com.netapp.snapcreator.workflow.impl.SCTaskCallableBlocking -Task quiesce completed for job Id : 73691 and workflow id : 67
2019-09-06T05:10:07.0000552-04:00 DEBUG [pool-3-thread-35] 133 com.netapp.snapcreator.workflow.impl.TaskExecutorBlocking -Task completed:quiesce for workflow id:67
2019-09-06T05:10:07.0000553-04:00 DEBUG [pool-3-thread-35] 133 com.netapp.snapcreator.workflow.WorkflowExecutor -Task execution failed for task:quiesce for workflow:backup with workflow id:67
2019-09-06T05:10:07.0000554-04:00 DEBUG [pool-8-thread-37] 133 com.netapp.snapcreator.workflow.notifier.impl.JobStatusNotifierImpl -UpdateJobStatus : Name(Backup) JobId(73691) Status(FAILED) JobPercentComplete(-1) Level(dd0001bbca-genworth-net_backup) ParentLevel(dd0001bbca-genworth-net)

[Narendere]

can you try to increase the  WRAPPER_TIMEOUT_IN_MSEC=3600000 in agent.properties

 and also to change Enable consistency group backup valude from Urgent to Relaxed in GUI Backup settngs.

check for the persmission for the below file (hopfully it should have execute perms)

/opt/NetApp/snapcenter/scc/plugins/wrapper/wrapper

[sarita_yadav]

Thanks! The below settings are already set as you mentioned.

-rw-r--r--. 1 root root 811 Jul 26 2018 agent.properties

WRAPPER_TIMEOUT_IN_MSEC=3600000

-r-xr-xr-x. 1 root root 4.1M Jul 26 2018 wrapper

I have modified enable consistency group backup value to Relaxed now. Do we need to set anything in the custom configurations or scripts in backup GUI? Or any other setting that I am missing?

I do see some files getting created in /tmp during this time.

cat r6Ha1B9OD_.sc
select pg_start_backup('xxxx_PostgreSQL_xxxx-cluster_xxxx_09-06-2019_04.09.53.3962')

cat GnVAJEdklm.sc
select pg_stop_backup()

Appreciate your assistance.

[Narendere]

configuration looks good,  check /tmp is mounted with correct options

servername#:   mount | grep /tmp
/dev/mapper/Core-lvTmp on /tmp type ext4 (rw,relatime,seclabel,data=ordered)

[sarita_yadav]

The backup is succeeding now after correcting the variables in the resource settings.

Thanks very much for the assistance.