how to remove running jobs not visible in Jobmonitor

SVOLLRAT1 · ‎2014-01-09

Hi Everybody

We have a slight Problem with SnapCreator.

The Job-Database states that there are still two Jobs in running state that are no longer reachable in Job Monitor.

Any suggestion how to get rid of them?

BR

Stefan

sivar · ‎2014-01-09

Hello Stefan,

I haven't seen an instance where zombie jobs exist.

What kind of jobs (plugins) are these?

Does the 2 zombie jobs still persist, after a snap creator server restart?

What is the output of jobStatus command?

./snapcreator --server <IP> --port <Port> --user <User> --passwd <Passwd> --action jobStatus --verbose

Thanks,
Siva Ramanathan

SVOLLRAT1 · ‎2014-01-09

Hello Siva

The Zombies or incorrect Entries are in the Database.

Processes on Agent-Side are already down.

I believe the issue was caused by restarting the scServer (every now and then the GUI is not reachable, still not fixed issue).

A Backup-Job was probably running at that time and the Database didn’t set the status properly after restart.

Output of the requested command is attached.

Freundliche Grüsse / Kind Regards

Stefan Vollrath

T-Systems Schweiz AG

Storage & Backup Operations

Stefan Vollrath

Storage Engineer

Murgenthalstrasse 12, CH-4901 Langenthal

+41 (0) 78 645 1076 (phone)

E-Mail: stefan.vollrath@t-systems.com

http://www.t-systems.ch<http://www.t-systems.ch/>

Notice: This transmittal and/or attachments may be privileged or confidential. If you are not the intended recipient, you are hereby notified that you have received this transmittal in error; any review, dissemination, or copying is strictly prohibited. If you received this transmittal in error, please notify us immediately by reply and immediately delete this message and all its attachments. Thank you.

Von: Siva Ramanathan

Gesendet: Donnerstag, 9. Januar 2014 16:26

An: Vollrath, Stefan

Betreff: - Re: how to remove running jobs not visible in Jobmonitor

<https://communities.netapp.com/index.jspa>

Re: how to remove running jobs not visible in Jobmonitor

created by Siva Ramanathan<https://communities.netapp.com/people/sivar> in Snap Creator - View the full discussion<https://communities.netapp.com/message/123330#123330>

Hello Stefan,

I haven't seen an instance where zombie jobs exist.

What kind of jobs (plugins) are these?

Does the 2 zombie jobs still persist, after a snap creator server restart?

What is the output of jobStatus command?

./snapcreator --server <IP> --port <Port> --user <User> --passwd <Passwd> --action jobStatus --verbose

Thanks,

Siva Ramanathan

Reply to this message by replying to this email -or- go to the message on NetApp Community<https://communities.netapp.com/message/123330#123330>

Start a new discussion in Snap Creator by email<mailto:discussions-community-products_and_solutions-databases_and_enterprise_apps-snapcreator@communities.netapp.com> or at NetApp Community<https://communities.netapp.com/choose-container.jspa?contentType=1&containerType=14&container=2481>

sivar · ‎2014-01-09

Stefan,

Sorry about the GUI issue you are referring.

Few of our customers have got around the GUI issue by increasing Java memory settings.

Also customers who have Snap Creator on Solaris boxes got around this issue by custom defining /tmp path for the Snap Creator GUI. (since it was found that /tmp was cleaned by Solaris automatically and ended up causing GUI issues for Snap Creator server).

If you have a support case on the GUI issue, please let me know. I will follow up with NetApp support.

I see only one job flagged as running.

Is this what you are trying to kill?
Are you able to kill it by the cancel button in the GUI? (if you increase job monitor size it may be visible)

19468	successful	CH_TR	CH_TR_DOML_CHLNHUB01	CH_TR_DOML_CHLNHUB01 Scheduled	scadmin	backup	2013-12-30T07:18:29.205+01:00 2013-12-30T07:19:15.976+01:00
19469	running	CH_CT	CH_CT_SMVI_EV	CH_CT_SMVI_EV	Scheduled	scadmin	backup	2013-12-30T07:30:00.053+01:00 -
19470	successful	CH_TR	CH_TR_DOML_CHLNARC01	CH_TR_DOML_CHLNARC01 Scheduled	scadmin	backup	2013-12-30T08:18:29.306+01:00 2013-12-30T08:18:51.262+01:00

SVOLLRAT1 · ‎2014-01-09

Hi Again

Job Monitor is at its max with 1000 Lines, so from GUI it is out of reach.

Any way to cancel via CLI?

Freundliche Grüsse / Kind Regards

Stefan Vollrath

T-Systems Schweiz AG

Storage & Backup Operations

Stefan Vollrath

Storage Engineer

Murgenthalstrasse 12, CH-4901 Langenthal

+41 (0) 78 645 1076 (phone)

E-Mail: stefan.vollrath@t-systems.com

http://www.t-systems.ch<http://www.t-systems.ch/>

Notice: This transmittal and/or attachments may be privileged or confidential. If you are not the intended recipient, you are hereby notified that you have received this transmittal in error; any review, dissemination, or copying is strictly prohibited. If you received this transmittal in error, please notify us immediately by reply and immediately delete this message and all its attachments. Thank you.

Von: Siva Ramanathan

Gesendet: Donnerstag, 9. Januar 2014 16:59

An: Vollrath, Stefan

Betreff: - Re: how to remove running jobs not visible in Jobmonitor

<https://communities.netapp.com/index.jspa>

Re: how to remove running jobs not visible in Jobmonitor

created by Siva Ramanathan<https://communities.netapp.com/people/sivar> in Snap Creator - View the full discussion<https://communities.netapp.com/message/123334#123334>

Stefan,

Sorry about the GUI issue you are referring.

Few of our customers have got around the GUI issue by increasing Java memory settings.

Also customers who have Snap Creator on Solaris boxes got around this issue by custom defining /tmp path for the Snap Creator GUI. (since it was found that /tmp was cleaned by Solaris automatically and ended up causing GUI issues for Snap Creator server).

If you have a support case on the GUI issue, please let me know. I will follow up with NetApp support.

I see only one job flagged as running.

Is this what you are trying to kill?

Are you able to kill it by the cancel button in the GUI? (if you increase job monitor size it may be visible)

19468

successful

CH_TR

CH_TR_DOML_CHLNHUB01

CH_TR_DOML_CHLNHUB01 Scheduled

scadmin

backup

2013-12-30T07:18:29.20501:00 2013-12-30T07:19:15.97601:00

19469

running

CH_CT

CH_CT_SMVI_EV

Scheduled

scadmin

backup

2013-12-30T07:30:00.053+01:00 -

19470

successful

CH_TR

CH_TR_DOML_CHLNARC01

CH_TR_DOML_CHLNARC01 Scheduled

scadmin

backup

2013-12-30T08:18:29.30601:00 2013-12-30T08:18:51.26201:00

Reply to this message by replying to this email -or- go to the message on NetApp Community<https://communities.netapp.com/message/123334#123334>

Start a new discussion in Snap Creator by email<mailto:discussions-community-products_and_solutions-databases_and_enterprise_apps-snapcreator@communities.netapp.com> or at NetApp Community<https://communities.netapp.com/choose-container.jspa?contentType=1&containerType=14&container=2481>

sivar · ‎2014-01-09

Unfortunately, there is no way to cancel from the CLI.

I am trying to see alternatives. (like our powershell cmdlet).

I will test this in the lab and let you know.

Is it causing your scheduled jobs to fail in anyway? (of the profile/config)

CH_CT

CH_CT_SMVI_EV

SVOLLRAT1 · ‎2014-01-09

Hi

Other Jobs that are in failed Status usually had its reason on the Agent-Side f.E. failed Quiesce Script or on SMVI-Commandlet.

Colleague of mine just created a script that dumps the Job-DB and extracts long running jobs out of there and creates alerts based on that.

Due to these unreachable Jobs, already canceled but not mentioned that way in DB, we have daily Tickets that start to annoy us.

Freundliche Grüsse / Kind Regards

Stefan Vollrath

T-Systems Schweiz AG

Storage & Backup Operations

Stefan Vollrath

Storage Engineer

Murgenthalstrasse 12, CH-4901 Langenthal

+41 (0) 78 645 1076 (phone)

E-Mail: stefan.vollrath@t-systems.com

http://www.t-systems.ch<http://www.t-systems.ch/>

Notice: This transmittal and/or attachments may be privileged or confidential. If you are not the intended recipient, you are hereby notified that you have received this transmittal in error; any review, dissemination, or copying is strictly prohibited. If you received this transmittal in error, please notify us immediately by reply and immediately delete this message and all its attachments. Thank you.

Von: Siva Ramanathan

Gesendet: Donnerstag, 9. Januar 2014 17:28

An: Vollrath, Stefan

Betreff: - Re: how to remove running jobs not visible in Jobmonitor

<https://communities.netapp.com/index.jspa>

Re: how to remove running jobs not visible in Jobmonitor

created by Siva Ramanathan<https://communities.netapp.com/people/sivar> in Snap Creator - View the full discussion<https://communities.netapp.com/message/123336#123336>

Unfortunately, there is no way to cancel from the CLI.

I am trying to see alternatives. (like our powershell cmdlet).

I will test this in the lab and let you know.

Is it causing your scheduled jobs to fail in anyway? (of the profile/config)

CH_CT

CH_CT_SMVI_EV

Reply to this message by replying to this email -or- go to the message on NetApp Community<https://communities.netapp.com/message/123336#123336>

Start a new discussion in Snap Creator by email<mailto:discussions-community-products_and_solutions-databases_and_enterprise_apps-snapcreator@communities.netapp.com> or at NetApp Community<https://communities.netapp.com/choose-container.jspa?contentType=1&containerType=14&container=2481>