Subscribe

Checking the "srm walk" process status

Hello,

Can I check the status of "fsrm walk" process?

I can see the following command. But I can't find out the way whether the walking it doing or not.

Start: dfm srm walk start

Stop: dfm srm walk stop

Thanks,

Ogata, Toshiyasu

Re: Checking the "srm walk" process status

=> In Web UI, there is a way to identify whether the srm walk is in progress or not.

In SRM Path Details page, if you see "Stop" button there, it means that SRM walk is in progress (running)

In SRM Path Details page, if you see "Start" button there, it means that SRM walk is not in progress.

=> In CLI, Executing the "srm walk start/stop" commands repeatedly will help us to know whether the walk is in progress or not.

# dfm srm walk start win1:C:
SUA

Started walk on win1:C:\SUA.

# dfm srm walk start win1:C:
SUA

Walk on win1:C:\SUA is still running.

#

During this check, if the srm walk is started mistakenly, you can very well stop it using "srm walk stop" command immediately.

Regards,

Saravanan

Re: Checking the "srm walk" process status

There is one more command "dfm srm path list" available in CLI which can tell you whether the walk is in progress. "dfm srm path list" has Walk Status in its output.

Other than the running status, you wont be able to get any other statistics till the walk completes.

Regards,

Saravanan

Re: Checking the "srm walk" process status

Thanks for informataion.

I checked and can see "running - Loading into database" after executing "dfm srm path list".

The amount data on path is only 2GB. From GUI it seems walk is completed. But "dfm srm path list"

is still running. it takes more than 100 minutes...

Is this behavior normal?

Best regards,

Ogata, Toshiyasu

Re: Checking the "srm walk" process status

Hi Toshiyasu Ogata,

The amount data on path is only 2GB.

The no. of files/directories & the depth of the Filesystem tree matters most for FSRM walk.

Is this behavior normal?

No, this seems to be abnormal.

Is this happening for all the FSRM paths?

Regards,

Prasad

Re: Checking the "srm walk" process status

Hello,

After restarting sybase database and re-executing "srm walk", then status became "completed".

By the way,

The no. of files/directories & the depth of the Filesystem tree matters most for FSRM walk.

Regarding time to walk, do you have a  rough guide line such as "10 minutes per 1,000,000 file for walking to finish "(or best practice paper)?

Thanks,

Re: Checking the "srm walk" process status

>"(or best practice paper)?

As of now we do not have any best practice paper for FSRM.

Not sure if someone is secretly preparing for one

In the lab we have observed a single agent doing filewalks at 5-10 million file per hour, on a filer that wasn't under load. Splitting up the data into multiple paths walked by multiple agents should bring that time down significantly, unless all those files are on a single filer. If the filer is under load part of the day, the filewalks should be done at a time when it's not under load, to minimize the performance impact.

CPU speed has the biggest impact on filewalk performance.

Network performance is also important.

Host agents should have a medium-high bandwidth and very low latency connection to the filer for best performance.

Host agent memory and disk speed has little impact on performance, unless the filewalk is of a local disk, then disk speed and memory do matter.

The number of filewalks is limited only by the number and speed of the host agents. DFM is not involved in the process of filewalking at all.

Re: Checking the "srm walk" process status

I could give some of the best possible advices(from our team)

1. Run SRM walk at different schedules.

And also while the filer is being used sparingly.

Filers under heavy load can be considerably slower.

2. Do not schedule multiple, simultaneous SRM path walks on the same host agent

3. Install multiple host agent & distribute the paths.

The number of filewalks is limited only by the number and speed of the host agents.

Re: Checking the "srm walk" process status

Thanks for your assistance!

Ogata, Toshiyasu