2010-03-01

Data processing at CADC

Right now we are having trouble reducing SCUBA-2 data for the JCMT Science Archive (JSA).Briefly the problems seem to be:

  • The JSA wrapper is reporting success even in some cases of failure
  • Some maps take so long to make that MAKEMAP is timing out during long maps (this will also affect processing on private computers)
  • There is a bizarre NFS problem on the processing nodes that causes required perl modules to "disappear" when the pipeline is looking for them.
We're working through fixing these, so until then availability for products is a bit patchy. The good news is that processing throughput is great, so catching up with the backlog does not seem to  be a problem.

No comments: