How can I tell which pipeline processed my data? How can I tell if my data have been reprocessed under the most recent pipelines?
Posted by z-Schuyler Van Dyk on 02 December 2008 12:08 PM
This is a multi-step process at least at the moment.|
- Check the header of one of your BCD files and look for the keyword 'CREATOR'. (e.g., imhead blah_bcd.fits | grep CREATOR) This is the software version used to process your data.
- Check the pipeline history file for your instrument. It can be found in Appendix A of the Instrument Handbooks. If the value of your file's CREATOR is a number greater than or equal to the largest number on the pipeline history page, you've got the most recent version. If it does NOT match, keep reading.
- Check the header of one of your BCD files and look for the keyword 'DATE_OBS'. (e.g., imhead blah_bcd.fits | grep DATE_OBS) This is the date your object was observed.
- Check the schedules page and find the date of your observation. Make a note of the campaign, e.g., MIPS-2 or IRS-23.
- Check the processing status page and find your campaign. Locate the pipeline version of the last reprocessed data (second column).
- If this number is equal to (or close to, e.g., 12.5 vs. 12.3) the number found in your CREATOR keyword, you still have the best data currently available. If the number there is also less than the highest value in the pipeline history file, there might be reprocessing going on. Watch the the processing status page to see when your campaign is reprocessed.
- If this number is greater than the number found in your CREATOR keyword, you probably should go get the most recent data out of the archive using Leopard. Note that not all pipeline versions make significant changes to all data; see the pipeline history file (it can be found in Appendix A of the Instrument Handbooks) to see if you should go get the most recent data out of the archive.