Data Processing Checklist for Astrometric Data Reduction

The purpose of this document is to define standard procedures for processing astrometric data frames for the Deep Ecliptic Survey. Methods of accomplishing the items on this checklist will be documented elsewhere. NOTE: if you are creating any files outside of the Lowell network and copying them to gryll, make sure the file and directory permissions are correct.

• Create super bias frame (may already exist from another night in the same run).
• Create super flat frame (may already exist from another night in the same run).
• Debias/flatten data, only process good data.
• Push flattened data to MIT and Lowell as you go.
• Repair header anomalies as data are taken.

• Determine object aperture size for the night (DOFWHM).
• Extract source lists (PROC which drives FINDSRC) (can be in parallel with astrom).
• Run MOSPLOT (which drives MOSAST which drives ASTROM). Note that you need to run MOSAST once on each chip to start.
• Run MOSCHECK and iterate with ASTROM until no exceptions.
• Run DOSRC (which drives SRCAST)
• Build psf's for all images (DOPSF).

• Create match file (MATCHUP, no cross link linkages yet, YYMMDD.link.match).
• Run object linker DOLINK (which drives LINKOBJ2) and cleanup errors.
• Create looker search status web page (MKHTMLOG) and update lookerassign.html.

• Generate fake objects in images (DOSALT).
• Push changed/salted data to MIT and Lowell.
• Move src/srd files to original_src.
• Copy (cp -p) info*.log files to original_src.
• Move obj files to original_obj.
• Regenerate source lists on salted frames (PROC, change path)
• Re-integrate original_src with salted source (rsync -auv *.src* ..)
• Re-run DOSRC
• Copy (cp -p) or link (ln -s) any unsalted files from ../rawfits to ../salted so that ../salted has a copy of every file. Set up look.pro to point to the data in ../salted. (.run saltlink)
• Re-run object linker DOLINK (which drives LINKOBJ2) and cleanup errors.

• Run LOOKER (two passes minimum).

  ---

  The preceeding steps must be completed on all nights in a run before doing the following steps.

  ---

• Clone images (make links to other night's images, original data only)
• Re-run matchup to get full list (YYMMDD.match).
• Clone astrometry (CLONEAST).
• Add fake objects to 3rd frames (DOSALT2).
• Clone remainder of images in salted data (not as many as in original data, SALTLINK)

• Visual confirmation of slow moving objects (3rd frames done also).
• Run DOOBJAST (drives OBJAST) on all frames (generates object astrometry). Check that objast.err is clean.
• Collect astrometry (ASTCOL,OBS=nnn,/NODB) and eliminate all NaN's.

• Identify fake objects in obj files (desalt,'.','psf')
• Re-run MOSAST on all fields (DOOBJAST)

  ---

  The following steps must be run on Lowell computers

  ---

• Collect astrometry (ASTCOL,OBS=nnn).
• Generate interesting list of objects (procedure)
• Run kbomatch (procedure) and generate lplast.xrft file
• Double check, with PLAST assistance, missed recovery/repeat observations. (notes)

• Once astrometry is clean, collect astrometry with final codes enabled (DES flag!).
• Run ORBFIT (kted file is useful here).
• Save interesting list of objects to oblist.dat (kobj file is useful here)
• Save new orbits to vorb file.

  ---

  The following is run once all nights in a run are up to this point.

  ---

• Run kbompck, review new_special_ted, add to special_ted when ok.
• Run the daily update script (/gryll/data1/bin/kboupdate) and review results
• Create mpc files and submit (send kbompck output along with submission).
• Update lookerassign.html.