Data Analysis Logbook

Conventions (CDD, 2005 Oct 1)


Plate Scale for August 2005 (CDD, 2005 Oct 2)

From scans on limb of Moon (25520-25523, 25537-25540; 2005 Aug 13):

Gradient Degeneracy / Nod-Correlated Background Signal (CDD, 2005 Oct 2)

Explanation of degeneracy (PDF)

Yes, we can see the Moon. (CDD, 2005 Oct 2)

Moon intensity image (2005 Aug 13)

Early October version of sharcsolve (CDD, 2005 Oct 2)

gzip'ed tar file

Angle Conventions (GN, 2005 Oct 10)

Angle Conventions

Thoughts on Hertz-mode Improvements for April (GN, 2005 Dec 3)


Smoothed tau(225GHz) for January 2006 run (CDD, 2006 Feb 17)

Tau fits and software

"Total power" vs. tau(225GHz) for January 2006 run (CDD, 2006 Feb 28)

Total power plots

H and V array offset from unchopped scans (CDD, 2006 Mar 6)

Excel file, showing ~1.5'' offset

Summary of logbook information on calibration and M82 (GN, 2006 Mar 26)


Grid tests (GN, 2006 Mar 26-27)


Beam analysis (HL, 2006 Mar 30)

Comparison beam maps from camera mode (CDD, 2006 Mar 30)


Quicklook and Sharpinteg software (LGK 2006 Mar 30)


A possible reason of AZ depended beam elongation (HL 2006 Mar 31) :


Analysis of Grid Tests (GN 2006 April 2) :


IP, assuming Mars unpolarized (HL, 2006 Apr 5)


Quicklook version 1f and Sharpinteg 1a (LGK 2006 Apr 11)


Test of quicklook version 1f (LGK 2006 Apr 11)


IP, assuming Mars and Jupiter unpolarized (HL, 2006 Apr 13)


Sign and angle conventions (GN, 2006 Apr 13; updated 2007, May 18)


Which way is North (and East) on quicklook images? (GN, 2006 Apr 17)


IP, assuming Mars and Jupiter are unpolarized (HL, 2006 Apr 18)


IP, now with Saturn (HL, 2006 Apr 20)


Orion (HL, 2006 Apr 21)


M82 analysis (2006 Apr 25)


Expected sensitivity for M82 (GN, 2006 Apr 26)


Orion/M82 (HL, 2006 Apr 27)


Preliminary results on OMC-1 from January 2006 Run (John V., 2006-May-1)


Test of instrument polarization subtraction in sharp_combine (John V., 2006-May-2)


Approximate nonlinearity correction for January 2006 run (CDD, 2006 May 4)


Throughput estimate, including effects of gain changes (GN, 2006 May 5, updated May 9)


Sharpinteg version 1b(LK, 2006 May 08)


Plots of AZ and ZA pointing corrections from backsub(LK, 2006 May 08)


Test of the reproducibility of M82 (vectors show inferred B directions)(HL, 2006 May 11)
  • 3 sigma = Reproducible ?
  • use only good cycles (with higher SNR) (HL, 2006 May 12)

  • An experiment (vectors show inferred B directions)(HL, 2006 May 12):

  • Get maps and errors of each HWP position (h1, h2, h3, h4, v1, v2, v3, v4) first.
  • Bin the maps and get q, u from correspondent bins.

    Some results with the sharpinteg-sharp_combine pipeline with various pointing offset corrections (JEV, 2006-May-15)

    3 subsets of M82 data


    Sharpinteg version 1c with CAZO,CZAO header values and widow pixel fixes (LGK 2006-May-16)


    John has put five of our grid tests through the sharpinteg-sharpcombine pipeline. The results are good to within a few degrees. (GN 2006-May-17)


    Plots of backsub output of q,u,Q,U,I,I uncorrected for atmosphere,Atmospheric transmission,on and off source #'s of pixels,background, % pol, and pol angle (radians). (LGK 17 May 2006)

    Plots of backsub output of q and u with hwp 0 angle corrected for and date versus cycle number. (LGK 18 May 2006)

    Rough comparison of Hertz and SHARP results for the central 20 arcsec of M82 (GN, 2006 May 25)


    Beam Shape (HL, 2006 Jun 12)


    noise study from M82 (HL, 2006 Jun 22)


    Quicklook version 1g (CDD 2006 Jul 5)


    fitgauss for polarization scans (JEV 2006 Jul 5)


    Plate Scale for July 2006 (CDD, 2006 Jul 16)

    From scans on Jupiter (32017-32019; 2006 Jul 14): Excel spreadsheet with plots

    July 2006 beam analysis (MMK, July 18 2006)

    July 2006 beam analysis (HL, Sep. 21 2006)


    H and V Misalignment Analysis Summary(MA, July 19 2006)

  • Analysis summary
  • For Mike's open questions: (1) Huabai's note in the instrument logbook for the subarray rotation is sky right. (2) Huabai's unit for the stretch scale is pixel/arcsec, so there is no discrepancy between Darren and Huabai's results. (HL, Aug 9 2006)
  • Translational misalignment analysis

  • A discussion of map-making and how to decide on smoothing/interpolating kernel sizes. (JEV, 2006-July 25)


    Visual Focus Curve for July 12, 2006 (CDD, 2006 Jul 26)


    B1 intracycle pointing offset analysis (MA, Aug 10 2006)

  • Analysis data

  • New M82 analysis with further pointing corrections (JEV, 2006 Aug 11)


    Intracycle pointing offset tests (MA, Aug 24 2006)

  • Analysis data

  • logbooks from July (GN, Aug 24 2006)

  • "spreadsheet" logbook (as corrected by John)
  • list of errors in the above logbook
  • "electronic" log files (in tar format)

  • Some results on HWP stability (GN, Aug 30 2006)

  • HWP stability results

  • Intracycle pointing offsets analysis revised (MA, Aug 30 2006)

  • READ ME file
  • Data plot
  • Example I images

  • Signal-to-noise analysis on DR21 from July 2006 data. (JEV 2006-Sept-7)


    Explanation of Analysis Directory Structure (LGK 2006 Sep 21)


    Intercycle pointing analysis (MA, Sep 27 2006)

  • Correlator Instruction Document
  • B1 sharpcombine image with and without corrections
  • Analysis summary file

  • Pointing accuracy of the DR21M/IRAS20126 data taken in the 2006 July run (HS, uploaded on 2006 Sep 27)

     
    - Attached figures 
    DR21M...
     sample image of the 2D Gaussian fit of DR21
     cazo distribution before any correction on the DR21M data
     czao distribution before any correction on the DR21M data
     cazo vs za plot after pointing offset correction
     czao vs za plot after pointing offset correction
    
    I20126...
     sample image of the 2D Gaussian fit of IRAS20126
     cazo distribution before any correction on the IRAS20126 data
     czao distribution before any correction on the IRAS20126 data
     cazo vs za plot after pointing offset correction
     czao vs za plot after pointing offset correction
    
    - Additional files: 
     pointing offsets for DR21M (caution: all data included.  However, because 
       some of the data don't have the peak in the image frame, offsets for those  
       data would be probably incorrect.) 
     pointing offsets for I20126 (all data included.)
    
    


    Sharpinteg version 1d

    Simulated Data and GAP (MA, Oct 18, 06)
     GAP analysis log with simulated data (MA, Oct 25, 06)
     Q maps for linear array misalignment
     U maps for linear array misalignment
     Q maps for rotational array misalignment
     U maps for rotational array misalignment
     Q maps for stretch array misalignment
     U maps for stretch array misalignment
     Q maps for linear, rotational, and stretch array misalignments
     U maps for linear, rotational, and stretch array misalignments
    

    DR21 pointing images and notes on SE field discrepancy with Hertz

    Revised pointing accuracy of the DR21M/I20126 data taken in the 2006 July run (HS, uploaded on 2006 Oct 27)

    - Attached figures 
     DR21M ...
      cazo vs za plot after daily pointing offset correction
      czao vs za plot after daily pointing offset correction
     I20126...
      cazo vs za plot after daily pointing offset correction
      czao vs za plot after daily pointing offset correction
    
    
     - Attached data files
      DR21M...
      pointing offsets of the data taken towards the center
      pointing offsets of all data
    
      I20126...
      pointing offsets of the data taken towards the center
      pointing offsets of all data 
    

    Planet data analysis with gap (MA, Nov 2 2006)
    Mars dither 29756-71
    Mars dither 29788-803
    Jupiter dither 29888-903
    Jupiter dither 29852-67
    Saturn dither 28875-90
    Saturn dither 29175-90
    
    

    Notes on use of IDL pointing program, pointcorr

    IP for Jupiter, July run (MMK, 11/07/06)

    Polarization efficiency and HWP zero angle (JEV, 2006-Nov-7)

    Notes detailing SharpInteg (versions 1e and 2) usage and details of code formalism

    Excel logbook for November 2006 Run

    Efficiency measurements (JEV, 2006-Nov-21)

    Preliminary results from December 2006 (updated 2006-Dec-19, JEV)
    • NGC 253
      • Red vectors = > 3 sigma, green vectors = between 2-3sigma
      • Vectors plotted every ~5''
      • July 2006 IP has been applied (incorrectly - N.B. on 2007-Jun-5)
      • Smoothed tau has not been applied
      • Pointing correction has not been applied
      • Displayed I map has been smoothed with 6'' gaussian kernel
      • Median backgrounds have been subtracted from each file
    • Orion
      • No smoothed tau, IP, or pointing corrections
      • An unsuccesful attempt at background/scale corrections
    • Smoothed tau, pointing corrected for both OMC-1 and NGC253 (updated 2007-Jan-15)

    Pointing during the 2006 Dec run (HS, uploaded on 20 Dec 2006)

    - Attached files and figures 
    
       pointing offset table (az,azo,zao is not included this time.)
       notes for some known issues/memo
       pointing offset in az vs. za 
       pointing offset in za vs. za
       residual plot of pointing offset in az vs. za
       residual plot of pointing offset in za vs. za
    
    
    

    Some more about pointing for December 5, 2006 (CDD, 2006 Dec 21)



    Signal-to-noise analysis on NGC253 at 450 μm (2006-Jan-17, JEV)

    GAP v 1.5 simulation tests README file (MA, uploaded on 01 Feb 2007)

    - Attached files and figures
    - Please read the README file first before looking at the attached plots
    
       20" by 20" spherical gaussian source with no noise
       20" by 20" spherical gaussian source with detector noise added
       10" by 15" elliptical gaussian source with no noise
       10" by 15" elliptical gaussian source with detector noise added
       5" by 5" spherical gaussian source with no noise
       5" by 5" spherical gaussian source with detector noise added
       GAP_v1.5simtests.rtf file (raw data from experiment)
    
    

    Array Alignment for the Dec 2006 Run (MA, uploaded 01 Feb 2007)

    See Attachments below for the H and V files generated by sharpinteg2 for the file sharc2-034349.fits taken in Dec 2006.
    The files generated do not look like anything that might be used to calculate the array misalignments.  I have tested
    sharpinteg2 with M42 data taken during the Dec run and the program appears to be functioning normally.  Might this just 
    be a bad data file?
    
    -FITS FILES:
    FITS H array file
    FITS V array file
    -PS FILES:
    PS H array file
    PS V array file
    
    

    Preliminary analysis from February 2007 run

  • OMC-1 at 350 μm and comparison with Hertz

    GAP v1.5 Results with Simulated Data (MA, uploaded 22 Feb 2007)

    The following files illustrate the amount of artifical polarization generated for a number of 
    different gaussian sources with a translational misalignment of 0.1 pixels and a rotational 
    misalignment of 2 degrees between the H and V arrays.   
    10" by 15" ellipse
    10" by 10" sphere
    20" by 20" sphere
    
    The following files illustrate the correction error as a function of pointing drifts.
    Correction error for the 10" by 15" ellipse
    Correction error for the 10" by 10" sphere
    Correction error for the 20" by 20" sphere
    
    The following file illustrates the correction error for the 10" by 15" ellipse for 
    various degrees of uncertainty in the hardware parameters.  This plot should give 
    a feel for the robustness of the program. 
    Hardware error file for the 10" by 15" ellipse
    
    

    Smoothed tau(225GHz) for February 2007 run (CDD, 2007 Mar 7)

    Tau data

    Plate Scale for February 2007 (CDD, 2007 Mar 8)

    From scans on ORIIRC2 (36109-36110; 2007 Feb 12):

    Plate Scale for December 2006 (CDD, 2007 Mar 9)

    From scans on M42.1 (34401-34404; 2006 Dec 5):
    OMC-3 data from February 2007 observing run (2006-Mar-15, JEV):
  • includes smoothed tau, 2007-Feb rgm, pointing corrections, but no IP; all vectors debiased.

    Pointing Model for February 2007 (CDD, 2007 Mar 21)

    Here are the (FAZO, FZAO) pointing measurements for the compact sources observed during the Feb. '07 run.

    Here is the "static" pointing model fit for the Feb. '07 run. If you want to know how to combine the static model and the hourly pointing measurements to predict the pointing for other sources, ask me. This should only be relevant for OMC-3, M82, and OMC-1 during this run.

    See zamin:~sharp/Runs/2007feb/calibs/pointing/ and pointing_model/ for analysis details.


    Array Misalignment from Feb 07 Run (MA, 2007 Mar 22)

    
    These measurements were made using the engineering files taken during the Feb 2007 run.  
    They are all taken with respect to the H array and include:
    
    Translations (x,y) [pixels]: 0.109151 , 0.007041
    Stretches (x,y): 1.008679 , 0.995928
    Rotation [deg]: 1.446355
    
    Note that the rotation angle is made in a clockwise fashion (ie, the V array is rotated by ~1.45 deg wrt the H array).
    
    

    Interpretation of ROTATOR_0 rotation and DISTORT distortion (CDD, 2007 Apr 19)

    ROTATOR_0 and DISTORT are constants I use in the sharcsolve code, so the 100% guaranteed definition could be found in that code. However, here is how I think it works:

    Plate Scale for Early April 2007 (CDD, 2007 Apr 19)

    From scans on Jupiter (37152-37155; 2007 Apr 5):

    GAP v1.6 Results with January 2006 Jupiter Data (MA, uploaded 03 May 2007)

    Uncorrected polarimetry map
    Corrected polarimetry map
    Performance plot for GAP looking at the edge pixels of the planetary disk
    

    Pointing Model for M82 in April 2007 (CDD, 2007 May 10)

    Here is the "static" pointing model fit for the early Apr. '07 run, and here is the one for late April. I used only SWEEP and BOX mode data this time.

    Predicting the pointing for M82 was the goal of the pointing model fits, and here are those predictions, based on measurements of Saturn, IRC10216, and CALLISTO before and after M82. There are three caveats for these predictions: 1) M82 and the pointing sources are more widely separated than I am used to, 2) There is a lack of pointing data, at any time, in the northern sky where M82 is, 3) There were often 2-3 hour intervals between pointings, in comparison to the 1 hour intervals I am used to. I believe it is very important to verify and perhaps tweak the relative alignment of the SHARP images of M82.

    See zamin:~sharp/Runs/2007apr/calibs/sharp_pointing/ for analysis details.


    Smoothed tau(225GHz) for April 2007 runs (CDD, 2007 May 10)

    Tau data

    Results of DG Tau analysis (GN, 2007 May 28)


    Document on Instrument Polarization Conventions (JEV, 2007 July 3)

  • IP measurements summary: July 2006 -- present (Excel file, PDF)
  • Joint fit of all runs:
  • For a HWP zero angle of ~ 90°, the best estimate of the 350 μm IP can be input to sharp_combine as "-ip 0.0034 0.00017 0.0036 0.0"

    Results of "V-null" quick-check grid tests 7/06-8/07 (GN, 2007 Aug. 17)


    Smoothed tau(225GHz) for August 2007 run (CDD, 2007 Aug 22)

    Tau data

    Smoothed tau(225GHz) for June 2007 run (CDD, 2007 Aug 29)

    Tau data

    Plate Scale for Late April 2007 (CDD, 2007 Aug 29)

    From scans on Saturn (38328; 2007 Apr 29), W51M (38405-38406; 2007 Apr 30), and Jupiter (38454; 2007 May 1): To make the analysis quicker, I am no longer solving for the characteristics of the H and V subarrays separately.

    Plate Scale for August 2007 (CDD, 2007 Aug 29)

    From scans on Mars (39752, 39837; 2007 Aug 11-12):

    outline of scheme for computing reduced-chi-squared (GN, 2007 Sept. 12)


    Quicklook of 2007 August data reduced at summit (HS, 2007 Sep 18)


    Summary of discussion on RGM taken in 2007 August run (HS, uploaded on 2007 Sep 23)


    Chop-nod analysis for M82 data taken in Feb 2007 (MA, 2007 Oct. 19)


    Pointing changes of 2007 Aug data (HS, 2007 Oct 23, updated on Oct 30)


    Preliminary Analysis of NGC 1333 4A from Nov 07 Run (MA, 2007 Nov 22)


    Slides for CSO TAC (GN, 2007 Dec 11)


    Test of sharp_combine i.p. subtraction (GN, 2008 Jan 16)


    Analysis of NGC 1333 4A from Nov & Dec 07 runs (MA, 2008 Jan 18)


    Best guess i.p. for Jan. 2006 (350), Dec. 2006 (450), June 2007 (450). (GN 2008 Jan. 30; updated March 10)


    Excel Spreadsheet for Feb 07 Pointing Analysis (MA 2008 Feb 4)


    Plate Scale for November 2007 (CDD, 2008 Feb 19)

    From scans on Mars (40560; 2007 Nov 9) and ORIIRC2 (40561-40562, 40665-40666; 2007 Nov 9-10):

    Consistency Test for NGC1333 Data (MA, 2008 March 17)


    Status Report on L 1527 Data Reduction (GN, 2008 May 20)


    Another status Report on L 1527 Data Reduction (GN, 2008 May 25)


    Status Report on M82 Data Reduction (GN, 2008 May 30)


    Analysis memo draft for the IRAS 20126 data (June 16) (HS, uploaded on 2008 June 16)

    Analysis memo for the IRAS 20126 data (June 27) (HS, uploaded on 2008 June 27)


    Calculating the average value of the reduced chi squared across a map (GN, 2008 July 17)


    chi2 can do outlier rejection, but it doesn't help for L1527 (GN, 2008 July 29)


    DG Tau analysis - subtracting offsets in Q and U (TM, 2008 Sept 11)


    Smoothed tau(225GHz) for September 2008 run (CDD, 2008 Sep 24)

    Tau data

    Plate Scale for September 2008 (CDD, 2008 Sep 24)

    From scans on Uranus (44312; 2008 Sep 6), GANYMEDE (44547-44549, 2008 Sep 9), and CALLISTO (44666-44668, 2008 Sep 10):

    "Mostly undigested" rgm ascii files from Sept. run, sent to me by Darren recently (GN, 2008 Oct 1)

    undigested rgm info

    Calibration notes on 2008-July run. (JEV 2008-Oct-15)


  • Set-up notes for 2008 Oct/Nov. run

    M82 polsharp4 plots using 55 files or cycles from Feb and Apr 2007 SHARP runs (LL, 2008 Oct 24)

    M82 reduced chi square results of 4 and 2 bins using 55 files or cycles from Feb and Apr 2007 SHARP runs (LL, 2008 Oct 24)

    M82 reduced chi square fits output file for 4 bins using 55 files or cycles from Feb and Apr 2007 SHARP runs (LL, 2008 Oct 24)

    M82 reduced chi square fits output file for 2 bins using 55 files or cycles from Feb and Apr 2007 SHARP runs (LL, 2008 Oct 24)


    Analysis of NGC1333 4A & 4B data from Sept. 08 run (MA Nov. 08)

  • PDF file

    Analysis of NGC1333 4A & 4B data from Sept. 08 run take 2 (MA Dec. 02)

  • PDF file

    Analysis of NGC1333 4A & 4B data from Sept. 08 run take 3 (MA Dec. 04)

  • PDF file

    Instrument Polarization Data & Analysis (JEV posted 2008-Dec-4)

  • tar'd and bzip2'd file
  • See post dated 2007-July-3 for some previous analysis.

    Plate Scale for May 2008 (CDD, 2009 Feb 8)

    From scans on Saturn (43402, 2008 May 10; 43571-43572, 2008 May 11) and Jupiter (43715-43716, 2008 May 11).

    Analysis Update for NGC6334 I(N) (MA, 2009 Feb 19)

  • PDF file

    Analysis Update for NGC6334 I(N) (MA, 2009 Mar 10)

  • PDF file

    Study of Subarray Misalignment (MZ, 2009 Mar 13)

  • PDF file

    Preliminary Analysis of L1527 (JEV, 2009 Apr 6)

  • Data files can be found on zamin at ~sharp/Runs/2009jan/process/l1527/
  • E-vectors; constant-length B-vectors
  • FITS file output from sharp_combine
  • 450 μm
  • thick vectors: P >= 3σ; thin vectors 2σ< P < 3σ
  • 3σ vectors in range 3 - 7 %.
  • I have made corrections for smoothed tau, pointing (good to about 2 arcsec). Background subrtaction has been performed for dc component only.
  • Smoothing kernel is standard 4.75 arcsec FWHM.
  • No IP correction has been made.
  • No chi-squared or similar analysis/data-quality checks have been performed.

    Analysis of reduced-χ2 addition to sharp_combine (JEV, 2009 Apr 14)


    Multi-wavelength data from W3 (JEV, 2009 Apr 17)


    How I got sharp_combine working on my mac (GN, 2009 April 20)

  • explanation -- PDF file
  • test data -- tar file

  • Result for L1527 (GN, 2009 May 14)

  • May 2009 analysis of L1527 -- PDF file

  • Result for IC 348 (GN, 2009 May 22)

  • May 2009 analysis of IC 348 -- PDF file

  • Update on data analysis of IRAS 20126 (HS, uploaded on 2009 June 30)

  • PDF

  • Update on data analysis of IRAS 20126 II (HS, uploaded on 2009 July 01)

  • PDF

  • Update on data analysis of IRAS 20126 III (HS, uploaded on 2009 July 09)

  • PDF

  • Update on data analysis of IRAS 20126 IV (HS, uploaded on 2009 August 06)

  • PDF

  • Result for B 335 (GN, 2009 Nov 27)

  • Nov. 2009 analysis of B 335 -- PDF file

  • Instrument Polarization Summary (JEV, 2009-December-7)

    See previous summary made in July 2007
  • IP measurements summary: September 2009
  • Text summary
  • Plots of 350 μm data

    Second chi2 Analysis for B 335 (GN, 2009 Dec. 9)

  • Dec. 2009 analysis of B 335 -- PDF file

  • How I got sharpinteg_2, chi2, and fitgauss working on my mac back in April (GN, 2009 December 15)

  • "more-code-for-mac" -- a very big zip file

  • Second chi2 Analysis for IC 348 (GN, 2010 March 8)

  • March 2010 analysis of IC 348 -- PDF file

  • A χ2 and Allan Variance analysis for SHARP (JEV, 2010 April 16)

  • First tests on NGC1333

  • Study of Variation in Signal Amplitude over Time (AJ, 2010 July 23)

  • Signal Amplitude vs. Time (Summary Document)
  • Signal Amplitude vs. Time (all files; compressed)

  • Notes on M82 Analysis (GN, 2010 July 27)

  • Notes on M82 Analysis (text file)

  • Memo on polarization angle and sign conventions for SHARP (GN, 2010 Dec. 5)

  • Summary of Polarization Measurement Conventions for SHARP (PDF file)

  • chi2 analysis for OMC3 (NLC, 2011 Jan 7)

  • OMC3 Writeup
  • OMC3 data files

  • data analysis on M17, NGC 253, M82 (LZ, 2011 Feb 26)

    Here are the memos on my data analysis work. I also include a memo on running SHARP software on a Linux machine.
  • M17
  • NGC253
  • M82
  • Linux installation notes

  • Improvements to sharpinteg (NLC, 2012 May 14)

    Primarily I improved the implementation of Chauvenet's criterion for removing electronic noise, but there are a few other minor bug fixes as well.
  • "Removing Electronic Row Noise in SHARP"

  • Improvements to sharpcombine (NLC, 2012 May 31)

    How to properly combine data with covariance.
  • "Treating Correlated Noise in SHARP"