#JEH> Continuation of test log from aips++ data reduction #JEH> of NGC 4038 D-array HI spectral line data. #JEH> Log 2. 12/10/01 # #JEH> Problem with my original calibration of the n4038D #JEH> dataset, but aips++ was changing so much then, that #JEH> I am starting over, and doing parallel reduction in #JEH> AIPS. First, deleted everything. #JEH> Using weekly. This has many updates. v1.7 (build 47). # #JEH> Notes from AIPS data reduction: #JEH> refant=24 #JEH> bl 4-10 bad #JEH> some 1st scans #JEH> ant 10 until 0/1 12 0 #JEH> ant 14 phase jump - flag until 0/2 41 30 #JEH> ant 17 has 18deg jump #JEH> ant 18 flagged by on-line system (W1=shadowed) #JEH> 2 kJy source on line data, bl 8-23 #JEH> self-cal made a big difference (3 phase only, 1 ph+gain) #JEH> ch 0 noise went from 1 mJy/b to 0.4 mJy/b (2300 CC) #JEH> unlin ch 5-23+105-115 #JEH> R+1: 47"x31", cleaned to 2.5 mJy/b. 1sig=1.1 mJy/b #JEH> Had analysts run fillm. File=AH582.960903.LINE (118 MB) #JEH> ======================================================== include 'ms.g' fitsfilename :='/export/data_1/jhibbard/DATA/n4038/AH582/AH582.960603.LINE'; myms:=fitstoms(fitsfile=fitsfilename, msfile='n4038D.ms'); myms.summary(verbose=T); myms.done(); #LOG> ======================================================== Observation: VLA Data records: 77213 Total integration time = 12450 seconds Observed from 03-Jun-1996/00:56:00 to 03-Jun-1996/04:23:30 ObservationID = 1 ArrayID = 1 Date Timerange Field DataDescIds 03-Jun-1996/00:56:00.0 - 01:08:30.0 1331+305 [1] 01:12:00.0 - 01:13:30.0 1130-148 [1] 01:16:00.0 - 01:53:00.0 NGC4038 [1] 01:55:00.0 - 01:58:30.0 1130-148 [1] 02:01:00.0 - 02:38:00.0 NGC4038 [1] 02:40:00.0 - 02:43:30.0 1130-148 [1] 02:46:00.0 - 03:23:00.0 NGC4038 [1] 03:25:00.0 - 03:28:00.0 1130-148 [1] 03:30:00.0 - 04:08:00.0 NGC4038 [1] 04:10:00.0 - 04:13:00.0 1130-148 [1] 04:17:00.0 - 04:23:30.0 1331+305 [1] Fields: 3 ID Name Right Ascension Declination Epoch 1 1331+305 13:31:08.29 +30.30.32.96 J2000 2 1130-148 11:30:07.05 -14.49.27.39 J2000 3 NGC4038 12:01:52.00 -18.55.40.00 J2000 Data descriptions: 1 (1 spectral windows and 1 polarization setups) ID Ref.Freq #Chans Resolution TotalBW Correlations 1 1412.63MHz 127 24.4141kHz 3125 kHz RR Feeds: 29: printing first row only Antenna Spectral Window # Receptors Polarizations 1 -1 2 [ R, L] Antennas: 27: #LOG> ======================================================== #JEH> First, lets take a look at the data: #AIPS: TVFLG, calco '*', dparm(6)=30 include 'msplot.g' mymsplot:=msplot('n4038D.ms', edit=T, flagfile="n4038Dflag01.flag"); #GUI> Show: Display data as an image #GUI> Data selection: #GUI> Field Id=[1,2] #GUI> Spectral selection: #GUI> List of spectral windows [1] #GUI> Number of channels 127 #GUI> Start channel 1 #GUI> Channel increment 1 #GUI> #BUG> NOTE!! CHANNEL WIDTH PARAMETER HAS DISAPPEARED! #BUG> Bugged it #JEH> aips shows some 128 Jy points on baseline 8-23 in ch1; want #JEH> to see if msplot shows it to. It does. #JEH> Redo for channel 64. #JEH> Then redo for pseudo-continuum: #GUI> Spectral selection: #GUI> List of spectral windows [1] #GUI> Number of channels 1 #GUI> Start channel 11 #GUI> Channel increment 96 #GUI> #JEH> Same high points in all channels. Verified in AIPS. Have to flag them: #JEH> [in aips TVFLG: switch all-ch flag, clip interactively; #JEH> AVSPC: ICHANSEL 11, 96, 1, 1; FLAGVER 1;TVFLG] #JEH> Verified that what I see in msplot is exactly what I see in TVFLG. #JEH> But can't tell much from msplot. #JEH> Using other options available in TVFLG, I notice that #JEH> ant 4 w/all, 10 w/all have phase jumps in first scan, #JEH> so I flagged those: #JEH> 4 w/all, timer=0 1 57 30 0 1 2 0 #JEH> 10 w/all, timer=0 0 56 0 0 1 12 0 #JEH> From ms.summary, verify that AIPS Ant 4 = E8 = aips++ Ant 4 and #JEH> AIPS Ant 10 = W3 = aips++ Ant 10. Thats good. #JEH> Also noticed in msplot that ant18 is gone #JEH> from source (fieldid=3) until 02:56:00, except for a few #JEH> single scans at the begining of run. I do NOT see this in #JEH> TVFLG. So lets flag that too. #JEH> Finally, Ant 14 has a huge phase jump from my earlier aips #JEH> reduction, so flagged that until 2:41:30 #JEH> LISTR output from aips. include 'flagger.g' fg:=flagger(msfile="/export/data_1/jhibbard/aips++/n4038D.ms" ); fg.filter(column='DATA', operation='range', comparison='Amplitude', range=['0.00001Jy','5Jy']); fg.setchan(1:127) fg.setantennas([4]) fg.setids(fieldid=[1]) fg.setflagmode('flag') fg.state() fg.timerange('1996/06/03/00:57:30','1996/06/03/01:02:00') fg.setantennas([10]) fg.state() fg.timerange('1996/06/03/00:56:00','1996/06/03/01:12:00') fg.setantennas([18]) fg.setids(fieldid=[3]) fg.state() fg.timerange('1996/06/03/00:59:00','1996/06/03/02:56:00') fg.setantennas([14]) fg.setids(fieldid=[1,2,3]) fg.state() fg.timerange('1996/06/03/00:56:00','1996/06/03/02:41:30') fg.done() #JEH> Check that it all worked out: include 'msplot.g' mymsplot:=msplot('n4038D.ms', edit=T, flagfile="n4038Dflag01.flag"); #GUI> Show: Display data as an image #GUI> Data selection: #GUI> Field Id=[1,2] #GUI> Spectral selection: #GUI> List of spectral windows [1] #GUI> Number of channels 1 #GUI> Start channel 11 #GUI> Channel increment 96 #GUI> #JEH> Verified that this worked in msplot. On to calibration. ######################################### ## ## CALIBRATING ## ######################################### #JEH> FIRST, THE RESULTS FROM AIPS: #AIPS> SETJY1: '1331+305 ' IF = 1 FLUX =14.7647 (Jy calcd) #AIPS> VLACALIB, CALCO '*', REFANT 24, solint 0, aparm 4, 0 #AIPS> LISTR, OPTY 'GAIN' #AIPS> GETJY SOURCE='1130-148' calso='1331+305' #AIPS> GETJY1: 1130-148 : 0 A 1 5.35110 +/- 0.02990 include 'imager.g'; im:=imager('n4038D.ms'); im.setjy(fieldid=1); #LOG> 1331+305 spwid= 1 [I=14.76, Q=0, U=0, V=0] Jy, (Perley-Taylor 99) #JEH> Same answer as in AIPS. Good. include 'calibrater.g'; cal:=calibrater('n4038D.ms'); #use a psuedo-continuum from channels 11-117 for calculating the G Jones cal.setdata(mode='channel',nchan=1,start=11,step=96,msselect='FIELD_ID<=2'); cal.setsolve(type='G',t=300.0,preavg=300.0,refant=24,table='n4038D.gcal'); cal.solve(); cal.plotcal(tablename='n4038D.gcal') cal.fluxscale(tablein='n4038D.gcal', tableout='n4038D.gcalout', reference='1331+305', transfer=['1130-148']); cal.plotcal(tablename='n4038D.gcalout') #LOG> Flux density for 1130-148 (spw=1) is: 5.334 +/- 0.002 Jy #JEH> WHYS IS THE ERROR 10 TIMES HIGHER IN AIPS??? #JEH> I DID THE ABOVE CHANNEL SELECTION IN cal.setdata BASED ON AN EMAIL #JEH> WITH ATHOL ON 10/07. HOWEVER, Vol3 OF GETTING RESULTS DIDNT HAVE THE #JEH> CHANNEL SELECTION; IT JUST HAD: cal.setdata(msselect='FIELD_ID<=2'); #JEH> SO NOW I'LL TEST THAT: cal.reset() cal.setdata(msselect='FIELD_ID<=2'); cal.setsolve(type='G',t=300.0,preavg=300.0,refant=24,table='n4038D.gcal2'); cal.solve(); cal.plotcal(tablename='n4038D.gcal2') cal.fluxscale(tablein='n4038D.gcal2', tableout='n4038D.gcalout2', reference='1331+305', transfer=['1130-148']); #LOG> Flux density for 1130-148 (spw=1) is: 5.334 +/- 0.002 Jy cal.plotcal(tablename='n4038D.gcalout2') cal.done() #JEH> LOOKS EXACTLY THE SAME. #JEH> SO IT APPARENTLY MAKES NO DIFFERENCE. I WONDER WHY? #BUG> I AM REALLY NOT SURE WHAT IS GOING ON HERE. IS IT CALCULATING G #BUG> JONES FOR EACH CHANNEL? FOR ALL CHANNELS? BUGGED TO ASK THIS QUESTION. #now calculate bandpass using both calibrators, since ANT14 and #ANT 10 are missing from 3c286 #For aips++, have to apply G Jones first. cal:=calibrater('n4038D.ms'); cal.setdata(mode='channel', nchan=127, start=1, step=1, msselect='FIELD_ID<=2'); cal.setapply(type='G',t=0.0,table='n4038D.gcalout'); cal.setsolve(type='B',t=86400.0,preavg=86400.0,refant=24,table='n4038D.bcal'); cal.solve(); cal.plotcal(tablename='n4038D.bcal'); cal.done(); #JEH> Hmmm - why is scale around 2.5 instead of 1.0??? #JEH> And ant 14 is much lower than everything else here. #JEH> But it was fine in gain cal. What up with that? #JEH> I like my bandpass plotting functions better. #JEH> See 'TESTING_LOGS/bandpassplot.g' for the #JEH> plot1BP function, and do this to use it: include 'table.g' include 'pgplotter.g' include 'TESTING_LOGS/bandpassplot.g' t:=table('n4038D.bcal') gain:=t.getcol('GAIN'); Nchan:=shape(gain)[4] solok:=t.getcol('SOLUTION_OK'); mypg:=pgplotter() limits:= [0,Nchan+1,0,max(abs(gain))*1.1] plot1BP(1,limits,gain,solok) limits:= [0,Nchan+1,0.95,1.1] plot1BP(1,limits,gain,solok) #JEH> Checked bandpass shape against AIPS #JEH> They agree incredibly well, down to #JEH> very specific bumps and wiggles. #JEH> Only problem is ant 14 is way too #JEH> low (~0.6 instead of 1.0). So I deleted it, and redid, #JEH> but then ant 10 became real low. #JEH> Does this have anything to do with #JEH> the fact that both of these antennas #JEH> were flagged for the scan on #JEH> on 3c286? I'll redo everything w/o #JEH> flagging ant14 or 10 for the whole #JEH> run, and redo the bandpass just using #JEH> the secondary calibrator, and see what #JEH> happens... # cal:=calibrater('n4038D.ms'); cal.setdata(mode='channel', nchan=127, start=1, step=1, msselect='FIELD_ID==2'); cal.setapply(type='G',t=0.0,table='n4038D.gcalout'); cal.setsolve(type='B',t=86400.0,preavg=86400.0,refant=24,table='n4038D.bcal'); cal.solve(); cal.plotcal(tablename='n4038D.bcal'); #JEH> Nope, no difference. Ant14 bpass still way too low. Shape is #JEH> perfectly in agreement with AIPS. #JEH> This will have to be tracked down.