CASA Testing Log S. T. Myers (AOC) 2007-08-21 ============================================================ Location: /home/sandrock2/smyers/Testing2/Aug07 Run through Jupiter6cm continuum obs again. Script: jupiter6cm_usecase.py Version: CASA Version 2.0 Rev 3047 Built on: Tue 2007/08/21 01:15:05 UTC ------ importuvfits() The "Origin" in the logger needs to have the task name first. Its confusing to have some originate in ::importuvfits and some in ::Flagger and some in MsFitsInput... whatever. If we keep a single Origin column, then it should be something like task::tool.method::whatever so that the task appears first. I notice it makes the scratch columns and then goes back and initializes them. Can't it make them with the appropriate initialization already in them? Note it now makes a .flagversions for you with a flags.Original in it. Excellent! listobs() Need to have an "outprint" parameter option in all list tasks. Do not use some other name like "outputfile" as those are used for other things in tasks. general I did "inp flagautocorr()" by mistake instead of "inp flagautocorr" and to my surprise it executed flagautocorr and then did the inp. I guess thats the way IPython expands things but its rather unsettling. flagautocorr() This has lots of extraneous logger output marked as from Flagger::Selector The progress meters that get printed to the terminal are also unhelpful since it isnt just one for the task (which would be good) but one for each something (spw? pol?) flagmanager() When I do mode='list' it says "See logger for flag versions for this file" but there seems to be nothing important in the logger. What is meant by this? plotxy() In todays version there were some comment lines in the inp() for this task that were not properly "#"-ed so that they could be cut and pasted. Joe said Ed did this (without cabal consultation by the way), and there might be some other tasks with this problem. I see it in gaincal, bandpass, applycal also. I am not that enamoured with the separator in the inp (help is ok). It starts to take up too much real estate IMO. If we do it, do we do it for other sections? If we do, then there needs to be a blank line "#" after the block of Data Selection params. I can find no good way to have multiline explanations just by indenting, you seem to have to put a "#" in column 1 which looks goofy: field = '' # field names or index of calibrators: # # ''==>all; field ='3C286,P1321*', field= '0~3' spw = '' # spectral window:channels: ''==>all, spw='1:5~57' If we can get by w/o multi-line comments then that is best! Lets keep lines to 100 char or less (see below for example). There is a long list of plot options (often with long names) that could be put under a hidden "selectplot" parameter. Note that "datacolumn" makes sense only for yaxis=amp,pha,re,im so this should be a sub-parameter. Some names are too long (replacetopplot ==> newplot, removeoldpanels ==> clearpanel) Can we abbreviate axes: hourangle==>ha, azimuth==>az, elevation==>el, channel==>chan? I would suggest: vis = '' # Name of input visibility xaxis = 'time' # az,el,ha,baseline,chan,time,u,v,w,uvdist,x yaxis = 'amp' # az,el,ha,baseline,amp,pha,u,v,w,uvdist datacolumn = 'data' # Use column: 'data','corrected','model','residual' field = '' # field selection (''==>all): e.g. '3C286,P1321*' or '0~3' spw = '' # spectral window:channels (''==>all): e.g. '1:5~57' selectdata = True # Other data selection parameters antenna = '' # antenna/baselines: ''==>all, antenna = '3,VA04' timerange = '' # time range: ''==>all correlation = '' # correlations: default = '' scan = '' # scan numbers: Not yet implemented feed = '' # multi-feed numbers: Not yet implemented array = '' # array numbers: Not yet implemented uvrange = '' # uv range ''==>all; uvrange = '0~100kl' average = '' # Select averaging mode: 'time','channel',''==>none showflags = False # Show flagged data iteration = '' # New panels by: 'field','antenna','baseline','scan','feed' selectplot = True # Other plotting control parameters subplot = 111 # Panel number on display screen (yxn) plotsymbol = '.' # pylab plot symbol plotcolor = 'darkcyan' # pylab plot color markersize = 5.0 # Size of plotted marks linewidth = 1.0 # Width of plotted lines connect = 'none' # Specifies which points are connected with lines plotrange = [-1, -1, -1, -1] # The range of data to be plotted, can be time values skipnpoints = 1 # Plot every nth point multicolor = 'both' # Plot in different colors: 'none','both','chan','corr' newplot = False # Replace the last plot or not when overplotting clearpanel = True # Turn on/of automatic clearing of panels title = '' # Plot title (above plot) xlabels = '' # Label for x-axis ylabels = '' # Label for y-axis fontsize = 10.0 # Font size for labels windowsize = 1.0 # Window size overplot = False # Overplot values on current plot (if possible) (Note I end on a non-expanded parameter so that the blank line gets put in correctly.) ------ plotxy() ###Try exercising the overplot/replacetopplot/removeoldpanels CASA <110>: inp ----------> inp() # plotxy :: Plot points for selected X and Y axes: vis = 'jupiter6cm.usecase.ms' # Name of input visibility xaxis = 'uvdist' # azimuth,elevation,hourangle,baseline,channel,time,u,v,w,uvdist,x yaxis = 'amp' # azimuth,elevation,hourangle,baseline,amp,pha,u,v,w,uvdist datacolumn = 'data' # data (raw), corrected, model, residual (corrected - model) Data selection parameters (see help plotxy and help par.selectdata) field = '1331+305' # field names or index of calibrators: ''==>all; field ='3C286,P1321*', field= '0~3' spw = '' # spectral window:channels: ''==>all, spw='1:5~57' selectdata = True # Other data selection parameters antenna = '' # antenna/baselines: ''==>all, antenna = '3,VA04' timerange = '' # time range: ''==>all correlation = 'RR LL' # correlations: default = '' scan = '' # scan numbers: Not yet implemented feed = '' # multi-feed numbers: Not yet implemented array = '' # array numbers: Not yet implemented uvrange = '' # uv range''==>all; uvrange = '0~100kl' average = '' # Select averaging mode: time or channel subplot = 211 # Panel number on display screen (yxn) overplot = False # Overplot values on current plot (if possible) showflags = False # Show flagged data iteration = 'antenna' # Plot separate panels by field, antenna, baseline, scan, feed plotsymbol = '.' # pylab plot symbol plotcolor = 'darkcyan' # pylab plot color markersize = 5.0 # Size of plotted marks linewidth = 1.0 # Width of plotted lines connect = 'none' # Specifies which points are connected with lines plotrange = [-1, -1, -1, -1] # The range of data to be plotted, can be time values skipnpoints = 1 # Plot every nth point multicolor = 'both' # Plot polarizations and channels in different colors replacetopplot = False # Replace the last plot or not when overplotting removeoldpanels = True # Turn on/of automatic clearing of panels title = '' # Plot title (above plot) xlabels = '' # Label for x-axis ylabels = '' # Label for y-axis fontsize = 10.0 # Font size for labels windowsize = 1.0 # Window size CASA <111>: go ----------> go() Executing: plotxy() CASA <112>: replacetopplot=True CASA <113>: go ----------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 307958 Attaching the main selected MS Tue Aug 21 23:17:12 2007 WARN : May need to read 923874 values from disk. Tue Aug 21 23:17:12 2007 SEVERE : [msplot::checkinputs()] Exception Reported: TablePlot: No Table is Set.... *** Error *** No data selected - please check inputs ###WHY DIDNT THIS WORK? MAYBE replacetopplot=True NEEDS overplot=True? ###IF SO THEN IT SHOULD BE A SUB-PARAMETER CASA <115>: go ----------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 307958 Attaching the main selected MS Tue Aug 21 23:17:53 2007 WARN : May need to read 923874 values from disk. Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.69 sec. Time to extract Flags : 0.01 sec. Number of new points being plotted : 46304 Number of new points not being plotted : 56 Total Plotting time : 0.427 sec. Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.66 sec. Time to extract Flags : 0.03 sec. Number of new points being plotted : 44437 Number of new points not being plotted : 151 Total Plotting time : 0.660 sec. ###SO JUST DOING GO TWICE IN A ROW MADE IT WORK OK???? CASA <117>: overplot=True CASA <118>: go ----------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 307958 Attaching the main selected MS Tue Aug 21 23:18:33 2007 WARN : May need to read 923874 values from disk. Tue Aug 21 23:18:34 2007 SEVERE : [msplot::checkinputs()] Exception Reported: TablePlot: No Table is Set.... *** Error *** No data selected - please check inputs CASA <119>: go ----------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 307958 Attaching the main selected MS Tue Aug 21 23:23:14 2007 WARN : May need to read 923874 values from disk. Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.68 sec. Time to extract Flags : 0.01 sec. --------------------------------------------------------------------------- Traceback (most recent call last) /home/sandrock2/smyers/Testing2/Aug07/ in () : pop from empty list Tue Aug 21 23:23:16 2007 SEVERE : [ msplot::iterplotnext() ] Exception Reported: TablePlot: CasaPyInterpreter: From Python : SEVERE : if(currAxes is not None):currAxes.lines.pop(); : ### overplot=True AND REPEATING go JUST ALTERNATES THESE ERRORS CASA <123>: overplot=False CASA <124>: go ----------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 307958 Attaching the main selected MS Tue Aug 21 23:24:04 2007 WARN : May need to read 923874 values from disk. Tue Aug 21 23:24:04 2007 SEVERE : [msplot::checkinputs()] Exception Reported: TablePlot: No Table is Set.... *** Error *** No data selected - please check inputs CASA <125>: go ----------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 307958 Attaching the main selected MS Tue Aug 21 23:24:09 2007 WARN : May need to read 923874 values from disk. Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.69 sec. Time to extract Flags : 0.01 sec. Number of new points being plotted : 46304 Number of new points not being plotted : 56 Total Plotting time : 0.429 sec. Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.67 sec. Time to extract Flags : 0.02 sec. Number of new points being plotted : 44437 Number of new points not being plotted : 151 Total Plotting time : 0.635 sec. ###OK WE ARE BACK WORKING CASA <127>: overplot=True CASA <128>: iteration='' CASA <129>: antenna='0' CASA <130>: go ----------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 23180 Attaching the main selected MS Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.68 sec. Time to extract Flags : 0.02 sec. Segmentation fault (core dumped) ###DAMN ###TRY AGAIN prefix='jupiter6cm.usecase' msfile = prefix + '.ms' default('plotxy') vis = msfile selectdata = True field = '1331+305' selectsp = True correlation = 'RR LL' xaxis = 'uvdist' yaxis = 'amp' multicolor = 'both' iteration = '' antenna='0' overplot=False replacetopplot=False removeoldpanels=True CASA <15>: inp ---------> inp() # plotxy :: Plot points for selected X and Y axes: vis = 'jupiter6cm.usecase.ms' # Name of input visibility xaxis = 'uvdist' # azimuth,elevation,hourangle,baseline,channel,time,u,v,w,uvdist,x yaxis = 'amp' # azimuth,elevation,hourangle,baseline,amp,pha,u,v,w,uvdist datacolumn = 'data' # data (raw), corrected, model, residual (corrected - model) Data selection parameters (see help plotxy and help par.selectdata) field = '1331+305' # field names or index of calibrators: ''==>all; field ='3C286,P1321*', field= '0~3' spw = '' # spectral window:channels: ''==>all, spw='1:5~57' selectdata = True # Other data selection parameters antenna = '0' # antenna/baselines: ''==>all, antenna = '3,VA04' timerange = '' # time range: ''==>all correlation = 'RR LL' # correlations: default = '' scan = '' # scan numbers: Not yet implemented feed = '' # multi-feed numbers: Not yet implemented array = '' # array numbers: Not yet implemented uvrange = '' # uv range''==>all; uvrange = '0~100kl' average = '' # Select averaging mode: time or channel subplot = 111 # Panel number on display screen (yxn) overplot = False # Overplot values on current plot (if possible) showflags = False # Show flagged data iteration = 'antenna' # Plot separate panels by field, antenna, baseline, scan, feed plotsymbol = '.' # pylab plot symbol plotcolor = 'darkcyan' # pylab plot color markersize = 5.0 # Size of plotted marks linewidth = 1.0 # Width of plotted lines connect = 'none' # Specifies which points are connected with lines plotrange = [-1, -1, -1, -1] # The range of data to be plotted, can be time values skipnpoints = 1 # Plot every nth point multicolor = 'both' # Plot polarizations and channels in different colors replacetopplot = False # Replace the last plot or not when overplotting removeoldpanels = True # Turn on/of automatic clearing of panels title = '' # Plot title (above plot) xlabels = '' # Label for x-axis ylabels = '' # Label for y-axis fontsize = 10.0 # Font size for labels windowsize = 1.0 # Window size CASA <16>: go ---------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 23180 Attaching the main selected MS Init PlotFlag Setup custom features Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.52 sec. Time to extract Flags : 0.02 sec. Number of new points being plotted : 46304 Number of new points not being plotted : 56 Total Plotting time : 0.414 sec. CASA <17>: End of iterations. ###I CLICKED THE NEXT BUTTON THERE JUST TO SEE WHAT WOULD HAPPEN CASA <17>: go ---------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 23180 Attaching the main selected MS Wed Aug 22 00:04:42 2007 SEVERE : [msplot::checkinputs()] Exception Reported: TablePlot: No Table is Set.... *** Error *** No data selected - please check inputs CASA <18>: go ---------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 23180 Attaching the main selected MS Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.51 sec. Time to extract Flags : 0.02 sec. Number of new points being plotted : 46304 Number of new points not being plotted : 56 Total Plotting time : 0.513 sec. CASA <19>: go ---------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 23180 Attaching the main selected MS Wed Aug 22 00:06:19 2007 SEVERE : [msplot::checkinputs()] Exception Reported: TablePlot: No Table is Set.... *** Error *** No data selected - please check inputs CASA <20>: go ---------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 23180 Attaching the main selected MS Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.5 sec. Time to extract Flags : 0.01 sec. Number of new points being plotted : 46304 Number of new points not being plotted : 56 Total Plotting time : 0.405 sec. ###IT SEEMS TO ALTERNATE WORKING AND NOT CASA <21>: antenna='1' CASA <22>: go ---------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 23180 Attaching the main selected MS Wed Aug 22 00:07:51 2007 SEVERE : [msplot::checkinputs()] Exception Reported: TablePlot: No Table is Set.... *** Error *** No data selected - please check inputs CASA <23>: go ---------> go() Executing: plotxy() Number of rows in the selected Measurement Set : 23180 Attaching the main selected MS Preparing the plotter.. Reading data... Time spent reading X and Y data from disk : 0.51 sec. Time to extract Flags : 0.02 sec. Number of new points being plotted : 46304 Number of new points not being plotted : 56 Total Plotting time : 0.407 sec. ###NOTE THAT THE PLOT SAYS ANTENNA1 : 0 EVEN THOUGH THE LOGGER ###SAYS ITS SELECTING ANTENNA1 = 1 Wed Aug 22 00:11:21 2007 NORMAL : Data to be selected from matches the following: Baselines: [1, 2], [1, 3], [1, 4], [1, 5], [1, 6], [1, 7], [1, 8], [1, 9], [1, 10], [1, 11], [1, 12], [1, 13], [1, 14], [1, 15], [1, 16], [1, 17], [1, 18], [1, 19], [1, 20], [1, 21], [1, 22], [1, 23], [1, 24], [1, 25], [1, 26], [1, 27], [1, 28] Fields: 1331+305 Scan Numbers: *ALL* -- 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93 UVRanges: *ALL* Spectral Windows: *ALL* -- SPW 0: *ALL Channels* -- 1 to 1 with a step of 1 SPW 1: *ALL Channels* -- 1 to 1 with a step of 1 Correlations: RR, LL Time range: *NONE*, all times selected Note that NOT all of the falling with in the bounds of the above selection may be plotted. For example, the flagged data is plotted only if 'showflags' is set to True. ###I DO NOT UNDERSTAND THIS BEHAVIOR Submitted as JIRA defect CAS-253 https://bugs.aoc.nrao.edu/browse/CAS-253