Deployment history - Archive related software - JMB

2009-11-09 report :
   archive servlet  : 5.6.24, 2009-10-30
   e2eftp.cgi       : 2.5.11, 2009-09-03
   getSDMFileSet.py : 1.3.1,  2009-10-29

2009-11-16 report :
   archive servlet  : 5.6.25, 2009-11-12 - data quality column, fix VO Tbl
   e2eftp.cgi       : 2.5.13, 2009-11-16 - supports remote host for casa
   getSDMFileSet.py : 1.3.3,  2009-11-16 - supports remote host for casa

2009-11-23 report :
   sdm/bdf ingest   : 1.0.0   2009-11-16 - direct bdf transfer to ngas
   archive_socketserver       2009-11-17 - casa remote host, fixed bug
   ngamsServer  v3.2ALMA      2008-01-01 - NGAS Server
   ngamsCClient v4.0ALMA      2009-03-11 - NGAS Clinet (C and PY)
   archive servlet    5.6.26, 2009-11-19 - secure area for files > 2.2GB

2009-11-30 report :
   getSDMFileSet.py : 1.3.4,  2009-11-24 - supports spect/time avg, casa.split
   sdmToMSScript.py : 1.3.4,  2009-11-24 - supports spect/time avg, casa.split
   e2eftp.cgi       : 2.5.14, 2009-11-24 - supports spect/time avg, casa.split
   
2009-12-07 report :
   ngamsServer v3.2ALMA       2009-12-04 - NGAS Server, aocngas-4, cv-evla-ngas-4
   ngamsCClient v4.0ALMA      2009-12-04 - NGAS Client, aocngas-4, cv-evla-ngas-4
 
2009-12-14 report :
   e2eftp.cgi       : 2.5.18, 2009-12-07 - fix minor bugs
   archive servlet    5.6.29, 2009-12-10 - tidy up appearance

2009-12-21 report :
   moveSDMBDFtoQueue :        2009-12-17 - python-sax parseSDMTableHeader

2009-12-28 report :   
   ingestSDMBDFintoNGAS         1.0.1, 2009-12-23 - direct files to aocngas-4
   autoingestSDMBDFintoArchive  1.0.5, 2009-12-23 - faster polling
   archive_socketserver       2009-12-23 - casa remote host : cv-evla-ngas-4
   archive_socketclient       2009-12-23 - casa remote host : cv-evla-ngas-4

2010-01-04 report :
   getSDMFileSet.py : 1.3.7,  2009-12-31 - able to deliver sdm.xml files only
   archive servlet  : 5.6.31, 2010-01-02 - DQ link fix

2010-01-11 report :   
   getSDMFileSet.py : 1.3.8,  2010-01-08 - uses /usr/bin/casapy-test
   archive_socketserver       2010-01-09 - casa remote host : capella.aoc.nrao.edu
   archive_socketclient       2010-01-09 - casa remote host : capella.aoc.nrao.edu

2010-01-18 report :
   archive_socketserver       2010-01-11 - casa remote host : dubhe.aoc.nrao.edu
   archive_socketclient       2010-01-11 - casa remote host : dubhe.aoc.nrao.edu
   autoingestBDFintoArchive   2010-01-12 - polls cbe area /home/lustre-widar
   copyBDFtoStage             2010-01-12 - polls cbe area /home/lustre-widar

2010-01-25 report :
   getSDMFileSet.py : 1.3.9   2010-01-18 - catch and log more errors, exit
   SDMCataloger     : 1.2.23  2010-01-20 - fixed proprietary time bug
   
2010-02-01 report :
   archive servlet    5.6.37  2010-02-01 - fixed thread interrupt bugs
   autoingestBDFintoArchive   2010-02-01 - round-robin bdf's to four archive streams
   autoingestSDMBDFintoArchive2010-02-01 - round-robin sdm's to four archive streams

2010-02-08 report :
   archive servlet    5.6.39  2010-02-04 - more small thread changes, minor fixes
   e2eftp.cgi         2.5.21  2010-02-04 - supports create MS with all ASDM tables included
   getSDMFileSet.py   1.3.11  2010-02-04 - supports create MS with all ASDM tables included
   sdmToMSScript.py   1.3.11  2010-02-04 - supports create MS with all ASDM tables included
   
2010-02-15 report :
   e2eftp.cgi         2.5.22  2010-02-08 - exports for getSDMFileSet direct Oracle connection
   getSDMFileSet.py   1.4.1   2010-02-08 - direct Oracle connection, cx_Oracle
   ingestSDMBDFintoNGAS       2010-02-09 - moved deployment from evlangas-1 to aocngas-4
   archive servlet    5.6.40  2010-02-10 - added Historical VLA to download page

2010-Feb-22 report :
   sdmToFitsScript.py 1.0.0   2010-02-19 - catch casa error msgs
   getSDMFileSet.py   1.4.4   2010-02-18 - catch casa error msgs
   sdmToFitsScript.py 1.0.0   2010-02-19 - catch casa error msgs
   archive_socketclient.py    2010-02-15 - redeploy on host acorn
   e2eftp.cgi         2.5.25  2010-02-18 - modify email message for evla

2010-Mar-01 report :
   getSDMFileSet.py   1.4.5   2010-02-26 - proper format email for secure data
   e2eftp.cgi         2.5.27  2010-02-26 - evla secured data help in /home/e2earchive/stage

2010-Mar-08 report :
   getSDMFileSet.py   1.4.6   2010-03-07 - disable delete sdm/bdf and ms for now
   archive_servlet    5.6.41  2010-03-02 - change data file page format

2010-Mar-15 report :
   sdmToFitsScript.py 1.0.0   2010-03-08 - change exportuvfits param : writesyscal=True
   getSDMFileSet.py   1.4.6   2010-03-09 - changed error : exportuvfits now called /usr/bin/casapy-test
   e2eftp.cgi         2.5.28  2010-03-09 - passes user email address to getSDMFileSet.py

2010-Apr-05 report :
   sdmToFitsScript.py 1.0.0   2010-03-30 - includes splits for sw sets (sdmToFitsScript.py.100330)
   sdmToFitsScript.py 1.0.0   2010-03-31 - removed splits for sw sets (sdmToFitsScript.py.100330)
   getSDMFileSet.py   1.4.9   2010-03-30 - includes splits for sw sets (getSDMFileSet.py.1.4.9.100330)
   SDMCataloger       1.2.28  2010-03-22 - clean up pom.xml, under netBeans, load project_id from PDS db
   archive servlet    5.6.45  2010-03-26 - under netBeans, others
   SDMCataloger       1.2.28  2010-03-31 - fix Ka band error 
   ingestSDMBDFintoNGAS 1.0.2 2010-03-31 - fixed broken test, ngamsCClient -status

2010-04-13 report :
   SDMCataloger       1.2.29  2010-04-09 - recovers SbType, will set project lock correctly, tweaks
   e2eftp.cgi         2.5.29  2010-04-06 - pass flag swc to getSDMFileSet.py
   archive_servlet    5.6.45  2010-04-06 - add flag/no flag swx to download page
   getSDMFileSet.py   1.4.10  2010-04-06 - flag data swx
   sdmToMSScript.py   1.0.0   2010-04-06 - flag swx to importevla

2010-05-03 report :
   autoExecute..      1.0.0   2010-04-29 - executes download/convert requests in queue
   archive_socketserver       2010-04-29 - for MS,UVFITS directs exec scripts to queue dir
   getSDMFileSet.py   1.4.11  2010-04-30 - swx to /home/ballista3/casa/archive/linux_64b/bin/casapy
   archive.war        5.6.46  2010-05-03 - adds filesize to file_set_id text list
   runCompressProjectTblAll   2010-05-05 - cronjob on aocngas-master (every 10 mins)
   e2e-sdmcataloger.jar.1.2.33.100503 2010-05-05 - swx over to better lock/public determination
   autoingestSDMBDFintoArchive2010-05-05 - 1.0.1, place 'loc' in archfilelocation sql file name
   e2e-sdmcataloger.jar.1.2.33.100503 2010-05-06 - bug fix for EXPERT observations

2010-06-11 report :
   archive.war        5.6.48  2010-06-11 - remove segment from query type - archiveproject.jsp
   getSDMFileSet.py   1.4.15  2010-06-10 - fixed incorrect mail file path
   cleanUpCBEStaging          2010-06-10 - fixed dumb bug, not cleaning correctly

2010-06-14 report :
   ngamsServer        V3.2-ALMA 2010-06-09 - installed and operational, host : ngas@aocngas-5
   ngamsServer        V3.2-ALMA 2010-06-09 - installed and operational, host : ngas@aocngas-6
   ngamsServer        V3.2-ALMA 2010-06-09 - installed and operational, host : ngas@aocngas-7
   ngamsServer        V3.2-ALMA 2010-06-09 - installed and operational, host : ngas@aocngas-8
   ngamsServer        V3.2-ALMA 2010-06-09 - installed and operational, host : ngas@cv-evla-ngas-5
   ngamsServer        V3.2-ALMA 2010-06-09 - installed and operational, host : ngas@cv-evla-ngas-6
   ngamsServer        V3.2-ALMA 2010-06-09 - installed and operational, host : ngas@cv-evla-ngas-7
   ngamsServer        V3.2-ALMA 2010-06-09 - installed and operational, host : ngas@cv-evla-ngas-8
   catalogVLBAFITS              2010-06-16 - catalogVLBAFITS.c, fits_SU_header.c, fits_UV_scans.c, handles
                                             source name string > 16 char, number of sources <= 2000
   
2010-06-25 report :
   moveSDMBDFtoQueue  1.0.2     2010-06-17 - testing four parallel SDM data lines
   cleanUpSDMBDFarchived        2010-06-17 - in cronjob list, clean the four NGAMS queue areas
   autoingestBDFintoArchive 1.10.1 2010-06-17 - test four parallel bdf data line
   autoingestSDMintoArchive 1.0.2  2010-06-25 - streamlines ingest SDM file sets

2010-07-01 report :
   autoingestSDMintoArchive 1.0.3  2010-07-01 - copied sdm.xml files into NGAMS (1,2,3,4)
   moveSDMBDFtoQueue  1.1.3        2010-01-01 - turned on four data streams to (1,2,3,4)
   autoingestBDFintoArchive.1.10.2.100630 2010-06-30 - turned on four data streams (bdfs)

2010-07-05 report :
   archive.war       5.6.48  2010-07-07 - svn merge branch and trunk, production war file from trunk

2010-07-12 report :
   getSDMFileSet.py  1.4.15 2010-07-15 -- calls /home/ballista3/casa/archive2 for now, flagbackup=False  
   sdmToMSScript.py  1.0.0  2010-07-15 -- in importevla(..flagbackup=False)

2010-08-06 report :
   archive.war       5.6.52 2010-08-06 - includes download token, fixed up query string, no A.*
   autoloadsqlcatalog       2010-08-06 - installed runCompressProjectTblDIFX32, runCompressProjectTblEVLA32
   compressProjectTblEVLA.py 2010-08-06- delete and insert project rows into db directly
   compressProjectTblDIFX.py 2010-08-06- delete and insert project rows into db directly
   archive.war       5.6.53 2010-08-09 - uncheck tar option on archive data file page

2010-08-15 report :
   archive.war       5.6.54 2010-08-10 -
   autoExecuteArchiveDownloads
                     1.0.2  2010-08-14 - start scripts with /bin/sh
   getSDMFileSet.py  1.5.2  2010-08-13 - fatal errors write and send email, add -sources to cmd line
   sdmToMSScript.py  1.0.0  2010-08-13 - fixed small bug
   createNewEVLAProjectKeys.py
                     1.0.0  2010-08-09 - called from autosqlloadcatalog
   createNewDIFXProjectKeys.py
                     1.0.0  2010-08-09 - called from autosqlloadcatalog

2010-08-23 report :
   autoingestBDFintoArchive
                     1.10.3 2010-08-20 - includes huge bdf file detection, marks .bad

2010-08-31 report :
   getSDMFileSet.py  1.5.3  2010-08-31 - for missing bdf files, write ERROR msg and continue.