[AAA] Mejoras en la base de datos de Gemini (GSA)

[Oficina Gemini Argentina]

Les extendemos el aviso sobre los ultimos cambios en la interfaz de acceso
al archivo de imagenes de los telescopios Gemini.

Saludos,

Oficina Gemini

========================================================================

Recent Changes at the GSA

1. Processed calibration files: we are now ingesting into GSA any  
processed calibration files that are created.  These could be master  
biases or flats, spectroscopy standards, etc, in fact anything that  
has been processed and has the OBSCLASS not equal to SCIENCE.   At  
present, the reduced cals being regularly produced are somewhat  
restricted.  However, in the future we anticipate that all cals will  
be reduced and archived.  Any archived processed cals are  
automatically associated with raw science datasets and are available  
for download on various query results pages.  There is also a special  
query page just to search for processed calibrations.   All  
calibration (raw or processed) are non-proprietary and so even though  
they are now generally taken under specific GEMPRGIDs, they are still  
available to any user of the GSA.   They are also distributed with PI  
data packages via electronic transfer.

2. URLs: The URL of the GSA at CADC has become rather complex due to  
the introduction in Canada of bi-lingual URLs.   The current full URL  
of the GSA is now: http://www.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/ 
gsa/.   To make access a little more intuitive and the URL simpler  
we've introduced two new URLs that users can goto.  these are:   
http://gsa.gemini.edu and http://archive.gemini.edu.

3. Pre-Imaging: As of a month of so ago, GMOS-N/-S pre-imaging is now  
ingested into the GSA and available to PIs via electronic transfer.   
This replaces the manual process of placing the pre-imaging in a  
'hidden' ftp directory and telling the PIs the URL.   It is now a  
more secure process and pre-imaging is available in the GSA.   This  
significant addition means that in the near future ALL processed  
science data will be ingested into the GSA.  Of course, the processed  
datasets need to be regularly and automatically (as possible) created  
for this to occur.

4. Dataflow: The dataflow project at Gemini is well under way and the  
first step is close to completion.  This is the installation of the  
DataManager system which controls the 'flow' of data through the  
Observatory to the GSA.   At present, raw data from Gemini South  
instruments flows from the summit DHS to the GSA within minutes of  
acquisition.  The same will occur at Gemini North in December 2005.    
This enhancement means that PIs could get access to raw (unchecked,  
no quality control) data quickly.   As data checking and quality  
control take place, the raw datasets in GSA are replaced with  
subsequent version.

5. Gemini Web Pages: The Gemini external web pages on GSA have  
recently been updated to reflect the current status of the project.    
The internal GSA web site has also undergone a major upgrade.

6. Electronic Data Distribution: The full version of the PI  
electronic transfer and distribution (PIETD) system is now in  
operation at GSA.   PIs now get raw science data, processed  
calibration data, xml science programs, obslogs, iraf cl scripts/log,  
weather/environmental data, readme files, and any additional  
information available (e.g. MDFs for multi-object spectrographs -  
currently GMOS-N/-S).  The next step that is currently being worked  
on at CADC is advanced logging and reporting to allow us to track  
data packages and produce monthly reports on the operation of  
PIETD.   When processed science data becomes available, this also  
will be distributed in the data packages.   Raw calibration data,  
which can be significant in size, is available via 'complete catalog  
queries' at GSA if required by PIs/users.  Since PIETD was  
introduced, requests to the GSA have sky-rocketed (see attached table).

7. SV data: Current, all SV data packages (tarballs with complete  
datasets including processed data) are ingested into the GSA and are  
available for download.   This has been working in parallel with the  
Gemini (HI) SV download page.  However, we are planning on  
terminating the local Gemini page and re-directing all SV queries to  
the GSA.   In addition to this change, we are also planning on  
treating SV datasets as queue and classical dataset and ingesting  
them individually into GSA as they are acquired.   The proprietary  
period will generally  be set to 3 months.   This will hopefully make  
SV data more useful to the community and produce data that is  
available for general use in a timely manner.   As processed datasets  
are created from SV data these will also be ingested into the GSA  
together with the final tarball when available.

--
Dr. Colin Aspin

Gemini Scientist
Project Scientist -  Gemini Science Archive

Gemini Observatory
670 N. Aohoku Pl.
Hilo, HI 96720

(808) 974-2580 (ph)
(808) 935-9650 (fax)
(808) 960-5089 (cell)
caa en gemini.edu (e-mail)