Summary of activities July 2016 - Sep 2016

WP1 - Management

  • Second payment after justification received and sent to the partners.
  • Budget from CSIC cleared and payment reimbursed.
  • Minor adjustment in budget by Univ. Bristol accepted by the PO.

  • X. Luri and A. Brown actively participated in the coordination of the Gaia Data Release 1 (DR1) that took place on the 14th September 2016. A. Brown was one of the speakers at the DR1 press conference:

WP2 - User community

  • For the DR1, WP2 has ensured that the archive has been tailored to the actual user needs
    • User requirements gathering for the archive design
    • User requirements implementation verification
    • Coordination of the archive beta-testing
  • For collaboration of other astrometry mission (JASMINE), we have discussion on Small-JASMINE calibration with European partner, Michael Biermann and Wolfgang Loeffler, AIR at National Astronomical Observatory of Japan during 2nd to 4th Aug.
  • Further development of the BEANS software. The revision for the reviewer's report of the paper about BEANS has been submitted to MNRAS (Hypki).
  • Work on the deliverable D2.9 "Requirements specification for model comparison and optimization tools". The document is being prepared on the basis of examples which compare Gaia archive and a numerical simulation of the Milky-Way like galaxy within the BEANS software (Hypki).

WP3 - System design

T3.1 Technical Coordination

N Hambly continued to coordinate between GENIUS WPs 3 and Gaia CU9 WPs 920 (documentation), 930 (system architecture), 973 (data mining) and 974 (cross match infrastructure).

T3.2 Aspects of archive interface design

  • For the DR1, WP3 has contributed to the robustness of the archive design
    • Contribution to the definition of the archive data model
    • Coordinated review of end-user Data Model documentation, including VO UCD1+ content, between DPAC CU9, ESAC and ESAC-SDC
    • Enhancements to DPAC MDB Dictionary Tool in support of published catalogue Data Model
    • Bug fixing and enhancements to ADQL parser (as employed within Gaia archive)
    • Testing of ADQL interface and provision of example queries

T3.3 VO infrastructure

SW contributions made available via GitHub (note acknowledgement of EC FP7 funding at the bottom of these pages!):

Pyrothorn - Testing suite for Firethorn, TAP, SQLServer, DQP & Deployment Scripts

TAP Autocomplete - Javascript Autocomplete library for TAP, to be used by GACS

Taplib (Fork of Gregory's code) - Enhancements, Bug Fixes and Modifications to ADQL Parser needed for Firethorn & the Genius demonstrator

T3.4 Data Centre collaboration

S. Voutsinas visited E-SDC to integrate the ADQL autocomplete facility into GACS (5-8 July 2016). GWT library further enhanced for functions requested by E-SDC. Outcomes: Both sides understood what modifications would be required on each side to support this. Work was done on this during and after the trip and an integrated template is available which they are testing and plan on adding very soon.

T3.5 Data mining environments

First draft of Docker paper completed ( dockerpaper.pdf).

WP4 - Data Exploitation

T4.2 - Visualization

T4.3 - Data Mining

T4.4 - VO tools and services

  • Assist ESAC in ensuring they run a standards-compliant TAP service:
    • Testing by hand and filing support tickets for issues discovered
    • Supply/support automated TAP service validation tool (taplint)

  • Implement GUI client in TOPCAT for CDS X-Match service
  • Provide miscellaneous support by email for STIL infrastructure library to developers at ESAC and ARI developing TAP services
  • Investigations and software development for generating all-sky density maps from database queries

WP5 - Validation

  • For the Gaia DR1, WP5 has made a strong contribution to the validation of the Gaia DR1 data:
    • implement general sanity checks on the fields of the Catalogue
    • check the accuracy and precision of the Catalogue parameters
    • verify the correct distribution of these parameters, in particular the absence of large numbers of outliers
    • study the completeness of the Catalogue
    • detect as much as possible instrumental or data processing problems
    • and more generally check what would not be covered by the internal CU verifications, i.e., in particular, cross-CU checks.
  • Most of the work during this period has been devoted to writing the release documentation and the submitted paper

T5.1 - Technical coordination

  • For the validation results, coordination of ~60 pages in the catalogue written by the WP leaders, documenting the validations methods and findings. We tried to assess in particular as much as possible the level of precision and of systematics in the astrometry and photometry, and the completeness of the catalogue, thanks to all tests which have successfully run.
  • A paper has been submitted to Astronomy & Astrophysics with all these results.
  • K. Findeisen, GENIUS post-doc, after having done a considerable work in T5.2, has left the project to work on LSST.
  • New recruitement is being attempted

T5.2 - Definition of problem cases, validation scenarios and tools

  • As for the content, the pre-DR1 data received was filtered from:
    • 164 446 sources with inconsistent G-BP vs G-RP colours
    • 746 292 sources with less than 10 observations, producing wrong G magnitudes
    • 37 433 092 duplicate sources and 35 951 041 sources were flagged as duplicated sources.

T5.3 - Simulation versus reality: from models to observables

  • A new GOG simulation is now being used

T5.4 - Confronting Gaia to external archives

  • L. Ruiz-Dern has finished her manuscript and preparing for defense of her PhD mostly related to the tests developed in T5.4

T5.5 - Data demining: outlier analysis

  • Work done for DR1 has been documented

T5.6 - Transversal tools for special objects

  • Solar system objects: work is being prepared for DR2

WP6 - Support

  • For the Gaia DR1, WP6 has provided:
    • Provision of two large simulations of DR1 for system tests and validation of DR1 software
    • Contribution to the science alerts system
    • Implementation and support of the community portal (Gaiaverse)

T6.2-Simulated Catalogue

T6.3-Science Alerts testbed

WP7 - Dissemination

  • For the Gaia DR1, outreach material was produced:
    • A video, used to promote the data release (even by ESA itself):: Notice the GENIUS credits all around and the proper credits to GENIUS/FP7 at the end
    • The all-sky image that has become the icon of the data release is here: It was created and conceived by André Moitinho (GENIUS Portugal partner) and Márcia Barros (GENIUS fellow)
    • The GENIUS Gaiaverse site has been a node for multilingual, multicountry dissemination of the data release (available in 12 languages)
    • community portal (multilingual, 12 languages; more to be added) Social networks and news distribution.

In the first 24 hours (14-15 Sept.) the impact of Gaiaverse on the DR1 release has been as follows:

  • Twitter account:
    • 10.4K impressions, described as the delivery of a post or tweet to an account's Twitter stream. We earned 5.2K impressions per day. The more impressions we get, the more visibility the post has.
    • 1.9% engagement rate
    • 82 link clicks (on average, we earned 41 link clicks per day)
    • 69 retweets (on average, we earned 35 Retweets per day)
    • 58 likes (on average, we earned 29 likes per day)
    • 32 new followers in 24 hours

  • Gaiaverse website:
    • From Sept. 14 to Sept. 15, the website got 420 sessions initated by more than 350 users, of which 22.6% were returning visitors and 77.4% were new visitors. They've visited more than 1,000 pages (1,071 to be exact), that is an average of 2.55 pages per session. Globally, its bounce rate has been of 55.33%, that compared to the usual 60-65% means that a large percentage of users were engaged with the website's content without leaving it too early.
    • The homepage in its English version has been the most visited page (249 views), followed by the one dedicated to the DR1 in English (2nd, having 71 views) and German (3rd, with 65 views).
    • Being Gaiaverse a multilingual portal it is also interesting to see from which country did Gaiaverse receive more visitors during the DR1 release. Here's the top five:
      • USA
      • Germany
      • UK
      • Spain
      • Slovenia
    • Overall, sessions on Gaiaverse were distributed as follows during these hours:
      • Organic search (38.10%)
      • Referral (33.10%)
      • Direct (19.05%)
      • Social (9.76%)

  • Social networks such as Twitter and Facebook contributed to increase sessions on Gaiaverse as well. Of the 41 sessions via social referral (this 9.76%), 23 came from Facebook (56.10%) and 18 from Twitter (43.90%).

T7.1 - Coordination of dissemination activities

T7.2 - Community portal infrastructure

T7.3 - Community portal, outreach and academic activities

  • minutes.pdf: Output of 2nd to 4th Aug meating at NAOJ.

Topic attachments
I Attachment History Action SizeSorted descending Date Who Comment
PDFpdf SmallJASMINE-Calibration.pdf r1 manage 4910.6 K 2016-10-21 - 23:23 YoshiyukiYamada Output of 2nd to 4th Aug meating at NAOJ.
PDFpdf dockerpaper.pdf r1 manage 510.4 K 2016-10-25 - 14:42 NigelHambly First draft
PDFpdf minutes.pdf r1 manage 32.0 K 2016-10-21 - 23:23 YoshiyukiYamada Output of 2nd to 4th Aug meating at NAOJ.
More topic actions...
Topic revision: r6 - 2016-10-30 - ArkadiuszHypki
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback