DPCB: Data Processing Center of Barcelona

DPCB is embedded in the Gaia DPAC group at the University of Barcelona (IEEC-UB), in close cooperation with the Barcelona Supercomputing Centre (BSC) and the Consorci de Serveis Universitaris de Catalunya (CSUC), in Barcelona, Spain.

The DPCB hardware used in Gaia operations is located at the BSC (specifically the MareNostrum supercomputer), whereas the team at the IEEC-UB carry out the management, operations, development and tests.

DPCB runs the following systems during operations:

  • Intermediate Data Updating (IDU) from CU3, mainly composed of IDU-XM (cross-match), IDU-CAL (calibrations) and IDU-IPD (the main process, determining the Image Parameters).
  • DpcbTools from DPCB, including the DPCB Data Manager (DDM) and DPCB Monitoring tools (DMON).
  • Gaia Transfer System (GTS), including Aspera and DTSTool from CU1, for the data transfers from/to DPCE.

DPCB is part of the DPAC cyclic processing and runs the several stages of IDU (XM, CAL and IPD) every cycle. Depending on the inputs available, particularly at the beginning of operations, only some subsystems might run. On later stages of the mission, repeated executions of these subsystems may be needed during a given cycle.

Data reception and arrangement runs on a daily basis over the data sent continuously by DPCE.

DPCB overall processing aims to provide an updated cross-match table (using the latest attitude and source catalogue available), updated calibrations (for bias, background and instrument response in form of a LSF), and updated image parameters using such calibrations. All this will improve the results of all the other DPAC systems (mainly AGIS and PhotPipe) as they will use the updated data leading to better results.

DPCB also participates actively in the definition and design of the overall DPAC strategy for the cyclic activities involved in the Gaia data reduction.

Finally, another important role of DPCB has been the generation of CU2 simulation datasets for development and testing of the whole DPAC products. CU2 simulations have been essential prior to Gaia launch to test DPAC daily processing software and will still be used, even after launch, to test the cyclic processing chains. Currently simulations are still being generated for the CU9 software validation and testing. These simulations are essential for the preparation for the first Gaia catalogue release.

 

DPCB Hardware

 

MareNostrum:

One of the most powerful supercomputers in Europe is in charge of running IDU during its operational phase. The last BSC upgrade, MareNostrum III, is composed of 3028 computing nodes, each with 16 cores of Intel SandyBridge-EP E5-2670 processors (2.6 Ghz), 32 GB of RAM and 500 GB local disk. They are interconnected using a point–to–point fiber optic network (Infiniband 10Gb).

The central file system of MareNostrum, build upon IBM GPFS, is composed of more than 20 storage servers which provide a total capacity of 1.9 PB, offered globally to all the nodes and providing a parallel access through 10Gb Ethernet. Besides, a long-term storage is available, offering about 5 PB, which will be used for long-term storage of IDU input data (Raw DB) and also to store the final output data from IDU.

DPCB also uses a virtual server provided by BSC to allow some specific tasks to run, mainly related to data transfers and arrangements.

Consumed CPU Hours at BSC

CESCA/CSUC Hardware:

Xeon 8–core cluster (Prades):

It has 45 nodes, each with 2 quad-core Intel Xeon processors. 29 of the nodes have Xeon E5472 at 3 GHz and 32 GB RAM, while the other 16 have Xeon X5550 at 2.66 GHz (identical to those used for IDT operations at DPCE during the first months of the mission) and 48 GB RAM. The total processing performance is 2.68 TFLOP.

Altix UV cluster (Pirineus):

This is a shared-memory system with 1344 Intel Xeon X7542 cores (2.66 GHz) and 6056 GB RAM, offering about 14 TFLOP. It is used for GOG simulations for CU9 and specific scientific simulations related to Gaia.

Consumed CPU Hours at CSUC

DPCB Software

DPCB also develops software within DPAC, specifically DpcbTools. This product includes a set of tools and framework developed to allow DPAC applications to make best use of the hardware available at DPCB (especially on BSC hardware). The main features provided by this product are:

  • Data Access Layer (DAL), servers and caches, specially developed for each of the repositories of DPCB-BSC, namely: a local repository for each node, remote repositories from other nodes, one global repository for all the nodes (GPFS), and a backup or permanent repository. The DAL looks for the most efficient usage of them, especially considering the I/O requirements of CU3-IDU. The data servers and caches will efficiently manage the access to certain data that several processes may need. Each node will have a cache for some data, while other data will be stored at caches or servers shared between several nodes.
  • Node and task management tools, for determining and launching the tasks needed for the processing of some given data, and also to manage such tasks and the nodes where they are being executed.
  • DPCB Data Manager (DDM), main interface between GTS and the DPCB storage resources. This software is in charge of handling the received data from DPCE, perform data backups and manage data transfers to DPCE.
  • DPCB Monitoring Tools (DMON), also developed with BSC hardware in mind but applicable to CESCA/CSUC and other DPCs as well.

DPCB quality assurance and operational readiness activities

DPCB has participated in several activities and test campaigns prior to operations to fully test the Data Processing Center (DPC).

Some of the preparation activities carried out are:

  • Testing data reception from DPCE at DPCB in the Two-by-Two stage 1 testing campaign from November 2010 to January 2011.
  • End-to-End Stage 2 tests, to test the reception and handling of data from DPCE (June-December 2011).
  • Two-by-two Stage 2 tests, testing the return of DPCB data to DPCE (November 2011 to January 2012).
  • End-to-End Stage 3 tests, testing the execution of IDU at DPCB and return of data to DPCE (first half of 2012).
  • Operations rehearsal 1, focused on the commissioning phase and thus just receiving and arranging the data received from DPCE. (June 2012)
  • Operations rehearsal 2, focused on the commissioning phase and thus just receiving and arranging the data received from DPCE. (December 2012)
  • Operations rehearsal 3, focused on the commissioning phase and thus just receiving and arranging the data received from DPCE. (April 2013)
  • Operations rehearsal 4, focused on the nominal phase, just receiving and arranging the data received from DPCE. (September 2013)

DPCB participates in all the validation and qualification activities defined in the DPAC Operations Validation Plan, including rehearsals and challenges, as well as preliminary data processing tests with the very first data received from the spacecraft during commissioning.

DPCB relevant milestones over the last years

2009:

  • GASS and GOG cycle 6 version datasets and release integrated into DPCB
  • IDT and IDU tests for software release in developments cycles 6 and 7

2010:

  • Web deployment of IDT scientific results obtained with IDV at DPCB-CESCA
  • Web monitoring of IDT progress at DPCB-CESCA
  • DPCB Local Repository for IDU with Ingestor from ESAC through GTS
  • Generation of the first dataset for end-to-end DPAC software tests (6 months of simulated Gaia data) and second dataset for end-to-end DPAC software tests (12 months of data)
  • GASS simulator release with optimized I/O developed with the help of DPCB integrated and tested
  • Integration and testing of IDT and IDU for cycle 8 software versions
  • DPCB two-by-two tests with DPCE.

2011:

  • Full-scale high-density 24h GASS simulation generated
  • Tests with IDT using the full scale data at DPCB-CESCA
  • GTS 2by2-Stage2 tests passed successfully
  • IDU First complete version of Data Arrangers (including jobs creation) tested at DPCB
  • First version of MPJ-based data caches included in DpcbTools tested

2012:

  • DPCB-BSC Review and decision of final system architecture for IDU
  • IDU executed successfully for the end-to-end Stage3 tests
  • IDU performance testing campaign and resources estimations
  • Started development and test of HDF5 specific file format for DPCB
  • Developments on the DpcbTools software and GTS integration

2013:

  • MareNostrum upgraded. Software updated to run on the new machine
  • DPCB server at BSC upgraded for better performance, more disk space and better reliability before entering operations
  • DpcbTools and GTS Operational readiness tests for DPCE-to-DPCB data transfers
  • Generation of GASS datasets for operational readiness tests of critical daily systems

2014:

  • Large-scale GASS simulation for DPAC systems volume testing
  • Complete mission catalogue simulations with GOG for CU9 tests
  • Generation of GASS datasets for IDU and AGIS operational readiness tests. This includes two 5-years simulations
  • Large IDU-XM test focused on framework performance using 5-years of simulated data
  • DpcbTools release with complete functionality for nominal operations and optimized for best performance
  • Operations Rehearsal for cyclic software
  • IDU tests on real Gaia data

2015:

  • First IDU execution in operations
to help homework do i need my how email meeting to for reminder write a concert dream hee chul dating 2010 aztecs homework help updating usps not tracking mail essay college revisor writing service tx dallas resume business papers writing be order chronological in a experience on resume should my recommendation i letter own of can write cant essay buy money happiness you can paper term who write my order order to lynoral how mail coursework for gcse sale plan for startup business medical device online quick imuno-ritz bipolar on article disorder custom uk reviews essays reviews service editing do my in spanish homework erfahrung neksi homework student help websites help report police writing gemstones hair loss evaluation essay customer service how present to paper an academic ucen online hranicaruv dating papers research chemistry on on essay use writing with everyday critical a help neuroscience thesis master statement thesis disorder spectrum autism help my with homework online annotated bibliography buy service writing custom coupon dissertation plan francais de buy college 2014 essays application tutoring help online get homework research of an essay macro analysis david hume paper mg 10 dosages propecia uk buy arcoxia justice do my homework criminal order lord essay flies and the of law me but for speech summary for thee free not summary frontier sample chapter thesis 1 jackson thesis turner for lines mechanical engineer objective resume recommendations cv resume services writing and online for school students help homework middle letter high school cover student phd labour migration thesis money english essay on reviews companies essay writing papers research custom assistance report writing application college level lines dating party other water like compounds behave if discovery homework education home help dissertation thesis phd fast cheap essay essay tales the canterbury pharmacy canadian minipress from sell help huck essay finn plan toronto writer in business media evaluation coursework a2 for buy will write paper i research by essays written addison joseph best applications 50 college for essays price best writing essay service does learn your help you homework essay admission good graduate help resume phd engineering essay college board korea service reviews dissertation paper my term write original do essay who can my for me essay model chinese help with writing london cv custom essay it easy dissertation and writing service homework help biostatistics on based hiring appearance essay report written write titles community essay service help extended writing essay business my write paper essay are best friends my books help tulip touch essay fast about article nation science food persuasive essay study disorder mona case dependent personality essays poverty costing order job essay help services thesis help hall prentice geometry homework cheap research paper enterprise for free letter for manager merchandising position cover reviews uk my essay write the essay helping environment architecture thesis oriented phd service counties carbon utah homework help plagiarized essay and best non essays forum papers help junior history tudors homework woodlands sumycin pills online buying application cover medical for letter job a buying essay essay my history do medieval for topics history essay york helpers homework new game dating alpha reference dissertation doctoral help honors national essay society paper holocaust the research college sale for essays admission e caviglie alle norvasc gonfiore help homework linear regression dating online hydromap do my paper someone pay to complex analysis homework help studyexamples disordercase anxiety executive letter purchase cover help get with homework purchase essay personal free texas papers divorce online writing notes soap patient study with of disorder bipolar case sales plan interview business for sample manager purchase resume help homework goverment medical of letters for recommendation school requesting report buy a to how dissertation mumbai help custom for placemats paper wedding 1 of for sale mg zocor papers buy term writer paper buy theology research homework my help do me reviews monster for writing resume service service writing forum reviews essay homework othello timeline help essay cheap my write for me thesis written custom paper for representative format resume sales start to admission university a how essay college rixton interview dating seacrest ryan assignment xml help paper is online buying plagiarism a in australia essay help review to literature someone a write pay thesis uk length phd a school on tips writing medical statement for personal affordable custom essay dissertation advice uk help maths coursework with system ordering thesis aboutonline cv exeter writing service dissertation bel ami help essay vancouver a tok essay buy writing paper school service law spectrum disorder essay autism dallas services writing resume nj best writing professional resume online va services dating literatura uk serbska game website dating video central services coast resume writing with money do assignment my help mechanics of homework materials seo writing companies dissertation search writing phd writing letter help essay login custom depressive case disorder study describing help words flowers homework who has service best essay the writing resume services cheap writing phd of physical thesis education teaching fellows essay help livraison soft cialis rapide acheter helper dissertation professional resume seattle service writing help fourier homework transform cheap thesis 12 and writers quality creative help writing books usa essay buy essay army values moon homework help the on computer essay purchase movie valentine's on dating double day forensics help homework scorpio dating aries novel blood in cold essay written on tthe 10 companies dissertation writing act top salt great lake help homework shipping overnight biaxin buy road analysis essay format critical theme the essay cv us writing service front description for job desk in my french homework do papers sats online plagiarism without essay buy denise dating richards online get essays service writing reserch paper