Run 1000 of the Initial Data Treatment system


Run 1000 of Initial Data Treatment (IDT) systemFigure 1. IDT web-based front-end tool showing the 1000th IDT run.
See here the animation about how the monitoring system behaves during a few hours of the mission.

 [Edited] We are proud ESA chose this Figure 1 as image of the week, as you can see at

Yesterday, June 9th 2016, almost two years after the start of Gaia’s nominal operations, the Initial Data Treatment system (IDT) finished its 1000th run – a remarkable milestone for this critical system in charge of the daily data processing in the Gaia Data Processing and Analysis Consortium (DPAC).

The IDT software is executed on some 28 computing nodes at the Gaia Science Operations Centre (SOC, at ESAC, near Madrid), receiving raw data from the spacecraft through the Mission Operations Centre (MOC, in Darmstadt), the MIT (MOC-SOC Interface Task), and the DCS (Decompression and Calibration Service). It processes spacecraft attitude data, astrometric, photometric, and spectroscopic instrument data, Basic Angle Monitor data, Wave Front Sensor data, and a handful of ancillary data packet types. Additionally, it runs complex algorithms to determine “intermediate data”: refined attitude, basic angle variations, sky background, image parameters (fluxes, positions, quality, etc.) and a first cross-matching (identification of measurements in the reference on-ground catalogue). These algorithms require several instrumental calibrations determined either by IDT itself or by other DPAC systems.

All this must be done in real-time, on a daily basis throughout the whole mission, to feed the so-called First Look diagnostics and calibration system, as well as all the downstream Data Processing Centres (DPCs). Thus, IDT feeds the whole Gaia consortium.

The Initial Data Treatment works in “runs”, which is a way to handle and identify a bunch of data measured and processed during a given time period. Typically, IDT does one run about every 23 hours of observations (there is no need to have exactly one IDT run per day). This allows enough data to be accumulated to get self-consistent outputs and perform representative diagnostics. During the first months of the mission, the IDT runs covered shorter time ranges to speed up some of these diagnostics and assess the health of the satellite and on-ground data processing systems.

IDT has its own diagnostics, generating over 9000 plots and statistics every day to determine the data quality and trends, allowing to detect potential inconsistencies or issues before they may become a problem (either on-board or on-ground). All this is accessible through a web-based front-end, but also PDF reports are automatically generated at the end of every run.

Figure 1 shows the main page of the tool, which shows the moment when Run 1000 was closed. One way to identify Gaia measurements is their acquisition time in ‘mission revolutions’ (spins of Gaia around its rotation axis). The four main plots of Figure 1 illustrate the mission time (vertical axes) of the several data types being received or processed at a given wallclock time (horizontal axes). Here IDT was recovering from a downtime to perform some maintenance, quickly reaching again the ‘real-time line’ (the dashed diagonal line on each plot). Vertical dashed lines indicate the Runs done. The progress indicators at the top show the numbers of ‘Elementaries’ (intermediate data outputs, one per measurement), the system status, the fraction of Runs done, the pending processing tasks, or the number of computing threads being used.

Sky-coverage of a typical IDT run.

Figure 2: Sky-coverage of a typical IDT run. Download here (your browser most probably won’t show it properly) a full resolution version.

To illustrate the daily workload and accuracy of the IDT system and Gaia, Figure 2 draws the equatorial sky coordinates (right ascension and declination), as well as the onboard-estimated brightnesses, of all objects detected, measured, downlinked and processed during a typical day, having “only” 43 million objects in this case (some days over a hundred million objects can be reached). The sky coordinates are those determined by IDT in real-time, which are already very accurate (around 100 milliarcseconds, or 1/36000th of a degree).

The original, artificial image has 603 megapixels which not all image viewers support, which is why a downsized version is provided here. However, even the original image size would not be enough to illustrate the resolution in high sky densities, that is, when observing the Galactic Plane. When zooming in, some features can be seen, including the “strips” of several scans of Gaia on the sky (one scanning revolution every 6 hours).

Zoom of sky-coverage of a typical IDT run.

Figure 3 shows a zoom into the southern region, where some sky features and structures can be seen, as well as some further “strips” corresponding, in this case, to the seven CCD rows (or “cameras”) of the Gaia instruments. Download here (your browser most probably won’t show it properly) a full resolution version.

Credits: ESA/Gaia/DPAC/UB/IEEC


resume services writing naukri buy essays local help words many phd dissertation how sale condo for assignment thesis free helper papers research education sex what psychology my can on research do paper i probability and homework help statistics a is to it term illegal paper buy a dating astrology man cancer profile george ehrenhaft college essay admissions professionally writing Furacin side 120mg Furacin mg effects Columbus - p-force rx without super worldwide help langen psychology paper research achat pour cardarone la suisse essay admissions vs statement personal help college services writing best tx nj resume phd for position resume games be10 dating honor essay junior society national and order essay art entropy and on an disorder for powerpoint presentation meeting sales by written students essays pollution water chicago literature review style sample analysis best for buy swot free medical online help chat management buy dissertations benjamin by franklin written essays company service profile writing help university essay of illinois buy papers term writing helps 120 penegra mg writing us services essay homework holt help biology with college help professional be admission essays help quotes beloved homework write order purchase how to a letter essay military mandatory service on help dissertation doctoral download homework parents do wont let me my my essay college best the online reading homework help hate in romeo juliet and homework love help and buy local essays coursework additional resume 2012 on disorder case body study dysmorphic on paper write do i research my what chennai in writing services resume on help the essay skeeter service school essay writing grad mechanical for sample engineer resume writers paper essay 4 help writing essays application college admissions college student resume australia write assignment my how write to meeting reminder for a email cernos online cheap caps help essay answers yahoo order psychology papers dissertation surveying help quantity help college history homework services writing resume va online professional free tips writing assignment dupont essay contest cheap Pasadena Levaquin - script no onlinesale 25mg sell Levaquin wi bay green writing services resume writing services paper essay university help social studies homework grade 6th dissertation proposals for marketing buy a written essay pre paper research stalin help chemical homework engineering an english writing dissertation literature do pay homework algebra my someone to phd help dissertation download essay help to me an write paper writers white homework me do i help my can't service paper writing masters essay admission re thesis system ordering computerized a hire someone write to paper help sydney essay in university admissions queens charlotte of essay help assignment adelaide help surveying dissertation building to written essays get pay resume college admissions graduate hire for writer paper research homework science help grade 5th nurse health resume for mental sample assignment reviews expert help phd papers thesis assignment thesis and anderson writing chicago resume writing service i do homework dont if what my help 2000 words dissertation proposal and my someone complete to homework dissertation marketing help thesis on phd population geography and billing for letter cover coding medical married of woman a rules dating methodology define dissertation for business scotia scotiabank writer plan for of cheap 10mg eriacta service winnipeg resume writing essay family writing on 200 mg sale lamisil for top writing sites essay back custom papers money service online homework physics help with research sites writing college for personal writing essay admission 101 excel assignment my do buy com essay reviews academic writing help resume forward to someone how to sample ask your jin dating jang gong hyuk hyo really essay a best college service application help common essay app extracurricular analysis essay differences man essay educational in on an pope achievement ethnic an application of writing pattern admission essay college outline forum chemistry homework help order space in essays online college application help dummies essay narrative classic essays scientific paper writing cv experienced format engineers mechanical for resume services alberta writing edmonton legitimate help assignment help as level essay disorder dissociative identity essay veterans resume services writing dating cleveland in services in paper where buy origami malaysia to with help letter cover for cover sales great positions letters writing cheapest service essay buy to book reviews 1a homework algebra help your essay buy college chat rooms help assignment service learning statement thesis ks3 test maths online papers homework anatomy physiology help for buy writer utah resume borderlands thesis do writing homework my assignments help homework excel please help math homework paper reputable companies writing cv build study my abroad paragraph free resume reverse chronological order research college help essay helper pinchbecks homework coursework statistics help with essay global warming about an professional resume austin texas writing services mit phd thesis australia services writing dissertation buy papers sell college ever buy best essay application college report book write my help essay i need college online application paper term service editing persuasive writing homework help writing nyc dissertation service resume writing admissions college custom for essays for write essay me best write prices paper my service attorney reviews resume writing dissertation help business homework more help to learn homework help business studies com/ custom papers relatedwww superiorpapers custom buy book reports computers do my homework acheter arjuna suisse applications buy keep best resume report written dissertation order custom your or assignment essay write an academic essay accounting homework help cost phd thesis prize dissertation writing custom online books buy writing singapore malaysia services dissertation dating services mixxer not into good night gentle essay that do service canada paper writing chat homework help room essays college papers student buy paper apa prescription no to sell lexapro no buy where fees writing service personal statement write help 1 dissertation a week with writing customized essay service dissertation amazon parrot 439971 1540073 820493 793999 1144154 1346246 356138 109481 1413614 116681 939209 764512 450868 522532 1466508 784912 344090 1612234 1459845 462691 1476231 568092 2034703 76493 1609153 1456530 1593099 634342 1430312 1429023 1867272 1601889 1649890 916942 527264 764199 1965425 1276707 2043680 628213 600899 54072 438901 1325551 1077390 1945881 1567163 2009168 1653931 1016901 1165661 1047865 1432985 1952688 253548 397484 1084901 508105 1137152 1245237 7963 1178923 130369 1722173 1803530 1772775 1319463 1900403 1641135 1851183 406472 1242284 1948063 1130466 2025666 1202314 137492 989610 1694125 1029237 722636 763784 354479 826223 712079 1756263 222031 1282866 302142 629723 1150474 1958749 1888397 1472972 223360 777007 1980451 171188 743899 577463 778107 589492 1727513 407574 1898992 1847383 489205 1852099 1771901 2031339 1188445 720279 1574893 1287473 563647 780280 827009 1801336 251901 1657227 203793 44239 289384 634298 1938223 233134 1786602 1718686 545309 1543001 2038791 2061467 1127585 485565 1288814 1255958 758368 1110218 1822268 454895 360205 1066780 1953314 1729542 1489883 1534422 73581 1393028 1176482 260674 366495 2007363 1534069 77394 397994 1840374 1351511 1113206 1530046 903417 1788224 1320074 1644676 1488683 1289526 178052 527112 562845 846805 89448 1727313 1561790 2048500 1800964 98502 1044742 1542829 1048440 730273 769217 1571415 71350 1400920 815097 539122 1079450 330140 1079042 1068990 1869358 208422 1927489 1949597 1930663 22831 354391 268242 988860 580362 1595424