Home

streams-cta

The realtime analysis of the data from the CTA arrays poses interesting challenges to the design of a proper execution environment, that is capable of performing the required steps of data calibration, image cleaning and alert detection.

With the streams-cta project we investigate the use of highly scalable platforms, such as Apache Storm and Apache Kafka, that recently have been published by the computer science community to tackle Big Data analysis requirements. Based on the intermediate streams framework, which serves as a middle-layer design tool, we test different implementations and platforms for their performance and scalability.

Table of contents

• Streams-Storm for CTA Explains the wright way to package and deploy streams to a storm cluster

• ZeroMQ Experiments Description of the way the experiments with ZeroMQ have been done.

• Minutes

• ClusterSetup Instructions to setup the camera server producers, etc.