Skip to content

Export VM monitoring metrics from OpenStack via Ceilometer and publish them in Kafka bus

License

Notifications You must be signed in to change notification settings

5g-media/openstack-kafka-publisher

Repository files navigation

Openstack-kafka-publisher service

Introduction

The role of the Openstack-kafka-publisher service is to receive monitoring data of the running network services (and the running VNFs/VMs) deployed in OpenStack NFVI through the Ceilometer service (OpenStack) over UDP protocol and forward them in the publish/subscribe broker of 5G-MEDIA Service Virtualization Platform.

Actually, this service feeds the MAPE with monitoring data.

Apart from the instructions relevant to deployment of this publisher, indicative configuration of the Ceilometer service is provided under the ceilometer folder.

Requirements

  • The docker engine has been installed
  • The Ceilometer service can access this service (check firewall)

The python packages are available in the requirements.txt file.

Configuration

Inspect the publisher.conf file and modify it before the build of the image. The default settings are the following:

Parameter Value
UDP port 10000
kafka host 192.168.1.107
Kafka port 9092
Topic name nfvi.example.openstack

You need to configure the ceilometer properly in order to push the data over UDP in this service.

Modify the ceilometer.conf and pipeline.conf in the /etc/ceilometer path. Take a look in the files that are included in the ceilometer folder.

Installation/Deployment

Before the duild of the docker image, take a look in the configuration section.

1. Build the docker image

# clone code from  repository
cd openstack-kafka-publisher
docker build -t ceilometer_kafka_publisher .

2. Instantiate the service as docker container

docker run -d --name ceilometer_kafka_publisher -p 10000:10000/udp ceilometer_kafka_publisher

Usage

Check the logs

docker exec -it ceilometer_kafka_publisher bash 
# inside container
cd /opt/ceilPublisher
tail -f /ceilPublisher.log  

The expected response should look like:

2018-05-14 11:57:39,326 INFO ====================
2018-05-14 11:57:39,326 INFO Ceilometer Kafka publisher
2018-05-14 11:57:39,326 INFO UDP server port: 10000
...

Authors

  • Singular Logic

Contributors

  • Contact with Authors

Acknowledgements

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 761699. The dissemination of results herein reflects only the author’s view and the European Commission is not responsible for any use that may be made of the information it contains.

License

Apache 2.0

About

Export VM monitoring metrics from OpenStack via Ceilometer and publish them in Kafka bus

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published