Infrastructure services like RabbitMQ message broker and Apache Cassandra are a bloodstream for internal cloud operations and without which OpenStack services would not be able to communicate or function.
RabbitMQ sits between any two Nova components and provides a message bus for RPC communication between internal components of OpenStack. Apache Cassandra allows to quickly process large volumes of fast moving data in a reliable and scalable way and can handle hundreds of thousands of write operations per second. Not surprise, it is a choice database for companies like Facebook, Instagram and Netflix.
Unfortunately, the experience demonstrates that balancing a highly scalable database deployment or AMQP cluster cloud while maintaining data consistency or avoiding RabbitMQ alerts could be a challenge. The default installations are not always optimised for a best operations. Moreover, over the time these services degrade. File descriptor limits, corrupted transaction logs, consistency issue and so on - these are all the signs that the services require manual intrusion in order to optimise their performance that suits
a particular environment.
​
Some of the issues we can help with:
Cassandra is a popular open-source NoSQL database, but like any software, it can have some issues during deployment and operations. Some of the main issues that can be seen with Cassandra include:
​
-
Scalability: Cassandra is designed to handle a high volume of data and handle large number of requests, but as the data size and number of nodes grow, it can become difficult to scale the system to handle the increased load.
-
Data Consistency: Cassandra uses a distributed architecture, which can lead to issues with data consistency, especially when dealing with a large amount of data and high write loads.
-
Network issues: Cassandra uses a gossip protocol to communicate between nodes, if there are network issues, such as high latency or packet loss, it can negatively impact the performance of Cassandra.
-
Backup and Recovery: Backing up and recovering data in Cassandra can be complex and require a good understanding of the underlying architecture.
-
Monitoring and management: Cassandra can be difficult to monitor and manage, especially in large and complex deployments. It requires a good understanding of the underlying systems and the ability to monitor and diagnose issues in real-time.
-
Security: Cassandra has a number of security features, but if not properly configured, it can be vulnerable to attacks such as unauthorised access, and data breaches.
​
RabbitMQ is a popular open-source message broker and some of the issues that can be seen with RabbitMQ include:
​
-
Scalability: RabbitMQ is designed to handle a high number of messages, but as the number of queues and connections grows, it can become difficult to scale the system to handle the increased load. This can lead to performance issues and message loss.
-
Memory usage: RabbitMQ stores messages in memory, which can lead to high memory usage if not properly configured. If the system runs out of memory, it can cause messages to be dropped or the entire system to crash.
-
Network issues: RabbitMQ uses a network protocol to communicate between nodes and clients. If there are network issues, such as high latency or packet loss, it can negatively impact the performance of RabbitMQ.
-
Clustering and High availability: Clustering and high availability can be complex to set up and maintain, and if not done properly, it can lead to data loss and service disruptions.
-
Monitoring and management: RabbitMQ can be difficult to monitor and manage, especially in large and complex deployments. It requires a good understanding of the underlying systems and the ability to monitor and diagnose issues in real-time.
-
Security: RabbitMQ has a number of security features, but if not properly configured, it can be vulnerable to attacks such as denial-of-service (DoS) attacks, unauthorized access, and data breaches.
​
It is important to be aware of these issues, and have a plan to mitigate them, regular monitoring, testing, and maintenance can help to prevent and resolve these issues.
​