Software
Optimizing App Memory Management in Kubernetes
Jennifer J. Oentoro
Title:
Optimizing App Memory Management in Kubernetes
Description:
The OPAL project by Ortec Finance delivers real-time financial simulations via a REST API, responding within 2 seconds for frontend visualization. While high performance is achieved by pre-loading critical data into memory, this approach leads to significant memory usage. Additionally, the JVM’s memory retention during the generation of large-scale simulation results intensifies infrastructure demands.
OPAL operates in Kubernetes with uniform resource configurations for all clients, despite their varied needs. This mismatch results in inefficient resource utilization, with some clients using as little as 20% of allocated memory. Over-allocation inflates infrastructure costs and resource waste, especially as simulations for thousands of economic scenarios demand substantial memory and CPU.
This project focuses on optimizing OPAL’s memory management by fine-tuning JVM settings and aligning Kubernetes resource allocations to client-specific requirements while investigating and improving the existing Kubernetes infrastructure. By profiling each client’s resource usage, implementing tailored JVM configurations, and dynamically adjusting memory and CPU resources, the project aims to reduce over-commitment, cut costs, and enhance scalability. Clients with lower demands will receive minimal resources, while those requiring complex simulations will be provisioned accordingly.
The solution will enhance resource efficiency, lower operational expenses, and ensure scalability. Furthermore, the project will include delivering a Grafana dashboard to monitor JVM and Kubernetes usage, offering real-time insights for performance tuning and resource optimization. These efforts will enable OPAL to deliver reliable, high-performance simulations while maintaining cost-effective and sustainable Kubernetes operations.
| Location: | Eindhoven |
| Date: |
Friday 7 February 2025 |
| Time: | 15:00 |
| Room: | R10 4.12 |
| | |
| Company: | Ortec Finance |
| Main IT area: | Software |
| IT area: | Cloud Computing |
| Language: |
English |
