Hey, this is AmBlue. How can I help you today?

Cloud Cost Optimization

Kubernetes Cost Optimization – Best Practices (Part 2)

As businesses continue to embrace Kubernetes for its scalability and agility, cost management becomes increasingly critical. We understand that managing cloud costs can be complex, especially in large and dynamic containerized environments. That’s why we’re here to provide you with practical insights and actionable tips to take control of your Kubernetes spending. In our previous blog on Kubernetes Cost Optimization Best Practices – Part 1, we covered the common cost optimization challenges and a few solutions. Let’s see a few more,

Taints & Tolerances

In Kubernetes, “taints” and “tolerations” are mechanisms that can be used strategically to optimize costs by efficiently managing the allocation of workloads to nodes within your cluster. They act as filters in the Kubernetes world. Some of its uses in optimization are,

Efficient Utilization:

Nodes can be ‘tainted’ based on their utilization or capacity, such as CPU or memory usage. This allows you to mark nodes that are underutilized or overutilized. Whereas pods that are designed to scale horizontally can have ‘tolerations’ for nodes with low utilization. When additional resources are needed, more pods can be scheduled on those nodes to efficiently utilize available resources without provisioning new nodes.

Cost Optimization:

You can create custom ‘taints’ to represent various cost-related attributes, such as GPU availability, network bandwidth, or specific hardware types. Also pods can be configured with ‘tolerations’ that align with your custom cost-based policies. This ensures that workloads are deployed on nodes that match their requirements while considering cost factors.

Let’s say, your web application includes a background processing component that handles non-critical tasks like generating reports or processing non-urgent user requests. These tasks can tolerate occasional interruptions or delays without impacting the overall user experience.

For this case, Taint the nodes that are running on spot instances to indicate their cost-effectiveness but potential for interruptions.

Result: This taint marks these nodes as suitable for running cost-sensitive workloads.

To schedule less critical pods on spot instance nodes, define tolerations as below,

Result: These tolerations allow the pods to be scheduled on nodes with the “spot-instance” taint.

If a spot instance is reclaimed by the cloud provider, Kubernetes will automatically reschedule these pods on other available nodes, maintaining the desired level of service while optimizing costs.

Sleep Mode

You don’t need all workloads or resources to run 24/7. Especially during non-business hours and weekends. CPU, memory, or storage resources rack up the bills when they are left idle. Putting them into sleep mode with Cronjobs during non-business hours or HPA efficiently scales down the environment when not in use and scales up automatically when needed.

Example: If you want to put your Dev environment to ‘sleep mode’, here’s the code to scale them down at 5.00 P.M. everyday.

Node Pools

Node pools involves grouping nodes with similar characteristics like CPU, memory, etc. This helps in efficient resource management which in turn drives Kubernetes cost optimization. Different cloud providers offer a wide range of VM instance types optimized for various use cases. When you explore the offerings of your chosen cloud provider GCP, AWS, Azure, etc. you can identify instance types that align with your workload requirements. Pay attention to factors like CPU, memory, storage, network performance, and cost.

Kubernetes Cost Monitoring Tools

At Amadis as we always insist, spending is not a bottleneck as long as you SPEND RIGHT on your cloud resources. Spending right starts from analyzing your Kubernetes environment which is possible with Kubernetes cost monitoring tools.

CloudCADI simplifies your complex Kubernetes cost optimization process in a few clicks. Some of its key features are,

Pod-level showback: From your native cloud providers’ bills, you can get the charges of the clusters overall. Whereas in CloudCADI, you have the flexibility to drill down the charges at a lowest possible unit level – pod.

Node resizing:  CloudCADI never stops with the Kubernetes cost and utilization overview. Furthermore, it gives intelligent recommendations on how to alter your resources with choices and savings opportunities. Cloud administrators can simply leverage these options rather than manually evaluating the options.

By implementing these cost optimization tricks and regularly reviewing your Kubernetes environment for inefficiencies, you can effectively manage your infrastructure costs while ensuring optimal performance and resource utilization.

SPEND RIGHT on cloud with CloudCADI today.

Cloud Cost Optimization Cloud FinOps

List of Best Cloud Cost Optimization Tools 2024

Enterprises globally prefer to use cloud cost optimization tools to maximize their cloud investments. While certain organizations use native tools provided by AWS, GCP, and Azure others tend to opt for homegrown tools or third-party tools. Few even mix up to reduce cloud spending. According to a report from report of the FinOps Foundation, enterprises use an average of 3.7 tools for their cloud cost optimization process. Let’s see in this article a few of the best cloud cost optimization tools you can evaluate for 2024.

1. CloudCADI

CloudCADI is a one suite cloud cost optimization tool offered by Amadis Technologies Inc., USA. It got you covered for all your cloud FinOps needs. It makes the day of cloud practitioners easy with an effective dashboard, and precise reports with which allows show back to the lowest possible unit and start restructuring almost immediately. This tool comes with need-of-the-hour features like,

Cloud Native – It leverages the power of cloud features like scalability, elasticity, etc. facilitating faster deployment

Externalized Business Rule Engine – It allows the user to play around with multiple cloud assets recommendations, so the user has the flexibility to choose as per their infrastructure and project needs.

Non-intrusive nature – It stays within your cloud environment eliminating the need to worry about the security breach and third-party intrusion

Role-based data access – Customizing the cost optimization data visibility based on roles (Engineering team, Finance team, etc.) is simple with Cloud CADI.

Showback- It allows you to drill down and find the root cause of the cost overruns to take immediate actions.

End-to-End Automation- It facilitates the seamless integration of ticketing tools like ServiceNow.

Alerts- It has customizable reporting& alert capabilities to give visibility over IaaS/SaaS/PaaS services and assets, resulting in a better understanding of activities in the cloud

Clients – Johnson & Johnson, Unisys, GSM Outdoors, Exafluence, DigiKey

Founded – 2019

HQ: New Jersey, USA

Other Tools

‘Finops Foundation‘ is a non-profit organization that was established to promote best practices, standards, and education in the emerging field of cloud financial management, recently released a report on “Different Usage Types of FinOps Tools” (ref. figure below). Let’s see some of the tools mentioned,

2. AWS Cost Explorer

A native product of AWS cloud service provider helps to visualize, understand, and manage your AWS costs and usage over time. Few key features are, 

    • Monthly costs report – AWS Cost Explorer includes a default report that helps you visualize the costs and usage associated with your top five cost-accruing AWS services and gives you a detailed breakdown of all services in the table view.

    • Hourly & resource level granularity – AWS Cost Explorer helps you visualize, understand, and manage your AWS costs and usage over a daily or monthly granularity.

    • Savings plan reports – It provides you with two reports to help analyse your Savings Plans purchases and saving opportunities – Savings Plans utilization report and Savings Plans coverage report.

    • Reservation reports – The reservation utilization report visualizes your aggregate reservation utilization and allows you to set a custom reservation utilization target. The reservation coverage report visualizes your overall reservation coverage and allows you to set a custom reservation coverage target.

Few Clients – Verisk, Airbnb, Arista

Founded – 2014

HQ: Seattle, Washington, United States.

3. Cloudability (Apptio)