#Istio

[ceeberoni]

if theyre cold youre cold

[haroldfinch07]

Load Balancing Web Sockets with K8s/Istio

When load balancing WebSockets in a Kubernetes (K8s) environment with Istio, there are several considerations to ensure persistent, low-latency connections. WebSockets require special handling because they are long-lived, bidirectional connections, which are different from standard HTTP request-response communication. Here’s a guide to implementing load balancing for WebSockets using Istio.

1. Enable WebSocket Support in Istio

By default, Istio supports WebSocket connections, but certain configurations may need tweaking. You should ensure that:

Destination rules and VirtualServices are configured appropriately to allow WebSocket traffic.

Example VirtualService Configuration.

Here, websocketUpgrade: true explicitly allows WebSocket traffic and ensures that Istio won’t downgrade the WebSocket connection to HTTP.

2. Session Affinity (Sticky Sessions)

In WebSocket applications, sticky sessions or session affinity is often necessary to keep long-running WebSocket connections tied to the same backend pod. Without session affinity, WebSocket connections can be terminated if the load balancer routes the traffic to a different pod.

Implementing Session Affinity in Istio.

Session affinity is typically achieved by setting the sessionAffinity field to ClientIP at the Kubernetes service level.

In Istio, you might also control affinity using headers. For example, Istio can route traffic based on headers by configuring a VirtualService to ensure connections stay on the same backend.

3. Load Balancing Strategy

Since WebSocket connections are long-lived, round-robin or random load balancing strategies can lead to unbalanced workloads across pods. To address this, you may consider using least connection or consistent hashing algorithms to ensure that existing connections are efficiently distributed.

Load Balancer Configuration in Istio.

Istio allows you to specify different load balancing strategies in the DestinationRule for your services. For WebSockets, the LEAST_CONN strategy may be more appropriate.

Alternatively, you could use consistent hashing for a more sticky routing based on connection properties like the user session ID.

This configuration ensures that connections with the same session ID go to the same pod.

4. Scaling Considerations

WebSocket applications can handle a large number of concurrent connections, so you’ll need to ensure that your Kubernetes cluster can scale appropriately.

Horizontal Pod Autoscaler (HPA): Use an HPA to automatically scale your pods based on metrics like CPU, memory, or custom metrics such as open WebSocket connections.

Istio Autoscaler: You may also scale Istio itself to handle the increased load on the control plane as WebSocket connections increase.

5. Connection Timeouts and Keep-Alive

Ensure that both your WebSocket clients and the Istio proxy (Envoy) are configured for long-lived connections. Some settings that need attention:

Timeouts: In VirtualService, make sure there are no aggressive timeout settings that would prematurely close WebSocket connections.

Keep-Alive Settings: You can also adjust the keep-alive settings at the Envoy level if necessary. Envoy, the proxy used by Istio, supports long-lived WebSocket connections out-of-the-box, but custom keep-alive policies can be configured.

6. Ingress Gateway Configuration

If you're using an Istio Ingress Gateway, ensure that it is configured to handle WebSocket traffic. The gateway should allow for WebSocket connections on the relevant port.

This configuration ensures that the Ingress Gateway can handle WebSocket upgrades and correctly route them to the backend service.

Summary of Key Steps

Enable WebSocket support in Istio’s VirtualService.

Use session affinity to tie WebSocket connections to the same backend pod.

Choose an appropriate load balancing strategy, such as least connection or consistent hashing.

Set timeouts and keep-alive policies to ensure long-lived WebSocket connections.

Configure the Ingress Gateway to handle WebSocket traffic.

By properly configuring Istio, Kubernetes, and your WebSocket service, you can efficiently load balance WebSocket connections in a microservices architecture.

[jannah-software]

A Comprehensive Presentation on Jannah Middleware Application Part 11: Concluding Explanations of the Django Settings File

Concluding Explanations of the Django Settings File

A Comprehensive Presentation on Jannah Middleware Application Part 11: Concluding Explanations of the Django Settings File Video Highlights We talked about the following variables in the Django settings.py file: DEFAULT_AUTO_FIELD. Specifies the data type for the id field on the database tables for models. Concluding thoughts on this presentation: This presentation is to serve as a…

[sailfish-serum]

Istio is just. Everything to me right now,. He's a slut, he's a dude bro, he surfs, he's a fish, he's a man, he religously listens to lady gaga and jimmy eat world, he has a slutty little waist, he runs faster than a car can drive but chooses a 50cc moped as his choice regularly, he's a vigilante but doesnt care about people knowing his indentity

[datamattsson]

Got to listen to the release lead for #Kubernetes 1.28 interview today by Craig Box, finally! 🤗 Grace Nguyen did a great job walking through all the #Istio improvements. 🤭 It seems we need to start SIG LAN Party for the next #KubeCon No WiFi allowed! 🚫

[yanashin-blog]

I'm so glad to hear the announcement that Istio project is now a graduated Cloud Native Computing Foundation (CNCF) project.

The maturity of the community is remarkable, as seen at Istio Day, which is held concurrently with KubeCon, and I thought it was very reasonable to graduate at this time, given the maturity and popularity of Istio's features. Congratulations and best wishes for the future.

Service mesh adoption has been steadily rising over the past few years as cloud native adoption has matured across industries. -- Chris Aniszczyk, CTO of CNCF

And just because it graduate does not mean that its activities will stop. The project work continues uninterrupted.

Istio 1.18: Ambient Mesh

Istio 1.19: New sidecar container feature in Alpha in Kubernetes 1.28

With the rise of microservices architectures as the de facto pattern for authoring modern applications, connecting, observing, and securing the complex landscape of containers and services has become a challenge for engineers. Google is proud of our role in the creation and development of Istio as a comprehensive solution to this hard problem. Istio’s graduation, as well as its leading position as the world’s most adopted service mesh technology, reinforces our belief that it should be easy for everyone to benefit from secure, robust service-based applications. -- Cameron Etezadi, Director of Engineering, Google Cloud

VMware is delighted to celebrate Istio’s graduation within CNCF. Service mesh is a key part of cloud native architecture, and Istio provides a uniform and efficient way to better secure, connect, and monitor modern app services – making it the choice for enterprises. VMware has been an advocate for Istio and shares in the vision for a robust cloud native ecosystem for application networking. VMware looks forward to its continued collaboration with the Istio project and community to deliver more secure connectivity solutions for enterprises. -- Niran Evenchen, Senior Product Line Manager, VMware Tanzu

[mp3monsterme]

Bucharest Tech Week Conference - Monoliths in a Microservices World

Last week I was fortunate enough to have the opportunity to present at the Software Architecture Summit as part of the Bucharest Tech Week conference. My presentation, Monoliths in a Microservice World, was all new content that, by chance, worked well bringing together a number of points made by other speakers. The presentation aimed at the challenges of adopting Microservices and whether…

[liimbolosttheirway]

Sometimes, coping is drawing your lil guy jamming out

A friend shitting on my music choices for a project and then trying to immediately backpedal and change the subject will not stop me from enjoying my music or doing my project

[cayindibindekipiskevit]

ay bugünkü rezilligimi bir görün bi anda burnum kanamaya basladi ama nasi kaniyo sanirsin sah damarim patladi yanimda da pecete yok masamdaki kiza sordum suratıma bile bakmadan yok dedi neyse kosa kosa lavaboya gittim 15 dakika bekledim durmadi ayni hizda akiyo o kadar insan girdi çıktı lavaboya biri de iyi misin pecete ister misin demedi ya yaziklar olsun.. sonra neyse dedim kendi isimi kendm hallederim kosa kosa markete gittim pecetimi aldim da zar zor durdum

[thursdayglrl]

spotify no longer works on firefox for me because it keeps giving me "RBAC: access denied" and all I get when looking it up is stuff that's way too advanced for me (i know nothing about anything) lol

[ceeberoni]

istios

[codeonedigest]

AWS Service Mesh for Cloud API Developer | AWS APP Mesh Explained with Examples  

Full Video Link https://youtube.com/shorts/KDXrF2Km_R8 Hi, a new #video on #aws #servicemesh #appmesh #aws #ecs #cloud is published on #codeonedigest #youtube channel. @java #java #awscloud @awscloud #aws @AWSCloudIndia #Cloud #CloudCom

Service mesh is a dedicated infrastructure layer built into an application that controls service-to-service communication in a microservices architecture. It controls the delivery of service requests to other services, performs load balancing, encrypts data, and discovers other services. Service mesh enables greater scalability in service-to-service communication. AWS App Mesh provides…

[jannah-software]

A Comprehensive Presentation on Jannah Middleware Application Part 10: Continuing with Django Settings File

A Comprehensive Presentation on Jannah Middleware Application Part 10: Continuing with Django Settings File

Continuing with Django SettinA Comprehensive Presentation on Jannah Middleware Application Part 10: Continuing with Django Settings File Video Highlights We talked about the following variables in the Django settings.py file: ROOT_URLCONF Sub URLS that are served by Jannah, TEMPLATES WSGI_APPLICATION DATABASES Specifying database URL (connection string) AUTH_PASSWORD_VALIDATORS Password…

[sailfish-serum]

New Oc! His name is Istio! He's a leviathan decendant in the form of a Indo-Pacific Sailfish n he goes fast, outfit ideas are appreciated! I dont know how to dress him!

[gold0kapi]

Been sketching some merfolk so here's some teaser tails lol (and an Istio)

[i-love-linux-and-reject-gender]

me using a separate proxy container for every container running (thanks istio)