#Istio

[ceeberoni]

playing with poscas last night! some of my funny guys :P

[sailfish-serum]

Istio!!

[haroldfinch07]

Load Balancing Web Sockets with K8s/Istio

When load balancing WebSockets in a Kubernetes (K8s) environment with Istio, there are several considerations to ensure persistent, low-latency connections. WebSockets require special handling because they are long-lived, bidirectional connections, which are different from standard HTTP request-response communication. Here’s a guide to implementing load balancing for WebSockets using Istio.

1. Enable WebSocket Support in Istio

By default, Istio supports WebSocket connections, but certain configurations may need tweaking. You should ensure that:

Destination rules and VirtualServices are configured appropriately to allow WebSocket traffic.

Example VirtualService Configuration.

Here, websocketUpgrade: true explicitly allows WebSocket traffic and ensures that Istio won’t downgrade the WebSocket connection to HTTP.

2. Session Affinity (Sticky Sessions)

In WebSocket applications, sticky sessions or session affinity is often necessary to keep long-running WebSocket connections tied to the same backend pod. Without session affinity, WebSocket connections can be terminated if the load balancer routes the traffic to a different pod.

Implementing Session Affinity in Istio.

Session affinity is typically achieved by setting the sessionAffinity field to ClientIP at the Kubernetes service level.

In Istio, you might also control affinity using headers. For example, Istio can route traffic based on headers by configuring a VirtualService to ensure connections stay on the same backend.

3. Load Balancing Strategy

Since WebSocket connections are long-lived, round-robin or random load balancing strategies can lead to unbalanced workloads across pods. To address this, you may consider using least connection or consistent hashing algorithms to ensure that existing connections are efficiently distributed.

Load Balancer Configuration in Istio.

Istio allows you to specify different load balancing strategies in the DestinationRule for your services. For WebSockets, the LEAST_CONN strategy may be more appropriate.

Alternatively, you could use consistent hashing for a more sticky routing based on connection properties like the user session ID.

This configuration ensures that connections with the same session ID go to the same pod.

4. Scaling Considerations

WebSocket applications can handle a large number of concurrent connections, so you’ll need to ensure that your Kubernetes cluster can scale appropriately.

Horizontal Pod Autoscaler (HPA): Use an HPA to automatically scale your pods based on metrics like CPU, memory, or custom metrics such as open WebSocket connections.

Istio Autoscaler: You may also scale Istio itself to handle the increased load on the control plane as WebSocket connections increase.

5. Connection Timeouts and Keep-Alive

Ensure that both your WebSocket clients and the Istio proxy (Envoy) are configured for long-lived connections. Some settings that need attention:

Timeouts: In VirtualService, make sure there are no aggressive timeout settings that would prematurely close WebSocket connections.

Keep-Alive Settings: You can also adjust the keep-alive settings at the Envoy level if necessary. Envoy, the proxy used by Istio, supports long-lived WebSocket connections out-of-the-box, but custom keep-alive policies can be configured.

6. Ingress Gateway Configuration

If you're using an Istio Ingress Gateway, ensure that it is configured to handle WebSocket traffic. The gateway should allow for WebSocket connections on the relevant port.

This configuration ensures that the Ingress Gateway can handle WebSocket upgrades and correctly route them to the backend service.

Summary of Key Steps

Enable WebSocket support in Istio’s VirtualService.

Use session affinity to tie WebSocket connections to the same backend pod.

Choose an appropriate load balancing strategy, such as least connection or consistent hashing.

Set timeouts and keep-alive policies to ensure long-lived WebSocket connections.

Configure the Ingress Gateway to handle WebSocket traffic.

By properly configuring Istio, Kubernetes, and your WebSocket service, you can efficiently load balance WebSocket connections in a microservices architecture.

[simple-logic]

#Guess Can you guess the tech?

Comment your answers below👇

💻 Explore insights on the latest in #technology on our Blog Page 👉 https://simplelogic-it.com/blogs/

🚀 Ready for your next career move? Check out our #careers page for exciting opportunities 👉 https://simplelogic-it.com/careers/

[datamattsson]

Got to listen to the release lead for #Kubernetes 1.28 interview today by Craig Box, finally! 🤗 Grace Nguyen did a great job walking through all the #Istio improvements. 🤭 It seems we need to start SIG LAN Party for the next #KubeCon No WiFi allowed! 🚫

[yanashin-blog]

I'm so glad to hear the announcement that Istio project is now a graduated Cloud Native Computing Foundation (CNCF) project.

The maturity of the community is remarkable, as seen at Istio Day, which is held concurrently with KubeCon, and I thought it was very reasonable to graduate at this time, given the maturity and popularity of Istio's features. Congratulations and best wishes for the future.

Service mesh adoption has been steadily rising over the past few years as cloud native adoption has matured across industries. -- Chris Aniszczyk, CTO of CNCF

And just because it graduate does not mean that its activities will stop. The project work continues uninterrupted.

Istio 1.18: Ambient Mesh

Istio 1.19: New sidecar container feature in Alpha in Kubernetes 1.28

With the rise of microservices architectures as the de facto pattern for authoring modern applications, connecting, observing, and securing the complex landscape of containers and services has become a challenge for engineers. Google is proud of our role in the creation and development of Istio as a comprehensive solution to this hard problem. Istio’s graduation, as well as its leading position as the world’s most adopted service mesh technology, reinforces our belief that it should be easy for everyone to benefit from secure, robust service-based applications. -- Cameron Etezadi, Director of Engineering, Google Cloud

VMware is delighted to celebrate Istio’s graduation within CNCF. Service mesh is a key part of cloud native architecture, and Istio provides a uniform and efficient way to better secure, connect, and monitor modern app services – making it the choice for enterprises. VMware has been an advocate for Istio and shares in the vision for a robust cloud native ecosystem for application networking. VMware looks forward to its continued collaboration with the Istio project and community to deliver more secure connectivity solutions for enterprises. -- Niran Evenchen, Senior Product Line Manager, VMware Tanzu

[mp3monsterme]

Bucharest Tech Week Conference - Monoliths in a Microservices World

Last week I was fortunate enough to have the opportunity to present at the Software Architecture Summit as part of the Bucharest Tech Week conference. My presentation, Monoliths in a Microservice World, was all new content that, by chance, worked well bringing together a number of points made by other speakers. The presentation aimed at the challenges of adopting Microservices and whether…

[codeonedigest]

AWS Service Mesh for Cloud API Developer | AWS APP Mesh Explained with Examples  

Full Video Link https://youtube.com/shorts/KDXrF2Km_R8 Hi, a new #video on #aws #servicemesh #appmesh #aws #ecs #cloud is published on #codeonedigest #youtube channel. @java #java #awscloud @awscloud #aws @AWSCloudIndia #Cloud #CloudCom

Service mesh is a dedicated infrastructure layer built into an application that controls service-to-service communication in a microservices architecture. It controls the delivery of service requests to other services, performs load balancing, encrypts data, and discovers other services. Service mesh enables greater scalability in service-to-service communication. AWS App Mesh provides…

[ceeberoni]

if theyre cold youre cold

[sailfish-serum]

Istio is just. Everything to me right now,. He's a slut, he's a dude bro, he surfs, he's a fish, he's a man, he religously listens to lady gaga and jimmy eat world, he has a slutty little waist, he runs faster than a car can drive but chooses a 50cc moped as his choice regularly, he's a vigilante but doesnt care about people knowing his indentity

[gold0kapi]

Been sketching some merfolk so here's some teaser tails lol (and an Istio)

[dailypuyoque]

6☆ Fondant Istio

[alias-milamber]

That feeling when you’re sitting in an auditorium waiting for a talk on “How you can use istio and gke to level up your ingestion workloads on kubernates” and you have a sudden epiphany about the background lore for a WIP and where the BBEG self-justification comes from. (Clue: It’s not from istio, gke, kubenates or ingestion workloads)

[yuruyensato]

Slm evren bu kiz dünyayıda gezmek istio mümkünse zengin bir şekilde bb

[kendincebiri34]

Acayip fal tarot baktırasım var ya canım istio ama tövbe ettim ağğ sınanıyorum

[ceeberoni]

istios