Performant Architecture for a Fast Gen AI User Experience

[nokenwa]

Abstract

More and more developers are being asked to build Generative AI experiences into their web applications everywhere. However, the user's experience with Generative AI can sometimes be slow and frustrating. It’s been years since we would gladly wait over 10 seconds for a response to anything online. As AI processing gets faster, there are new limiting factors that could be negatively affecting your AI user experience.

In this talk, we will cover different ways to minimise laggy experiences in web applications when interacting with third-party Generative AI tools. We’ll be using a practical demonstration to show how you can reduce latency as we build one of my favourite sci fi gadgets, the babel fish.

About Me

Nathaniel is a Developer Evangelist at Twilio working to create magical moments for developers with their products. His life goals are to have Batman's brains, Deadpool's humour, T'Challa's fashion sense, Killmonger's Wokeness, and Thanos' determination! He serves the Javascript community in the UK and the rest of Europe

• I confirm that I will abide by the Code of Conduct

• I confirm my talk is 20 mins long in total.

[admataz]

Hey @nokenwa - thanks for the talk proposal. This is a much needed topic that needs covering. From what I've seen it's an endless tech cycle - new advances and capabilities that our current patterns don't deal with, degrading the UX. Then we catch up with new patterns and inventions. Look forward hearing how we can be using our tools to make better UX for the genAI experience.

I have you confirmed for 23rd October - hope that still suits?