Today's Deep-Dive: Tiledesk
Ep. 282

Today's Deep-Dive: Tiledesk

Episode description

Tiledesk is an open-source platform revolutionizing how companies build sophisticated LLM-enabled chatbots and live chat solutions, balancing advanced automation with crucial data control. It functions as a conversational app development platform, akin to a no-code visual workbench, enabling the creation of complex, multi-step AI bots. A key feature is its seamless human-in-the-loop capability, allowing smooth transitions to human agents with full context, thereby enhancing customer experience. Tiledesk’s multi-channel approach allows users to design responses once, which are then automatically adapted for various platforms like web, WhatsApp, and SMS. The platform utilizes Retrieval Augmented Generation (RAG) with an “agentic” approach, connecting AI agents to internal and external data sources for accurate, verified answers by separating knowledge into distinct repositories. Hybrid search combines keyword and semantic understanding to interpret user intent, even with imprecise language. A defining feature is the self-learning loop, where AI agents continuously improve by analyzing message exchanges and integrating effective human agent solutions. Complex workflows are managed through a no-code visual builder using prompt chains, breaking down logic into smaller, manageable modules. Specialized AI agents can collaborate, handing off tasks and context mid-conversation. Use cases include an e-commerce assistant integrating with platforms like Shopify, AI-powered email ticketing that learns from past resolutions, and a 24-7 scheduling feature. For deployment, Docker Compose is suitable for initial stages, while Kubernetes is recommended for production environments requiring high availability and scalability. Being open-source and offering on-premises deployment provides organizations with complete control over their data and privacy, allowing local LLM integration and vector store control, which is crucial for regulated industries. This deep integration of AI and human agents raises questions about the future role of support staff, potentially shifting them towards becoming expert AI trainers.

Gain digital sovereignty now and save costs

Let’s have a look at your digital challenges together. What tools are you currently using? Are your processes optimal? How is the state of backups and security updates?

Digital Souvereignty is easily achived with Open Source software (which usually cost way less, too). Our division Safeserver offers hosting, operation and maintenance for countless Free and Open Source tools.

Try it now for 1 Euro - 30 days free!

Download transcript (.srt)
0:00

Welcome to the deep dive your shortcut to being well-informed today

0:03

We're tackling a platform that really sits right at the intersection of customer

0:07

service open source flexibility and well cutting-edge AI

0:11

We are sinking our teeth into tile desk. It's a really powerful platform

0:16

That's I think fundamentally changing how companies build these sophisticated

0:20

LLM enabled chat bots and live chat solutions. It really is and it's crucial

0:25

because it hits two major demands

0:27

You know for enterprises at the same time. You've got the need for advanced

0:31

automation

0:31

definitely, but also that

0:34

Non-negotiable requirement for data control. It's an entire ecosystem really and

0:38

the fact that it's open source that elevates it way beyond just a standard

0:42

Sauce product. Absolutely and before we dive deep into the architecture and all the

0:46

agentic AI stuffed

0:47

How this boasts we want to give a quick nod to our supporter today safe server

0:50

Yeah, safe server is a great partner here

0:52

They focus specifically on hosting exactly this kind of flexible powerful open

0:57

source software

0:59

They really support you through the technical side of digital transformation

1:03

So if you're looking into deploying say custom secure AI solutions like tile desk

1:08

in a robust hosting environment

1:10

Well, you can find more info at www.safeserver.de

1:13

Perfect. So, okay our mission today. It's tailored specifically for you the

1:18

listener. We want to unpack tile desk from the ground up

1:21

We'll explain how it combines, you know classic live chat with these sophisticated

1:24

large language models

1:26

And crucially how you can actually deploy it using enterprise-grade tools like kubernetes

1:30

and docker

1:31

We want to make it accessible even if you're maybe just starting out with your

1:35

conversational AI strategy

1:36

Okay, so let's start with the basics the foundation tile desk

1:39

It actually began its life as an open source live chat platform built really robustly

1:44

using node.js and express

1:46

Standard stuff and it was designed for that asynchronous real-time customer support,

1:50

you know designed to scale but honestly

1:52

It's grown way beyond just being a chat widget now, right?

1:55

So if I'm looking at this, is it just like a better version of the old chat box?

1:59

I already have on my website or is it something more? It's really an entirely new

2:03

category. I think of it as a conversational app development

2:05

platform less like just a chat box and more like a

2:10

Complete no-code visual workbench kind of like tools like voice flow maybe but it's

2:15

purpose-built to empower you to create these highly sophisticated

2:18

LLm enabled bots bots that can handle complex multi-step tasks

2:23

It's really about building automated applications that just happen to communicate

2:26

conversationally

2:27

Okay, but for any company, you know worried about automating customer interactions

2:31

The fear is always losing that human touch or worse providing those frustrating

2:36

dead-end AI responses. So for enterprise adoption

2:39

What's the single most essential feature? Is it still being able to hand off to a

2:42

human? Oh, absolutely that human-in-the-loop capability is

2:46

Completely non-negotiable. It has to be there tile desk provides these out-of-the-box

2:51

chat bots that work seamlessly

2:52

side by side with human agents if the AI gets confused or maybe the customer

2:57

expresses something that needs real empathy or it's a

3:00

high-stakes problem

3:01

The interaction can instantly transition. Yeah, really smoothly to a human agent,

3:06

but here's the kicker

3:07

Okay, the human agent gets the full transcript and all the context from the AI

3:12

interaction

3:12

So there's zero frustration the customer doesn't repeat themselves and you get

3:16

reliable support

3:17

So the customer isn't starting over from scratch, right that alone fixes like 90%

3:22

of bad chat experiences

3:23

Probably now let's talk about managing communication across different platforms

3:27

that multi-channel challenge most businesses

3:29

They have to build separate bots for whatsapp for their website for Facebook

3:33

Messenger

3:34

Managing that content parity is just a nightmare exactly. That's the pain point

3:38

tile desk addresses really brilliantly

3:41

I think with its innovative multi-channel approach you design and configure your

3:45

chat bot replies only once you use rich media elements

3:49

You know images carousels buttons right there in the design studio

3:52

Then the platform's underlying engine it just auto adapts those responses to the

3:58

unique

3:59

Formatting needs of every single target channel web whatsapp Facebook Telegram SMS

4:04

even email Wow

4:05

So the key takeaway there is efficiency build it once deploy it everywhere and the

4:10

format just sorts itself out automatically

4:12

You're not rebuilding like six separate brains

4:14

You're just giving one brain the ability to speak six different format languages.

4:18

That's genuinely interesting for you know large-scale operations

4:21

Exactly it standardizes all that complexity. Okay. Let's move to the brains of the

4:25

operation the AI itself

4:26

We're hearing terms like a gentic AI operating system. Mm-hmm

4:30

It's one thing to answer a simple FAQ

4:32

But tile desk seems to be aiming for more complex workflows like information retrieval

4:36

operations stuff

4:37

Yeah, and what's absolutely crucial for any enterprise AI is accuracy. You just

4:42

cannot have bots hallucinating responses with customers

4:46

It's a non starter. This is where the knowledge base integration comes in and it's

4:51

powered by our agi

4:52

That's retrieval augmented generation essentially the AI agents are connected

4:55

directly to your company's internal documents your knowledge base articles

4:58

Maybe even external data sources. The AI isn't making up the answer

5:02

It's actually retrieving a verified source document and then formatting the answer

5:06

based on that source right our eggs

5:08

We've heard about our G before but the documentation specifically mentions a gentic

5:12

aria that sounds well

5:14

It sounds like it's tailored for large organizations with frankly messy data. It is

5:18

spot-on

5:19

Standard rag often hits this massive enterprise problem siloed knowledge

5:24

information is all over the place a

5:27

Single sort of monolithic RG system tries to index everything and that can lead to

5:32

relevance issues

5:33

The AI might pull a pricing sheet when it should have grabbed a warranty document

5:37

For example agentic RG solves this it lets you separate your knowledge into

5:41

multiple distinct repositories

5:43

So you might have one repository just for sales PDFs another one for HR policies

5:48

and maybe a third for technical

5:49

Support manuals. Okay interesting and how do they work together then do they talk

5:53

to each other you chain them together essentially

5:55

The system applies search fallbacks and guardrails

5:57

So it allows the agent to say check the technical docs first

6:01

And if that doesn't yield anything useful, maybe then it tries the general FAQ

6:05

repository

6:05

It ensures your answers are verified. They're routed correctly and retrieved from

6:09

the right specialized knowledge source

6:11

It prevents that cross-domain confusion that brings up the challenge of search

6:15

itself though users don't always ask questions perfectly, right?

6:19

They use messy colloquial language. What about this hybrid search? Does that

6:23

actually help solve that problem?

6:26

It really does because hybrid search cleverly combines two powerful techniques. It

6:29

uses traditional full-text retrieval

6:32

That's your basic keyword search, which is fast and great for exact matches and it

6:36

pairs that with semantic understanding

6:38

Which is powered by the LLMs themselves. So if a user types something complex like

6:43

My delivery was supposed to be here yesterday, but the tracking hasn't updated

6:48

since Tuesday

6:48

The system understands the intent behind it

6:51

It's a delivery issue needing tracing even if the exact keywords are kind of spread

6:55

out and imprecise

6:56

This leads to much smarter result and internally fewer missed resolutions

7:01

And the system doesn't just sit there executing instructions does it? It actively

7:05

learns

7:05

That's probably the defining feature the self-learning loop. The AI agent isn't

7:10

static

7:11

It actively listens to every single message exchange, especially those where the

7:15

interaction eventually had to transition to a human agent

7:18

That's key. It extracts crucial beta points common questions that stumped it before

7:24

and importantly the effective solutions

7:26

provided by the human agents

7:28

This new high quality knowledge is then automatically and seamlessly integrated

7:33

right back into the knowledge base

7:34

Huh? So every single time a human has to step in and you know save the day

7:39

They are without even realizing it training the AI to handle that exact scenario

7:43

better next time

7:45

That's continuous improvement baked right into the operational layer. That's pretty

7:49

clever precisely and we've seen this incredible learning capability

7:52

But great AI still needs sharp instructions to execute tasks reliably, right?

7:56

Which brings us to how tile desk actually makes designing complex workflows simpler

8:00

using their visual tools

8:01

We're talking about the no-code slow builder or the visual designer. Yeah for

8:04

anyone building automation complexity always kills usability

8:08

It just gets overwhelming

8:10

How does tile desk make managing these potentially huge complicated automation

8:16

routines manageable?

8:17

Especially when you're throwing AI logic into the mix it relies heavily on this

8:21

concept of prompt chains

8:22

This is really how you decouple the complexity if you try to write one massive

8:27

Monolithic prompt telling the LLM to handle say five different steps all at once

8:31

Well debugging that or updating it becomes basically impossible prompt chains break

8:37

that logic down

8:39

Instead you create a sequence of smaller smarter much more manageable prompts

8:42

Okay

8:43

So each little prompt module has just one specific job like check inventory or

8:47

calculate shipping costs something like that exactly and the full builder

8:50

Let's you do this orchestration with no code

8:52

You just drag drop and connect these smaller prompt blocks visually this give you

8:56

really granular control over the workflow

8:58

Makes it transparent much easier to debug and ensures the AI follows the exact

9:02

decision tree you designed step-by-step

9:04

Hmm that structure seems pretty essential and we start thinking about the multiple

9:08

specialized agents concept, too

9:10

If you can break down the workflow you can break down the agents as well, right?

9:13

You don't need one giant AI trying to be a genius at absolutely everything that

9:18

really works

9:19

Well instead you create AI agents with highly specialized roles

9:22

Maybe one for sales another for technical support a third for onboarding new users

9:28

And because the workflows are chained these specialized agents can actually

9:32

collaborate and even switch mid conversation

9:35

So if the sales agent identifies a technical issue cropping up

9:38

The replace bot action allows a seamless handoff to the specialized support agent

9:43

and crucially it passes all the context along

9:45

Okay to ground this powerful design in reality

9:48

Let's maybe look at a few specific use cases from the source material that

9:52

illustrate this kind of integration

9:53

The ecommerce assistant sounds like a great example of connecting AI directly to

9:57

core business systems

9:59

Oh, it's powerful because it moves way beyond just simple FAQ stuff. The ecommerce

10:03

assistant integrates directly with platforms

10:06

Like Shopify it syncs product catalogs in real time. It can display interactive

10:11

product carousels right within the chat window and

10:14

Crucially it allows the customer to conversationally build and modify their

10:18

shopping cart

10:19

That really transforms what might have been just a support bot into a genuine

10:24

conversion engine

10:25

And what about addressing that traditional time sync of customer service email ticketing?

10:29

Yeah, the AI email ticketing feature looks like a huge efficiency game. It links to

10:33

basically any corporate inbox

10:35

But here's the smart part before responding it actually learns from your historical

10:39

email threads and successful resolutions from the past

10:42

This means its automated responses are rooted in real high quality past

10:46

interactions that leads to more accurate often instant resolution of common queries

10:51

Which minimizes the backlog for human agents and then there's this simpler but

10:55

still critical

10:56

24-7 scheduling feature it connected Google Calendar or Outlook Calendar handles

11:00

availability checks confirms appointments all without any human intervention needed

11:05

Okay, that's a pretty comprehensive look at the functionality, but the real value

11:09

proposition. I think especially for technical or

11:11

Regulated industries is that tile desk is open source. This gives users profound

11:18

control over their infrastructure

11:20

So how do you actually deploy tile desk at scale? What does that look like? Right?

11:24

This takes us into the technical foundation and

11:26

Tile desk offers flexibility here, which is good for initial development

11:31

Maybe for trials or even smaller deployments the recommended option is Docker

11:35

compose. It's relatively easy

11:37

It's great for quickly standing up the necessary multi-container applications

11:41

locally just to see how the whole system the server dashboard

11:43

Database all interacts but Docker compose probably doesn't cut it when you need,

11:47

you know

11:48

5 nines reliability and massive user concurrency, especially with a real-time chat

11:52

application precisely

11:54

Yeah for production environments and definitely for enterprises that need high

11:57

availability and serious scalability

11:59

The clear recommendation is Kubernetes with Helm

12:02

Chat is fundamentally a real-time service. If your server hiccups or fails active

12:07

conversations just drop. That's bad

12:09

Kubernetes handles all that container orchestration

12:12

It manages automatic recovery load balancing rapid scaling of all the necessary

12:16

components things like the core tile

12:18

Desk server the dashboard the design studio the underlying MongoDB database

12:22

Kubernetes ensures continuous service even under peak loads

12:26

Okay, and the combination of being open source and having these controlled

12:30

deployment options enables that really critical concept of data sovereignty

12:34

Why is that such a massive differentiator these days because offering on-premises

12:37

deployment means organizations get complete actual physical control over their data

12:42

and their privacy

12:43

Full stop tile desks can be deployed entirely behind your corporate firewall. This

12:47

is often mandatory for sectors

12:49

Like finance health care or government entities and this control extends right down

12:53

to the most sensitive parts of the AI stack itself

12:55

Can you explain that control a little more specifically like what exactly do they

13:00

get to control pretty much everything that matters

13:02

They get local LLM integration

13:04

This means they don't have to send potentially proprietary or sensitive customer

13:09

data out to a third-party cloud providers LLM

13:12

Like open AI or entropic. Yeah, they can connect to and run open source models like

13:17

llama and Mistral

13:18

Completely locally within their own infrastructure. Yeah, furthermore. They

13:22

maintain vector store control

13:23

They can use local storage solutions like Q. Dran

13:25

Which for the less technical listener is basically the specialized database that

13:30

holds the semantic meaning of your documents for the our age system

13:34

Keeping that vector store local and secure behind the firewall is paramount for

13:38

compliance and privacy

13:39

That kind of flexibility and security isn't just a nice-to-have feature

13:43

It feels like a necessary strategic advantage for any large company serious about

13:47

digital transformation now

13:49

It absolutely is tile desk provides this powerful flexible open source way to

13:54

automate customer interactions

13:56

But it crucially maintains that human safety net while giving you

13:59

unprecedented control and security over the entire data infrastructure and the AI

14:04

stack

14:05

That's an excellent summary of why this platform is creating such a stir

14:08

And once again, we really want to thank our supporter for this deep dive safe

14:11

server

14:12

They help provide dedicated hosting solutions for digital transformation

14:15

initiatives including powerful open source platforms

14:18

Just like tile disk you can find out more at

14:21

www.safe server dot de and maybe here's one final provocative thought for you to

14:26

consider based on everything we've discussed today

14:28

We talked about how tail desks self-learning AI

14:32

Improves directly from human agent responses and feedback, right?

14:36

Especially from those escalated cases the platform also offers these AI coup pilot

14:40

tools that augment human agents in real time

14:43

Providing suggestions and knowledge during live chats

14:46

So think about this if the AI is learning directly from the humans and the humans

14:50

are simultaneously be augmented by the AI

14:52

How might this deep integration fundamentally change the role of the support staff

14:57

over time?

14:57

Could it turn them from simple agents focused just on resolution into expert AI

15:02

Something to mull over as you maybe explore these kinds of capabilities yourself.

15:02

Something to mull over as you maybe explore these kinds of capabilities yourself.