Today's Deep-Dive: WSO2 API Manager
Ep. 293

Today's Deep-Dive: WSO2 API Manager

Episode description

WSO2 API Manager is a comprehensive platform designed for creating, managing, consuming, and monitoring web APIs, playing a crucial role in modern business operations. It addresses the challenge of managing the vast flow of digital traffic generated by applications interacting with numerous backend services. The platform comprises three core components: the API Publisher, acting as the control room for defining APIs and setting rules; the API Developer Portal, serving as a marketplace for developers to discover, document, and test APIs; and the API Gateway and Traffic Manager, which enforce security policies and control data flow. WSO2 API Manager emphasizes robust security through industry standards like OAuth2 and fine-grained access controls, while its architecture is optimized for high-speed, low-latency performance. It also provides essential traffic management features like rate-limiting and throttling to ensure system stability and scalability. The platform is adapting to the rise of generative AI, offering specific governance tools for AI APIs, including token management, guardrails against prompt injection, and cost control mechanisms for LLMs. Egress API management is also a key feature, allowing control over outbound traffic to external services, thereby enhancing security and compliance. Being open-source, WSO2 API Manager offers transparency, customization, and community-driven innovation, making it a strategic choice for enterprises. Its Kubernetes-native design supports flexible deployment across on-premises, hybrid, and cloud environments, managed through a unified control plane. This ensures consistent policy application across diverse infrastructures, contributing to its adoption by numerous Fortune 500 companies and government agencies. Ultimately, WSO2 API Manager provides end-to-end API lifecycle governance, balancing developer experience with stringent security and performance requirements, and extending its capabilities to manage the complexities of AI-driven interactions.

Gain digital sovereignty now and save costs

Let’s have a look at your digital challenges together. What tools are you currently using? Are your processes optimal? How is the state of backups and security updates?

Digital Souvereignty is easily achived with Open Source software (which usually cost way less, too). Our division Safeserver offers hosting, operation and maintenance for countless Free and Open Source tools.

Try it now!

Download transcript (.srt)
0:00

Let's start with a simple thought experiment.

0:02

You use an app on your phone,

0:03

maybe tracking a package, right?

0:05

Or checking stock prices.

0:06

That app isn't, you know, doing all the heavy lifting itself.

0:09

It's talking to loads of other services behind the scenes.

0:12

And that whole invisible conversation,

0:13

the secure data transfer,

0:15

the identity checks happening instantly,

0:17

that's all APIs.

0:18

Managing that huge, ever-growing flow of digital traffic.

0:21

Well, that's what makes or breaks a modern business today.

0:25

So today we're doing a deep dive

0:27

into a platform built specifically for this challenge,

0:29

WSO2 API Manager, or WSO2 API M,

0:32

as you'll often hear it called.

0:34

Our mission really is to give you, the learner,

0:36

a clear, jargon-free starting point.

0:38

What is this thing?

0:40

What are its core parts?

0:41

And crucially, why is it such a big deal

0:43

for API governance worldwide?

0:45

We wanna cut through the tech talk

0:46

and understand how it gives organizations full control.

0:49

But before we jump into our sources, just a quick word.

0:52

This deep dive is brought to you by Safe Server.

0:54

Safe Server supports your digital transformation journey

0:56

and they're experts at handling the hosting

0:58

for complex software like this.

0:59

They make sure you've got the solid infrastructure you need.

1:02

You can find out more at www.safeserver.de.

1:06

Right, and we've got a good stack of materials here.

1:08

Our goal, I think, is to take the pieces of WSO2 API

1:12

and the gateway, the publisher, the developer portal,

1:15

and show how they're not just technical terms,

1:16

they're actually clear solutions to real business headaches,

1:20

especially around security and scaling things up.

1:22

Okay, let's unpack this then.

1:24

Our sources describe WSO2 API Manager

1:26

as a powerful platform for creating, managing,

1:30

consuming, and monitoring web APIs.

1:33

But let's get basic.

1:34

For someone needing the fundamentals,

1:36

what's the simple definition of API management itself?

1:39

Fundamentally, API management is the whole process,

1:42

the complete governance over an API's entire life.

1:44

Think cradle to grave, from the initial idea for an API

1:47

right through to when you finally retire it.

1:49

WSO2 API I think works so well

1:52

because it blends tried and tested principles

1:54

like security and reliability with modern demands

1:57

like agility and massive scale.

1:59

It's really all about keeping control, maintaining security,

2:02

and having visibility into all those digital interactions.

2:06

And the architecture is central to that control, isn't it?

2:09

We keep seeing this phrase,

2:11

loosely coupled modules in the reading.

2:14

What are the main bits we need to keep in mind?

2:16

Yeah, that modular design is key

2:18

because it gives everything a clear job.

2:20

You really need to focus on three main areas.

2:22

First, the API publisher.

2:24

I think of this as the control room.

2:25

It's where your tech teams define the API, set the rules,

2:29

manage its quality, its life cycle.

2:31

Got it, the rule maker.

2:32

Exactly.

2:33

Then second, you've got the API developer portal.

2:35

This is more like the shop window, the marketplace.

2:38

It's where developers, maybe external partners,

2:40

maybe internal teams go to find

2:42

and use the services you've built.

2:43

The storefront.

2:44

And third, the real engine room,

2:46

the API gateway and the traffic manager.

2:49

This pair acts like the security guard

2:51

and the performance cop, basically.

2:54

They sit between the person using the API

2:56

and your back end service.

2:57

They enforce every rule the publisher set up,

3:00

and they control the actual flow of data.

3:02

That separation makes a lot of sense.

3:04

Very clean.

3:05

Let's start with the discovery part, the developer portal.

3:08

That's the public face.

3:09

The sources compare it to an app store,

3:11

which is a great mental picture.

3:13

Yeah, we found that comparison really useful, too.

3:15

Like the Google Play Store or Apple's App Store,

3:17

the developer portal offers a graphical, user-friendly way

3:22

in.

3:23

If you're a developer wanting to use an API, you go there.

3:25

You find published, ready-to-go APIs.

3:28

You can browse by tags, who provides it,

3:31

or just search by name.

3:32

So it's not just a list.

3:33

Oh, no, it's much more interactive.

3:35

Developers can sign themselves up.

3:36

They can read detailed documentation.

3:39

They can leave comments, rate the APIs.

3:41

And this is cool.

3:42

They can even try APIs directly on the developer portal,

3:45

right there, before writing any code.

3:47

Wow, being able to try it right there

3:49

must speed things up massively for developers.

3:52

But crucial part, access control.

3:55

How does the portal manage who gets to use what?

3:59

Subscriptions.

4:00

Yes, and it's very controlled.

4:02

Developers subscribe to APIs per application.

4:05

So access isn't just tied to the developer.

4:07

It's tied to the specific app they're building.

4:09

This is also where they pick service tiers.

4:11

If you know you'll hit the API a lot,

4:13

you pick a high-volume tier.

4:15

If it's just occasional use, maybe a lower one.

4:17

This lets the provider manage resources, control load,

4:20

and, let's be honest, potentially monetize

4:22

their APIs effectively.

4:23

Right, makes sense.

4:24

So that covers the consumer angle.

4:26

Let's flip it back to the control room, the API publisher.

4:29

If the portal is the storefront, the publisher

4:32

is like the factory floor manager.

4:34

What are the key governance jobs done here?

4:37

The publisher is all about quality and consistency.

4:39

This is where the API teams define new APIs.

4:42

Often they'll import an existing definition,

4:44

like an open API or swagger file.

4:47

And crucially, they manage the lifecycle

4:49

with a strong governance model.

4:50

That means tight control over versioning,

4:53

managing the steps from creation to publishing,

4:55

and eventually deprecation and retirement.

4:58

This stops that nightmare where developers are suddenly

5:01

relying on a service that you secretly pulled offline.

5:04

Prevents breaking changes.

5:05

Exactly.

5:06

And a key function here is supporting API-first design.

5:10

This lets the company design the API contract, what

5:12

it promises to do, and share that with developers

5:15

for feedback before building the expensive backend stuff.

5:18

It makes it more collaborative.

5:19

And yes, this is also where you manage and hand out

5:21

those vital API keys for every consumer,

5:24

internal or external.

5:26

OK, now let's get to where the rubber meets the road.

5:29

Security and performance.

5:30

That's the gateway and traffic manager's job.

5:33

If the publisher sets the policy,

5:35

these two enforce it on every single request.

5:38

Precisely.

5:39

For access security, WSO2-APIM leans on industry standards,

5:43

especially OAuth2 for API access.

5:46

It supports complex flows like the authorization code grant

5:49

type, so you get robust token-based security.

5:51

Standard stuff, but important.

5:53

Very.

5:53

But the policy enforcement goes deeper.

5:55

You can set up really fine-grained security rules,

5:58

like you can restrict API access tokens

6:00

so they only work if the request comes from certain domains

6:03

or IP addresses.

6:04

So even if a token gets leaked somehow,

6:06

a bad actor probably can't use it from just anywhere.

6:09

That level of control is vital for enterprise trust.

6:12

That makes sense.

6:14

Now, performance.

6:15

The sources mentioned sub-millisecond latency

6:18

and extremely high-performance pass-through message routing.

6:22

That sounds amazing.

6:23

But is there a trade-off?

6:25

Usually, speed costs you something, doesn't it?

6:28

That's a fair question.

6:29

In this setup, you're generally not

6:31

sacrificing the core security checks for speed.

6:33

The speed comes from the design itself.

6:35

The gateway is built for high-speed pass-through.

6:37

It validates the token, applies security policies,

6:40

but it doesn't necessarily unpack and deeply inspect

6:44

every single message unless you specifically tell it to.

6:47

Ah, OK.

6:48

And the traffic manager.

6:49

That's the regulator keeping the system healthy.

6:52

It enforces rate-limiting and throttling policies

6:54

for APIs by consumer.

6:56

So if one app suddenly starts hammering your service,

6:59

the traffic manager steps in, restricts that app,

7:01

but doesn't let the surge bring down

7:03

the service for everyone else.

7:04

And the whole thing is built to scale horizontally.

7:06

That's how it can support millions of developer

7:08

servers without grinding to a halt.

7:11

That kind of traffic control is essential.

7:13

But now it's facing a new challenge, generative AI.

7:16

Our sources really highlight that WSO2 API manager

7:19

is adapting quickly here.

7:21

So how does it handle governing these complex AI workloads,

7:25

like from large language models?

7:26

Yeah, this is exactly why the AI Gateway component came about.

7:30

Governing AI APIs is just different from traditional REST

7:33

APIs.

7:34

Old APIs move simple data.

7:36

AI APIs deal with tokens, prompt engineering, context windows,

7:39

and costs that can vary wildly depending on the request.

7:42

Right, much more complex interaction.

7:44

Totally.

7:45

So the platform offers comprehensive governance

7:48

for GenAI APIs.

7:49

This means specific tools for token management,

7:52

setting up guardrails, and managing privacy controls

7:54

for LLMs.

7:55

Those guardrails are super important for stopping things

7:58

like prompt injection attacks, where

7:59

someone tries to trick the AI into revealing sensitive info.

8:02

And they also help manage costs by limiting, say,

8:04

the length of inputs and outputs, which saves

8:06

on that expensive compute power.

8:08

So it's not just about letting the request through.

8:10

It's about managing the risk that comes with this new type

8:13

of AI interaction.

8:15

And it's good to see the sources mentioned

8:16

built-in support for the big players

8:18

like OpenAI, Mistral AI, Azure OpenAI.

8:22

Absolutely.

8:23

And they've even added an AI assistant, Beta.

8:26

It uses natural language, conversational AI,

8:28

to help developers find and test APIs faster right

8:31

inside the developer portal, makes the whole developer

8:34

experience smoother.

8:35

Nice touch.

8:36

OK, now first, something often missed, but as you said,

8:39

critical for security, egress API management.

8:42

We all get ingress traffic coming in.

8:44

But what exactly is egress management,

8:46

and why is governing outbound traffic suddenly so important?

8:50

Egress management is simply about controlling

8:52

the traffic flowing out of your network to external APIs.

8:56

Think about it.

8:57

In today's world, especially with microservices,

8:59

your internal systems are constantly

9:00

calling out to third-party services, payment gateways,

9:03

mapping tools, those external LLMs we just talked about.

9:06

Right, countless external dependencies.

9:08

Exactly.

9:09

And if you don't manage that outbound traffic,

9:10

you have a huge blind spot.

9:12

You can't easily spot security issues if data is leaking out.

9:16

You can't enforce compliance rules

9:18

on data leaving your control.

9:20

And importantly, you can't control the costs.

9:23

You might have hundreds of internal services

9:25

making external calls you don't even know about.

9:28

WSO2 API Manager's ability to monitor and apply

9:31

policies to those outbound requests

9:32

basically closes that perimeter, giving you full control

9:35

over security and costs.

9:37

That makes the governance truly end-to-end.

9:40

Not just the front door, but the back door, too.

9:42

Let's connect this back to the bigger picture, the open source

9:45

foundation.

9:46

WSO2 API Manager is called the hashtag one open source

9:50

API management product.

9:52

Why is being open source such a strategic plus for big companies

9:56

beyond just saving money on licenses?

9:58

Well, the strategic benefit really

9:59

comes down to control and agility, I think.

10:01

First, there's transparency and trust.

10:03

Because the code is open, anyone can examine the code logic

10:06

and understand the implementation with confidence.

10:08

For something as critical as security,

10:10

that openness is invaluable.

10:12

We could look under the hood.

10:13

Precisely.

10:14

Second, and maybe even more critical for enterprises,

10:17

is customization and community.

10:19

Open source means you get extension freedom.

10:22

You're not locked into a vendor's roadmap.

10:24

If a company has some really specific niche need,

10:27

maybe integrating with some ancient legacy system,

10:30

they can potentially modify the open source core

10:32

themselves to handle it.

10:34

That adaptability is often what big organizations need,

10:37

rather than just an off-the-shelf box.

10:39

Plus, you benefit from community-driven innovation,

10:42

often leading to faster patches and new features

10:44

than closed platforms.

10:46

That ability to tailor it to unique, complex needs

10:49

is definitely powerful.

10:50

And that flexibility seems to extend to where you run it,

10:53

too, right, the deploy-anywhere idea.

10:55

Absolutely.

10:55

The platform doesn't really care where it runs.

10:57

On-premises data centers, hybrid cloud setups,

10:59

or using its Kubernetes-native design

11:01

for pure cloud deployments.

11:03

Kubernetes-native, OK?

11:05

And this is where the unified control plan

11:06

becomes so important.

11:07

The sources talk about different gateway types,

11:09

universal gateway, Kubernetes gateway, immutable gateway.

11:12

Sounds a bit like jargon, but the benefit is simple.

11:15

The control plane lets you manage all of them

11:17

from one single interface.

11:20

So if you have old systems on-prem using one gateway type

11:23

and new microservices in the cloud using another,

11:25

you apply the same security rules,

11:27

the same throttling policies, to both, all from one dashboard.

11:31

Wow, OK.

11:32

Applying unified rules across that kind

11:34

of fragmented landscape, old and new,

11:35

that's going to be essential.

11:37

It really shows why this platform,

11:38

with over 12 years behind it, is trusted by so many big names,

11:42

over 50 Fortune 500s, 130-plus government agencies.

11:46

That track record speaks volumes.

11:48

It really does.

11:48

It points to stability and the ability

11:50

to handle really critical workloads in demanding situations.

11:54

So to wrap up our dupe dive, WSO2 API Manager

11:57

is basically this comprehensive system built

11:59

to manage the entire API lifecycle.

12:01

It's the central point for security,

12:03

for high-performance traffic control, for full visibility,

12:05

both traffic coming in and going out.

12:07

And now it's also providing that vital governance

12:09

layer for complex AI and LLM services.

12:12

Right.

12:13

And for you, the learner, the key thing to grasp

12:15

is that real API management has to cover everything.

12:18

Balancing that developer experience in the portal

12:21

with strict policy setting in the publisher,

12:23

making sure it performs under heavy load with the gateway

12:25

and traffic manager, and crucially controlling

12:28

both the front door and the back door, ingress and egress,

12:32

especially as AI keeps pushing the boundaries.

12:36

So here's a final thought to chew on.

12:38

If you have a single control plane that

12:39

can manage all your APIs, no matter where they live,

12:42

on-prem, cloud, edge, could you use that unified governance

12:46

model to bring, say, your security teams and your finance

12:49

teams closer together?

12:50

Maybe speed up how you onboard new partners

12:52

while better managing the financial risks involved.

12:55

Something to think about.

12:56

Thanks for joining us for this deep dive into WSO2 API Manager.

13:00

And remember, this discussion was supported by SafeServer.

13:03

They're your partner for hosting and really accelerating

13:05

You can find out more and visit them at www.safeserver.de.

13:05

You can find out more and visit them at www.safeserver.de.