You know that feeling, right?
Download transcript (.srt)
0:00
0:01
0:03
0:06
0:07
0:08
0:10
0:12
0:16
0:20
0:23
0:25
0:26
0:29
0:32
0:34
0:36
0:37
0:40
0:43
0:45
0:46
0:49
0:51
0:54
0:58
1:00
1:02
1:04
1:05
1:07
1:09
1:13
1:17
1:19
1:21
1:24
1:26
1:28
1:29
1:33
1:35
1:37
1:37
1:39
1:42
1:44
1:46
1:51
1:54
1:55
1:56
1:59
2:00
2:03
2:03
2:04
2:06
2:11
2:13
2:15
2:17
2:18
2:22
2:24
2:26
2:31
2:33
2:35
2:38
2:40
2:42
2:43
2:44
2:46
2:47
2:48
2:51
2:52
2:54
2:57
2:59
3:02
3:03
3:06
3:08
3:13
3:14
3:15
3:16
3:18
3:22
3:25
3:27
3:29
3:30
3:32
3:35
3:36
3:38
3:40
3:41
3:42
3:43
3:45
3:48
3:50
3:51
3:55
3:56
3:58
4:00
4:02
4:04
4:06
4:08
4:09
4:13
4:16
4:18
4:20
4:21
4:23
4:25
4:28
4:30
4:32
4:36
4:36
4:38
4:40
4:41
4:44
4:47
4:49
4:52
4:53
4:54
4:56
4:58
5:00
5:01
5:03
5:05
5:06
5:07
5:09
5:12
5:13
5:14
5:16
5:16
5:18
5:22
5:24
5:25
5:28
5:30
5:33
5:34
5:37
5:38
5:41
5:44
5:45
5:47
5:48
5:50
5:51
5:52
5:55
5:58
5:59
6:02
6:05
6:07
6:09
6:11
6:13
6:14
6:16
6:17
6:19
6:20
6:22
6:25
6:27
6:29
6:31
6:34
6:37
6:38
6:40
6:41
6:43
6:45
6:46
6:48
6:49
6:53
6:55
6:57
6:58
7:00
7:02
7:04
7:06
7:08
7:09
7:11
7:12
7:13
7:16
7:18
7:22
7:25
7:27
7:30
7:31
7:33
7:36
7:39
7:40
7:41
7:44
7:47
7:49
7:50
7:54
7:57
8:00
8:03
8:06
8:09
8:10
8:10
8:12
8:14
8:16
8:17
8:21
8:23
8:27
8:30
8:32
8:36
8:38
8:40
8:41
8:42
8:45
8:48
8:50
8:53
8:55
8:57
8:58
8:59
9:03
9:05
9:07
9:09
9:11
9:13
9:15
9:17
9:19
9:21
9:23
9:26
9:27
9:31
9:33
9:35
9:38
9:39
9:43
9:46
9:49
9:51
9:53
9:55
9:59
10:01
10:02
10:02
It's a constant checking, refreshing a page,
checking the build status, waiting for some update.
It's exhausting.
It just eats up your time.
And honestly, your focus?
What if you didn't have to do that anymore?
Imagine having a digital helper, a sort of secret twin
that just does all that repetitive web checking for you
and only pings you when something actually changes.
Well, today we're doing a deep dive
into exactly that kind of tool.
It's called Kibitser, the personal web assistant.
We've gone through its GitHub repo, the docs,
all the sources you gave us, our mission,
to break down what Kibitser is,
why being self-hosted is such a big deal here,
and crucially, how easy it actually is for, well,
even a beginner to get started automating this stuff.
But before we jump in, a quick shout out to Safe Server
for supporting this deep dive.
Safe Server helps with hosting software like this
and supports your digital transformation journey.
You can find out more at www.safeserver.de.
Okay, so this secret twin brother idea,
the docs actually use that phrase,
like a secret twin brother who does routine tasks
and asks for nothing in return.
I kinda like that description.
Yeah, it's evocative, isn't it?
And it really nails the core idea.
Kibitzers is fundamentally monitoring software.
Its job is to pull, check websites, APIs, files,
whatever data source you point it at, again and again.
And then, only when the specific bit of data
you're watching changes, it does something.
Usually, it sends you a notification.
The whole point is shifting that burden, right?
So you don't have to constantly check.
It lets you, as they say, stay on the edge of events your way.
And it's not some lockdown commercial thing, right?
We should probably confirm its status.
Absolutely.
Yeah, the source is confirmed.
It's FOSS, Free Open Source Software, MIT license,
which is very permissive.
And looking at GitHub, it seems pretty healthy.
22 contributors, almost 800 commits, nearly 700 stars.
It's definitely active and has a community around it.
And what's under the hood?
What makes it tick?
It's overwhelmingly Python, like 96.7% Python code.
The creators even mentioned Python
is kind of the perfect language for Kibbutz,
which makes sense, I think.
Why is that?
Well, Python just has this huge ecosystem
for web scraping, network stuff, parsing data.
All the things you need for a tool like this
are readily available as libraries.
It makes building these monitors much easier.
Right, that makes sense.
But OK, Python means setup, dependencies.
If it's self-hosted, does that mean I suddenly
need to be a server admin?
And in a world full of cloud services, things like Zapier,
why go to the trouble of self-hosting?
That's really the core question, isn't it?
And Kibitzer's documentation hits it head-on.
It says pretty bluntly, self-hosted,
trust no one with your credentials.
That's the fundamental reason.
Credentials.
OK, so if you're monitoring sensitive stuff.
Exactly.
Think about some of the examples we'll get to,
like checking your bank balance or maybe a private build
server inside your company.
You simply cannot, or at least shouldn't,
hand over those logins to some third party cloud platform.
Self-hosting keeps you in control.
So it's about security and privacy, first and foremost.
It is.
But it's also about reach and flexibility.
Because it's self-hosted, it runs wherever you run it.
Windows, Linux, Mac, desktop, server, doesn't matter.
And this is key.
It can go wherever you can go.
Meaning?
Meaning, if you need to monitor something
behind your corporate VPN, or a site that needs SSH access,
or something only visible from your home network,
Kibitzer can do that because it lives there
on your machine or server, a typical cloud monitoring
service.
It hits that VPN wall and stops.
Your self-hosted twin brother just carries on.
OK, that's actually a huge advantage,
especially for anything internal or sensitive.
It's personal because it operates
from your personal digital space.
Precisely.
And it's practical, too.
The docs mentioned it's lightweight.
It apparently can run on tiniest VM offered by cloud providers.
So you're not looking at massive hosting costs.
Oh, really?
Yeah, they even suggest trying it on AWS free tier or GCP.
Always free.
So self-hosting doesn't have to break the bank, even
for something running 24-7.
All right, let's make this concrete.
What kind of routine tasks are we actually talking about?
What does a secret twin brother do?
Any good examples from the docs?
Oh, yeah, there's a good range.
On the sort of developer IT side,
there's the classic example, waiting for a long build
on something like TeamCity to finish.
Ah, yes, the eternal wheat.
Exactly.
Instead of hitting Refresh, Kibitzer
just tells you when it's done.
Or, say, tracking a specific bug fix
release for a library you depend on.
OK, that makes sense for tech stuff.
What about more personal things, where that self-hosted trust
really matters?
Well, the examples get pretty personal.
The docs mention a bank balance how-to.
Whoa, OK.
Yeah, and another success story someone shared
was about pulling a Russian passport readiness status.
Checking passport status.
Wow, that's often some clunky government website
you have to keep checking manually, right?
Exactly.
These are often tasks involving sites
that don't have nice, clean APIs.
They're messy, maybe require logins,
maybe involve multiple steps.
And these are definitely things you
don't want some random third-party service logging
into for you.
No kidding.
That passport example really highlights
the value automating something genuinely annoying
and time-consuming in the real world.
Right.
And Kipitzer is built for this.
Yeah.
The docs say it handles everything
from raw SSH commands to complex browser scenarios.
It knows protocols.
It's not just grabbing simple text.
OK, but monitoring bank balances,
interacting with complex government sites,
that sounds like it needs serious programming skills
to set up the rules.
How does Kipitzer make that part easy, especially
for a beginner?
This is where the assistant part really shines, I think.
You don't define these tasks in Python code, generally.
You define them in YAML.
YAML, OK, the configuration file format.
Right.
And the key is that it's designed to be human-friendly.
It's structured.
It's readable.
But here's the real magic, I think.
You can change what it monitors or how it monitors just
by tweaking that YAML file.
No coding, no restarting complex processes.
So if the bank website changes its layout slightly.
You just adjust the selector in the YAML.
Maybe it takes 30 seconds.
It makes maintaining these checks much, much simpler
than managing custom scripts.
Gotcha.
So the YAML is like the instruction manual
for your assistant.
Define the where, the how often.
Pretty much.
You set it up once in that central file.
And then, as they say, sit back and relax.
Kibitzer will notify you when something happens.
And the notifications, how do they arrive?
It integrates with common tools.
The docs mention Slack and Mailgun specifically.
So you can get alerts directly in your chat or email,
wherever works best for you.
OK, let's circle back to the beginner angle.
We see the value.
We see the power.
But how easy is that initial step,
getting it up and running?
They seem to have focused on making
that really straightforward.
It's basically three steps using Python's package manager, PIP.
Step one, install.
Just PIP install Kibitzer.
And it works with Python 2 and 3,
which is good for flexibility.
Step two, configure.
And again, that whole configuration in one YAML file
approach is key for beginners.
Everything's in one place.
Step three, run.
Just type Kibitzer in your terminal.
That's it.
Install, configure, run.
It seems designed to be a very gentle on-ramp.
OK, simple start.
But then, you mentioned complex browser scenarios, SSH commands.
The sources also call it powerful.
How does it bridge that gap?
If I start simple, how hard is it to level up?
That's the neat part.
You don't really switch tools.
You just add more capabilities to your YAML configuration.
That powerful aspect comes from its built-in features
and integrations.
Like what?
Well, simple page checking fails if the data
is loaded with JavaScript after the page initially loads, right?
Yeah, happens all the time.
So Kibitzer can use Selenium for that.
Selenium basically drives a real web browser behind the scenes.
Your Kibitzer Assistant can then log in, click buttons,
wait for things to load, just like a human would,
and then grab the data it needs from the fully rendered page.
Yeah, so it can handle those dynamic, modern web pages.
It's not just scraping static HTML.
It's actually interacting.
Exactly.
It's doing the tedious click work,
and then to find the exact piece of information
you want, like just the price on a product page,
not the whole description.
It supports things like XPath and CSS selectors.
These are ways to precisely target
a tiny piece of information within a huge web page.
So you only get alerted if that specific price changes,
or that specific status updates.
Not just if anything on the page changes, much less noise.
That precision is key.
And can you extend it further if the built-in stuff isn't
enough?
Absolutely.
You can plug in your own bash or Python scripts pretty easily.
And there's a plug-in system for more complex extensions.
Plus, they mention a vibrant, friendly community
on Gitter, which is probably invaluable when you start
getting into the more advanced configurations,
like complex xBath queries.
OK, so let's pull this all together.
What's the takeaway here?
Kibitzer seems to offer this potent mix of serious web
automation power, but wrapped in a way that keeps you in control
because it's self-hosted.
That's critical for sensitive stuff like finances
or government interactions.
And importantly, it pairs that power with a simple setup
using that YAML file, making it accessible
even if you're just starting out with automation.
It feels like a really nice balance.
I think that's a fair summary.
Simplicity to start, but with the power readily
available when you need it, all while maintaining
control and privacy.
So we've heard it can check bank balances, track passport
applications, monitor builds.
Given how relatively easy it seems to get started
and the power it offers with things like Selenium,
here's something to think about.
What repetitive, maybe slightly annoying, time-wasting task
are you doing online every day or every week?
Could that task be handed over securely and reliably
to your own secret twin brother?
Definitely something to consider.
And with that thought, we want to give our sincere thanks
once again to SafeServer for supporting this deep dive.
Remember, for help with software hosting
and digital transformation needs,
Thanks for tuning in, and we'll catch you on the next deep dive.
Thanks for tuning in, and we'll catch you on the next deep dive.