Today's Deep-Dive: ChangeDetection
Ep. 139

Today's Deep-Dive: ChangeDetection

Episode description

This episode focuses on the benefits and functionalities of website change detection, specifically using the tool change detection.io. This open-source tool allows users to monitor websites for any changes, providing alerts only when relevant updates occur, thus saving time and enhancing efficiency. It is user-friendly, accommodating both tech-savvy individuals and those less comfortable with code, thanks to features like a visual selector and the ability to mimic browser actions. Various users, from smart shoppers to businesses, utilize it for tracking price changes, monitoring competitors, and staying updated on industry news. The tool can automate tasks through API calls, allowing for seamless integration with other applications. However, it is primarily focused on text content changes and may not be suitable for real-time updates or visual changes. The future of change detection may involve AI advancements, enabling deeper insights into the changes detected. Overall, change detection.io empowers users to stay informed and make timely decisions based on website updates. SafeServer, the sponsor of this discussion, offers support for digital transformation and tool setup.

Download transcript (.srt)
0:00

Hey everyone welcome to another deep dive today. We're going to be looking into

0:03

something that's super interesting and can really help you stay ahead of the curve

0:07

online.

0:08

We're talking about website change detection. And by the way this deep dive is

0:12

powered by safe server. They're the experts when it comes to digital transformation

0:16

and hosting.

0:17

They can even help you set up the tools we're going to be talking about today. So

0:20

that's something you're interested in. Check them out at www.safeserver.de

0:25

Yeah it's like having a digital detective constantly scanning websites for the

0:29

changes that matter to you. Sounds pretty useful. So what exactly is this tool we're

0:35

talking about.

0:35

It's called change detection.io. It's a really popular open source tool and it lets

0:40

you monitor websites for any changes no matter how small. And the best part is it's

0:45

designed for everyone. So if you're comfortable with code. Great. But if not it's

0:48

still super easy to use.

0:49

From the research I did it seems like people are using this for just about

0:53

everything. I mean from finding deals to keeping an eye on well pretty much

0:57

anything online.

0:58

Exactly. I mean think about how frustrating it is to constantly refresh a web page

1:03

waiting for a price to drop or a product to come back in stock. Change detection.io

1:08

basically takes care of all that for you.

1:10

So smart shoppers use it to track price changes. Bargain hunters can get restock

1:15

notifications. Data journalists can even monitor government websites. The

1:19

possibilities are pretty much endless.

1:22

Well I need to make sure I'm getting this. So instead of me hitting refresh every

1:26

five minutes this tool does it for me and only alerts me when something changes.

1:30

You got it. You're in complete control. It's like setting up a custom alert system.

1:33

But for the Web.

1:34

OK. This might sound like a silly question but how is that different from just bookmarking

1:38

a page and checking it every now and then.

1:40

It's all about efficiency and opportunity. Let me give you an example. Imagine you're

1:44

trying to get your hands on a limited edition sneaker release.

1:48

You know those things sell out in seconds. By the time you check your bookmarks it's

1:52

already too late. Change detection dot IO catches those changes the moment they

1:57

happen so you can actually get ahead of the game.

1:59

OK. Now I'm starting to see why this is so useful. So how does it work. Is it

2:04

difficult to set up.

2:06

That's the beauty of it. It's designed to be super simple. Let's say you want to

2:10

keep an eye on the price of a product on Amazon. You just tell change detection dot

2:14

IO to watch that page and it takes care of the rest.

2:17

So it can handle any website. Pretty much. Yeah. From small blogs to huge e-commerce

2:23

sites it can monitor pretty much anything.

2:25

OK. You've convinced me. What are some of the features that make this possible. I

2:29

mean I was looking at the research you said and it seems like there's a lot going

2:32

on under the hood.

2:33

Well one of the coolest features is the visual selector. This lets you choose

2:36

exactly what part of the web page you want to monitor. So like if I'm only

2:40

interested in the price on that Amazon product.

2:42

I could ignore all the other stuff on the page. Yeah exactly. You can tell it to

2:47

just focus on the price and nothing else. No more wasting time looking for the

2:50

information you need. That's super useful.

2:52

Yeah. Also something about browser steps. What are those all about. That's where

2:57

things get really interesting. So sometimes websites hide information behind

3:02

certain actions like logging in or adding something to your cart. Change detection

3:07

dot IO can actually mimic those actions. It's like having a mini web browser built

3:12

right in. So it can see changes even in those hidden parts of a website. You got it.

3:16

Think about those flash sales that require you to log in to see the special prices

3:21

change detection dot IO.

3:23

Can handle that for you and let you know the second the sale starts. OK. Now we're

3:27

talking that's some serious online shopping power. But what if I want to track a

3:31

site that updates all the time like a news site or social media. Wouldn't I be

3:35

getting tons of notifications. That's a good point. But that's where filters come

3:39

in. Change detection dot IO gives you a lot of control over what you're monitoring.

3:43

So you can choose to only be notified when certain keywords appear or if a specific

3:47

part of the page changes. It's all about making sure you only get the alerts that

3:51

are relevant.

3:52

So it's not just about any change, it's about the changes that actually matter.

3:56

Exactly. And you can get those notifications in a bunch of different ways too.

4:00

Emus text message, even platforms like Discord or Slack. You can pick what works

4:05

best for you.

4:05

It's amazing how much control you have. It all sounds really useful.

4:09

But I have to ask, from a technical standpoint, how does this all work?

4:13

I mean, I saw some terms in the research like XPath and CSS selectors.

4:17

Do I need to be a coding expert to understand any of this?

4:20

No, not at all. Those terms might sound complicated,

4:23

but they're basically just different ways to target specific information on a

4:28

webpage.

4:28

It's like giving the tool a set of instructions on where to look for changes.

4:32

Okay, so even if I'm not comfortable with code, I can still use this.

4:35

Definitely. They've made it really user-friendly.

4:38

You know that visual selector we talked about earlier?

4:41

You can just point and click on the elements you want to track. You don't have to

4:45

write any code.

4:45

The tool does all the technical stuff in the background.

4:47

That's a relief. So it sounds like they really wanted to make this accessible to

4:51

everyone.

4:51

But what about people who are more tech savvy and want more control over things?

4:56

Oh yeah, for sure. For those folks, ChangeDetection.io is super flexible.

5:01

You can use advanced filters, write custom scripts, even connect it with other

5:05

tools and platforms using something called API calls.

5:07

You mentioned API calls. What are those exactly and why would I care?

5:12

So API calls are basically ways for different applications to communicate with each

5:17

other.

5:17

Imagine this, you could set up ChangeDetection.io to monitor a competitor's website

5:22

for price drops.

5:23

And then when it detects a change, it could automatically update the spreadsheet

5:28

with the new price.

5:29

Wow, that opens up a lot of possibilities. It's like having a digital assistant

5:32

working behind the scenes, automating tasks based on what's happening online.

5:36

It's pretty powerful stuff, right? But before we get too carried away with all the

5:41

amazing things you can do with this,

5:42

let's take a step back and look at who's actually using ChangeDetection.io and why

5:47

I think you'll be surprised by how many different ways it's being used.

5:50

Okay, so we've talked about how ChangeDetection.io works all the cool features like

5:55

the visual selector and browser steps and the filters.

5:57

But who's actually using this? Give me some real world examples.

6:00

Well, you know how flight and hotel prices are always changing. People are using

6:05

ChangeDetection.io to monitor those prices and find the best deals before they

6:09

disappear.

6:09

Makes sense.

6:10

Yeah.

6:11

I feel like I'm always missing out on those flash sales for travel websites. So

6:15

this could actually alert me when, let's say, a flight to Bali drops below a

6:20

certain price.

6:21

Exactly. You just tell it your destination, the dates, your budget, and it does the

6:25

work for you. No more endless searching.

6:27

Okay, so that's one way to use it. What else?

6:29

Let's say you're a student looking for scholarships. A lot of times those

6:33

applications have really strict deadlines, so you don't want to miss them. With

6:38

ChangeDetection.io, you can track scholarship websites and get notified the minute

6:42

new opportunities pop up.

6:43

That's a great idea.

6:44

Yeah.

6:45

I can see how helpful that would be, especially for students who are trying to

6:49

figure out all that financial aid stuff.

6:50

And it's not just for personal use. Businesses are finding some pretty creative

6:54

ways to use ChangeDetection.io, too.

6:55

Like what? Give me some examples.

6:57

Let's say you own a small business and you want to keep an eye on your competitors.

7:01

You can use ChangeDetection.io to track their websites for price changes, new

7:07

products, they're launching even their marketing campaigns.

7:09

It's like having your own personal spy.

7:12

Now that's smart. That kind of information could give you a serious advantage.

7:16

Yeah, and it goes beyond just competitors. Businesses are using it to stay updated

7:21

on industry news track.

7:22

Any changes in regulations even monitor their supply chains for any potential

7:27

problems.

7:27

Wow, this is really powerful stuff.

7:29

We've talked a lot about tracking websites for changes, but can you give me an

7:33

example of how someone might actually use those changes to do something like

7:38

automate a task?

7:39

Sure. Let's go back to the travel deal example.

7:41

Imagine you really want to go on that trip to Bali and you're ready to book the

7:45

flight if the price drops below a certain point.

7:48

You could set up changedetection.io to send you an email or even a notification to

7:52

your phone as soon as that price changes.

7:54

So it's not just about knowing that something changed, it's about using that

7:58

information to actually do something quickly.

8:00

Right. And if you know a little bit of coding, you can take that automation even

8:04

further.

8:04

You could connect changedetection.io to other tools like a spreadsheet or a project

8:09

management app and have it automatically update those tools with the new

8:13

information.

8:13

That's pretty amazing. So you could have it watching a specific webpage and then

8:18

based on what changes it sees, have it set off a whole chain of events, sending

8:22

emails, updating spreadsheets, maybe even adding things to your to-do list.

8:25

Yeah, exactly. And that's just the beginning of what you can do with API calls.

8:29

Okay. This is all pretty mind-blowing. But let's be real for a second. Is there

8:33

anything this tool can't do? Are there any limitations?

8:36

Well, it's important to keep in mind that change-detection.io is mainly focused on

8:42

changes in text content. It can handle images to a certain extent,

8:44

but if you're mostly interested in visual changes on a website, there might be

8:48

better tools out there.

8:49

So if I'm a designer and I'm trying to see if my competitor changed their website

8:54

layout or branding change-detection.io might not be the best choice?

8:57

Right. You always want to make sure you're using the right tool for the job. And

9:01

another thing to remember is that change-detection.io doesn't work in real time.

9:05

It checks for changes at set intervals, which you can customize, but there's always

9:10

going to be a bit of a delay.

9:11

So if I need something that's truly instant, like for a stock ticker or a live

9:15

auction, this might not be the best fit.

9:17

Exactly. But for most cases, those small delays aren't really a big deal. And even

9:22

with those limitations, change-detection.io still offers a level of automation and

9:26

control that you just wouldn't be able to do manually.

9:28

That's a great point. This tool basically frees you up from having to constantly

9:34

check websites yourself, so you can focus on using that information to make

9:37

decisions, take action, or just stay informed.

9:39

Couldn't have said it better myself. And the fact that it comes in a free open

9:43

source version and a paid version with even more features means it's a good option

9:47

for pretty much everyone.

9:48

We've covered a lot of ground here. We talked about the technical stuff, the

9:52

practical uses, even some of the limitations. But what about the future? Where do

9:55

you see website change detection going in the next few years?

9:58

Yeah, it feels like we're just getting started. I think one of the most exciting

10:02

areas is AI, you know, artificial intelligence. Imagine change detection.io, not

10:09

just detecting changes, but actually understanding what they mean.

10:12

So instead of just knowing a price went down, it could tell me if it's a good deal

10:17

or just a small change.

10:18

Right. And it could even start to predict future changes based on what's happened

10:22

in the past. It'd be like having a crystal ball for the web.

10:24

Okay, now that's a little creepy.

10:26

I know, but think about what you could do with that. You could spot trends before

10:30

they happen, make better decisions, even get ahead of the competition. It's pretty

10:34

amazing.

10:34

And what about just making these tools easier to use?

10:37

Oh yeah, for sure. I mean, we're already seeing things like drag and drop

10:40

interfaces and more intuitive designs. I think eventually anyone will be able to

10:45

use these tools, even if they don't know anything about coding.

10:47

So even my grandma could set up a watch list for yarn sales online.

10:50

Exactly. Everyone should be able to benefit from this technology.

10:54

Okay, so as we wrap up our deep dive into changedetection.io, what are the key

11:00

things you want our listeners to remember?

11:03

Well, first of all, website change detection is a really powerful tool, and it can

11:06

be used in so many different ways.

11:07

No matter who you are, a bargain hunter, a business owner, or just someone who

11:11

wants to stay in the loop, there's a way you can use this.

11:14

And what's great about changedetection.io is that anyone can use it.

11:18

It's all about automation, efficiency, and control. Changedetection.io does all

11:23

that tedious monitoring for you, so you can focus on what really matters using that

11:27

information.

11:27

Couldn't have said it better myself. And huge thanks to SafeServer for making this

11:32

deep dive possible.

11:33

If you want to learn more about changedetection.io or just need some help with your

11:37

digital transformation strategy, check them out at www.safeserver.de.

11:42

Yeah, they're a great resource for anyone who wants to stay ahead of the game.

11:45

Alright folks, that's our deep dive into a world of website change detection with

11:50

changedetection.io. I hope you found this as fascinating as we did.

11:54

Remember, the web is constantly changing, but with tools like changedetection.io,

11:58

Until next time, keep exploring, keep learning, and keep diving deep.

11:58

Until next time, keep exploring, keep learning, and keep diving deep.