Today's Deep-Dive: Grist
Ep. 264

Today's Deep-Dive: Grist

Episode description

This deep dive discusses Grist, a modern relational spreadsheet that combines the familiar grid of traditional spreadsheets with the discipline of databases. Grist enforces strict data typing in columns, ensuring consistency and scalability. It uses Scolite, a widely deployed database engine, making data portable and accessible. Grist supports Python syntax in formulas, offering powerful data manipulation capabilities with an AI assistant to help users write formulas. It features incremental imports for recurring data and native forms for data collection. Grist provides granular access control, allowing dynamic permissions based on data and user attributes. It integrates with other tools via APIs and supports open-source core with additional enterprise features in the hosted version. The document highlights Grist’s potential to shift the trend towards open, flexible data platforms.

Gain digital sovereignty now and save costs

Let’s have a look at your digital challenges together. What tools are you currently using? Are your processes optimal? How is the state of backups and security updates?

Digital Souvereignty is easily achived with Open Source software (which usually cost way less, too). Our division Safeserver offers hosting, operation and maintenance for countless Free and Open Source tools.

Try it now for 1 Euro - 30 days free!

Download transcript (.srt)
0:00

Welcome back to the deep dive.

0:01

Look, we know you want knowledge you can use fast, no fluff.

0:06

Today, we're tackling something, well, almost universal.

0:09

That moment, your simple spreadsheet

0:11

just explodes into this unmanageable beast.

0:15

Broken links, copy paste errors, you know the drill.

0:18

Our sources today point towards something called Grist.

0:21

It's being called the evolution of spreadsheets.

0:23

Big claim.

0:24

It is a big claim, but maybe a necessary one.

0:26

If you're wrestling with Excel or Google Sheets

0:29

hitting their limits, Grist offers a different path.

0:31

So our mission today is to unpack that.

0:33

How does it mix that easy spreadsheet feel

0:36

with real database power?

0:38

And crucially, what does that actually mean for you

0:39

if you're just trying to get your data organized?

0:41

Okay, but before we really get into the weeds of Grist,

0:44

we absolutely want to thank the supporter

0:46

of this deep dive, Safe Server.

0:48

Safe Server is fantastic because they handle the hosting

0:51

for exactly this kind of powerful software.

0:54

Think of them as your partner

0:55

for that digital transformation,

0:57

making sure robust tools like Grist run smoothly.

1:00

You can check them out at www.safeserver.de.

1:03

All right, so let's unpack Grist.

1:06

The sources call it a modern relational spreadsheet.

1:09

What's behind that term for the everyday user?

1:12

Yeah, that phrase relational spreadsheet,

1:14

that's kind of the core idea,

1:16

and maybe where the initial adjustment comes in,

1:18

you still get that grid, that familiar spreadsheet look,

1:20

but underneath, it's enforcing some database discipline.

1:23

And probably the biggest single difference,

1:25

especially if you're coming straight from Excel,

1:27

is how columns work.

1:29

This is key.

1:30

In Excel, a column can be a total free for all, right?

1:33

Dates, names, numbers, whatever.

1:35

Total KO sometimes.

1:36

Exactly.

1:37

In Grist, columns are different.

1:38

They have a name, sure, but critically,

1:40

they hold one specific type of data, just one.

1:44

One type, like you decide this is currency and that's it.

1:47

Precisely, or this is a date,

1:50

or this links to another table, it only holds that.

1:53

And that structure, that discipline,

1:55

is what stops things from falling apart

1:57

when your data gets complex.

1:59

It allows it to scale.

2:00

Okay, I can see how that might feel restrictive at first,

2:03

if you're used to just dumping anything anywhere.

2:06

It can be, yeah.

2:07

A bit of a mindset shift.

2:08

But the payoff is reliability.

2:11

And if you've ever used something like Airtable,

2:13

this idea of linking tables, the relational part,

2:16

will feel pretty natural.

2:17

Grist actually has articles to help people

2:20

make that jump from Excel or Sheets.

2:22

That's helpful.

2:23

Now you mentioned something about its physical format

2:25

being interesting, Scolite.

2:27

Yes.

2:28

This is actually pretty cool, especially

2:30

if you care about owning your data.

2:33

Grist files are built on Scolite.

2:35

Scolite.

2:36

Isn't that like a super common database engine?

2:38

The most widely deployed database engine on the planet.

2:40

Yeah, it's everywhere.

2:41

OK, but why does that matter for my spreadsheet file?

2:44

Portability and control.

2:45

Massively.

2:46

Think about it.

2:47

Your data isn't locked into some weird proprietary format

2:51

only Grist can read because it's Scolite.

2:53

Almost any standard database tool

2:55

can pull out the basic text and numbers.

2:57

So even if Grist disappeared tomorrow,

3:00

your actual data is safe, accessible.

3:02

You can back it up reliably.

3:03

You're not trapped.

3:04

That's actually a really big deal.

3:06

Future-proofing your data from the get-go.

3:09

All right, let's shift gears.

3:10

Formulas.

3:11

This is where spreadsheets often show their power,

3:15

but also their pain points.

3:17

VLO cup nightmares.

3:19

Anyone.

3:19

Hey, yeah.

3:20

We've all been there.

3:21

Gris takes a radically different approach here.

3:23

We're talking like genuine data superpowers baked right in.

3:26

Superpowers.

3:27

Go on.

3:27

OK, so the headline feature.

3:28

Full Python syntax is supported directly in the formula cells.

3:31

Whoa, hold on.

3:32

Python.

3:33

Like, the programming language inside a spreadsheet.

3:36

Yeah, the programming language, including access

3:39

to a lot of its standard library so you

3:40

can do some seriously powerful data manipulation right there

3:43

in the grid.

3:44

That sounds incredibly powerful, but maybe a bit intimidating.

3:49

Or even, like, overkill for just adding two numbers.

3:52

It could seem that way.

3:53

First, security.

3:54

It runs in a controlled sandbox, so you're not

3:56

opening massive security holes by default.

3:58

It's designed carefully.

4:00

And for the overkill part, grist gets that.

4:03

It also includes lots of the familiar Excel functions,

4:06

so the easy stuff is still easy.

4:08

SUM, average, if they're there.

4:10

Ah, OK, so it caters to both ends.

4:12

Exactly.

4:13

But when you do hit a wall with standard functions,

4:16

maybe you need to parse complex text

4:18

or do some non-trivial date calculations.

4:20

Having Python right there is honestly a game changer.

4:24

And I saw something about AI helping out with this.

4:27

Because writing Python code isn't exactly

4:29

common spreadsheet knowledge.

4:30

Right.

4:31

There's an AI assistant built in specifically tuned

4:33

for writing grist formulas.

4:35

You can basically tell it in plain English

4:36

what you want to do.

4:37

Like, show me the average sales for last month

4:39

for the completed deals.

4:40

Pretty much exactly like that.

4:41

And it will generate the grist Python formula for you.

4:44

It really lowers the barrier to using

4:47

those advanced capabilities.

4:48

That makes a lot more sense.

4:50

OK, beyond just the raw power of formulas,

4:53

what about making data entry cleaner, more organized?

4:57

Yeah, good point.

4:58

There are several features for that, things like choices

5:00

and choice lists.

5:01

Like drop down menus?

5:03

Sort of, but often presented as colorful tags.

5:06

It means you pre-define the allowed values,

5:08

ensuring consistency, no more complete

5:11

versus completed versus done.

5:12

That alone would save headaches.

5:14

Totally.

5:14

And then there are references and reference lists.

5:18

Because it's relational, you can properly link records.

5:20

So this invoice record points directly

5:22

to the correct client record in the client's table.

5:25

No error-prone duplication.

5:27

Nice.

5:27

And I see specialized editors, too, for dates, currency.

5:31

Yep.

5:31

Those enforce the data types we talked about earlier.

5:34

Make sure a date is a date, currency is currency.

5:36

Helps keep data clean.

5:38

And conditional formatting.

5:39

Making cells change color based on rules.

5:41

Yes, and that's also controlled by formulas.

5:43

So you can set up quite sophisticated rules,

5:46

like flag any task that's overdue

5:48

and assign to a specific team.

5:50

Visual cues based on real logic.

5:52

OK.

5:53

Moving from putting data in to getting insights out.

5:56

Traditional spreadsheets often become this giant wall

5:59

of text and numbers.

6:01

How does Grist handle visualizing things?

6:04

This is another strong point, drag and drop dashboards.

6:08

You're not stuck just in the grid view.

6:10

So charts and things.

6:11

Charts, definitely.

6:12

Card views, which are great for seeing individual records,

6:15

calendar widgets, the usual suspects.

6:18

But the really unique thing is how you can link these widgets

6:20

together.

6:21

Link them.

6:22

How does that work?

6:23

Imagine you have your main table of data, maybe a chart showing

6:26

sales by region, and perhaps a detailed card view.

6:29

You can lay them out together on a dashboard page.

6:32

Then when you click on, say, a specific row in the main table,

6:35

maybe representing a single project,

6:37

the chart and the card view instantly

6:39

filter to show only the data related

6:41

to that specific project.

6:43

So clicking filters everything else automatically.

6:45

Exactly.

6:46

It makes exploring your data incredibly dynamic

6:48

without having to constantly create new siltered views

6:51

or cram everything onto one sheet.

6:53

It keeps the analysis separate but connected.

6:55

That sounds much cleaner.

6:57

Now, what about getting data into Grist easily,

7:00

like from forms or recurring imports?

7:03

Bank statements come to mind.

7:05

Oh, the dreaded CSV import reconciliation.

7:09

Yes, Grist has a feature called incremental imports,

7:13

which is fantastic for this.

7:14

Incremental imports.

7:15

Yeah.

7:16

Say you import your bank activity CSV for January.

7:20

Then in February, you get the next CSV

7:22

instead of dumping it all in and manually deleting duplicates.

7:26

Which takes forever.

7:27

Right.

7:27

Grist can intelligently look at the new file,

7:30

compare it to what's already there,

7:31

and only import the genuinely new rows.

7:34

It handles the deduplication.

7:35

It's a huge time saver for recurring data.

7:38

OK, that's brilliant.

7:39

And for collecting new data.

7:41

It has native forms.

7:42

You can design simple forms directly within Grist,

7:44

and the submissions feed straight into your tables.

7:47

No need for a separate tool like Google Forms or Typeform

7:50

if your needs are straightforward.

7:51

Very useful.

7:52

Now, collaboration means security.

7:54

How does Grift handle permissions,

7:56

especially if multiple people are using the document?

7:58

It offers really granular access control, much more detailed

8:01

than typical spreadsheets.

8:02

Granular how?

8:03

Like down to the column?

8:05

Down to individual rows, columns, or even entire tables.

8:09

OK, that's pretty standard for a database like Tools.

8:12

True, but here's the clever part.

8:14

The permissions aren't just static user rules.

8:16

They can be dynamic based on the data itself or user attributes.

8:20

Whoa, based on the data.

8:22

Give me an example.

8:23

OK, imagine a sales pipeline table.

8:25

You could set a rule saying users can only

8:28

see rows where the assign rep column matches

8:30

their own user email.

8:32

Or only users with the manager attribute

8:35

can see the commission amount column.

8:37

So the rules adapt to the data in real time.

8:39

Exactly.

8:40

That kind of dynamic data-driven access control

8:44

is usually found in much more complex and expensive enterprise

8:47

database systems.

8:48

It's pretty powerful for collaborative work.

8:50

And does it play nice with other tools, integrations?

8:52

Yep, it's built to connect.

8:54

There's a REST API, Zapier integration,

8:56

web hooks are supported, and standard import

8:59

text port with Google Drive, Excel, CSV.

9:02

It aims to be a hub, not an island.

9:04

This leads us nicely to a really defining aspect.

9:07

Grist is open source, or at least open core.

9:10

What does that mean, practically?

9:11

Right, the core engine, grist core,

9:13

is open source under the Apache 2.0 license.

9:17

This is significant for a few reasons.

9:19

Like what?

9:20

Why should the average user care if it's open source?

9:22

Three main things, I'd say.

9:24

First, independence.

9:26

You're not locked into Grist Labs forever.

9:28

If you self-host, the core tool keeps working.

9:31

Your data format, sweet light, is open.

9:33

You have options.

9:34

Second, trust.

9:36

The code is public.

9:37

Security researchers, or just curious developers,

9:40

can inspect it, find vulnerabilities, contribute fixes.

9:43

More eyes generally means more robust, trustworthy software.

9:47

And third, flexibility, especially around cost.

9:50

You can self-host grist core.

9:51

If you have the technical know-how,

9:53

you can run it on your own server, maybe

9:55

for internal use, without paying subscription fees.

9:57

OK, self-hosting sounds powerful, but maybe daunting.

10:00

How easy is it to actually try this grist core thing?

10:03

Surprisingly easy if you're comfortable

10:05

with basic tech tools.

10:06

The most common way is using Docker.

10:08

It's often just one or two commands in your terminal,

10:10

and you have a local grist instance running.

10:12

Docker.

10:13

OK, that's becoming pretty standard for developers.

10:15

It is.

10:15

Makes it quite self-contained.

10:18

There's also a dedicated desktop app, if you prefer that,

10:21

and even something called grist static,

10:23

which lets you embed a read-only grist

10:25

sheet in a static website without any back-end server

10:28

needed.

10:28

Lots of options, then.

10:30

But you mentioned open core.

10:32

That implies some parts aren't open source.

10:34

What's the deal with the hosted version at getgrist.com

10:37

versus this grist core?

10:39

That's a key distinction, especially for businesses,

10:42

maybe.

10:43

Grist core is the full open source product.

10:45

The hosted service, getgrist.com, includes that core,

10:48

but adds some extra non-open source extensions.

10:51

What kind of extensions?

10:52

Things that might be more enterprise-focused,

10:54

maybe specific integrations like an Azure back-end option,

10:58

advanced audit logging features, or the newer, more general

11:01

purpose Grist AI assistant that goes beyond just formula.

11:05

Why does that matter?

11:05

Transparency, mainly.

11:07

If your organization needs certain compliance features,

11:10

like detailed audit trails, you need

11:12

to know if that specific feature is

11:14

part of the open source publicly auditable code,

11:18

or if it's a proprietary extension provided

11:20

by Grist Labs.

11:21

They're pretty clear about it, but it's

11:23

important to understand which components are which,

11:25

especially if you choose to self-host and enable

11:27

those enterprise features.

11:28

Got it.

11:29

Transparency is good.

11:30

OK, let's try and wrap this up.

11:32

Key takeaways for someone listening.

11:33

Grist seems to tackle spreadsheet chaos

11:36

head on by mixing that familiar grid with strict database

11:39

rules, especially that one data type or column rule.

11:42

Right.

11:43

And it massively boosts what you can do with your data

11:46

by digging Python into the formulas,

11:48

but makes it accessible with things like the AI assistant.

11:50

And maybe most critically for the long term,

11:52

its open source foundation and use of SeqWite

11:55

mean you actually control your data, no vendor lock-in.

11:58

Exactly.

11:59

Which leads me to a final thought maybe a bit provocative

12:02

for you to chew on.

12:03

Given this combination powerful open scripting, like Python,

12:07

plus a universal open data format like SeqWite,

12:11

what does this trend really mean for all those closed off

12:14

proprietary low code platforms out there?

12:16

Are we maybe seeing the start of a shift?

12:19

A move away from platforms that deliberately

12:21

make it hard to get your data out or work

12:23

with it using other tools?

12:25

Is openness becoming the new competitive advantage?

12:28

That is definitely something to think about,

12:30

the future of data ownership and flexibility.

12:33

Excellent stuff.

12:33

Thank you for walking us through Grist today.

12:36

Thanks all of you for joining this deep dive.

12:38

And one last huge thank you to our sponsor, Safe Server.

12:41

Meet reliable hosting for powerful software like Grist

12:44

or help with your digital transformation.

12:46

You can find more info at www.safeserver.de.

12:46

You can find more info at www.safeserver.de.