Support for additional RDBMS

Lercher · August 12, 2020, 11:55am

Hi all,

I‘m wondering if it is possible to have temporal using other relational database systems besides MySQL if there is a stable go sql driver available. In my particular case I‘m interested in SQL Server and Postgress, just because it‘s already established infrastructure at customer sites.

Could someone comment on this or on a roadmap about it? Additionally appreciation for pointing to a description of the (now stable) existing database schema on GitHub to have a look at.

Thanks, Martin

ryland · August 12, 2020, 4:25pm

Hey, thanks for the great question. Today we officially support MySQL and Cassandra. We are planning on support for Postgres as its the most requested database. That being said I do not have a timeline for this. We currently do not have concrete plans for supporting SQL server but its definitely possible.

Here is the MySQL schema for V1. Note this could change if critical bugs are found before V1:

github.com

temporalio/temporal/blob/master/schema/mysql/v57/temporal/versioned/v1.0/schema.sql

CREATE TABLE namespaces(
  partition_id INT NOT NULL,
  id BINARY(16) NOT NULL,
  name VARCHAR(255) UNIQUE NOT NULL,
  notification_version BIGINT NOT NULL,
  --
  data BLOB NOT NULL,
  data_encoding VARCHAR(16) NOT NULL,
  is_global TINYINT(1) NOT NULL,
  PRIMARY KEY(partition_id, id)
);

CREATE TABLE namespace_metadata (
  partition_id INT NOT NULL,
  notification_version BIGINT NOT NULL,
  PRIMARY KEY(partition_id)
);

INSERT INTO namespace_metadata (partition_id, notification_version) VALUES (54321, 1);

This file has been truncated. show original

Let me know if this helps.

Lercher · August 12, 2020, 7:57pm

Hi Ryland, thanks for your very quick response. If I wanted to sum it up in my own words, it’s „a handful of narrow tables with some indices, but no views, stored procs, functions, etc., i.e. nothing really complicated in terms of porting it“. That’s really good news for me. Thanks, Martin.

madhu · August 13, 2020, 5:44am

I tested this in mysql 5.7.21 and there are couple of issues with that ( i am not able to bring up temporal, did not dig deep) but it temporal works just find with 5.7.30,

Haven’t tested on mysql 8.

Lercher · August 13, 2020, 2:53pm

Hi all, I made a quick experiment and piped the mysql DDL mentioned through a converter. The resulting, sightly augmented sql script creates all 24 tables. If you’re interested, it is here: https://gitlab.com/lercher/wf/-/blob/master/temporal-28-sqlserver.sql

The script creates all the objects in a schema “temporal” in your default database so that the tables can co-exist with existing other schemas. However, I have no idea if it would work with a go based sql driver and how it behaves under load, which is a secondary concern for myself currently.

Martin_Lercher · February 26, 2021, 7:39pm

Just to inform about my work on an MS SQL Server plugin for v1.7.0. Have a look at Martin Lercher / temporal-sqls · GitLab

Topic		Replies	Views
SQL Server support with Java Community Support java-sdk , database	3	641	March 14, 2022
Questions on temporal basic setup Community Support	5	578	February 16, 2023
Temporal with MySQL Community Support mysql , worker	0	124	March 1, 2024
SQL Server Persistence Support Community Support	1	307	May 8, 2023
Mysql schema compatibility error when starting temporal service Community Support java-sdk , mysql	6	2705	January 25, 2024

Support for additional RDBMS

Related Topics