Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
71 commits
Select commit Hold shift + click to select a range
3e5a54c
release: bump to version v0.147.0
materialize-bot Jun 20, 2025
bbd456b
adapter: in support_execute_one drop SessionClient only after receivi…
aljoscha Jun 24, 2025
3322ff0
release: bump to version v0.147.1
def- Jun 24, 2025
38d0df8
Bump console version to 25.2.2
SangJunBak Jun 23, 2025
eaf8769
Remove www-authenticate header.
alex-hunt-materialize Jun 24, 2025
2a93fdc
add new sm version to persist-client cfg.rs
jubrad Jun 23, 2025
483806b
release: bump to version v0.147.2
def- Jun 24, 2025
a9d16d3
tests: Add dummy segment client (except in SLT)
def- Jun 24, 2025
8d6d9a5
environmentd: in telemetry.rs, print all rows in one-row assertion
aljoscha Jun 24, 2025
2bd6f10
cargo test: Disable test_only_dummy_segment_client
def- Jun 24, 2025
77fcf5d
release: bump to version v0.147.3
def- Jun 25, 2025
a19ea83
Redirect HTTP to HTTPS, rather than just return unauthorized.
alex-hunt-materialize Jun 25, 2025
d9900e4
allow basic auth for AuthenticatorKind::Password
alex-hunt-materialize Jun 26, 2025
26e56ac
Selectively add www-authenticate header to only some AuthErrors
alex-hunt-materialize Jun 26, 2025
392a49a
move profiling endpoints to a constant
alex-hunt-materialize Jul 1, 2025
344377d
Update sql-server to use EncryptionLevel::Prefer and tests to use TLS…
martykulma Jul 1, 2025
3bcede6
controller: replace `CreateTimely` epoch with a nonce
teskje Jun 30, 2025
695e349
controller: remove `ClusterStartupEpoch`
teskje Jun 30, 2025
b6fc22e
compute: use protocol nonce to identify connections
teskje Jun 30, 2025
8c237f9
Add support for configuring encryption for sql server (#32892)
martykulma Jul 8, 2025
40e7c88
Bump Console version to 25.2.3 to fix caching issue (#32893)
SangJunBak Jul 1, 2025
a017dff
Add a watcher timeout to orchestrator-kubernetes
alex-hunt-materialize Jul 7, 2025
3d71666
Update definitions.rs
jubrad Jul 8, 2025
4325f09
automatic sqllogic rewrites
jubrad Jul 11, 2025
85039cc
Adapt session.td to enable_reduce_reduction being off
def- Jul 11, 2025
54fffb3
release: bump to version v0.147.4
def- Jul 12, 2025
f03c8f4
tests: Recent nightly/RQ fixes
def- Jun 21, 2025
1e12f64
tests: Release Qualification fixes
def- Jul 12, 2025
86a397f
Add alias to current_catalog (#33204)
SangJunBak Aug 1, 2025
adbff15
fix whitespace
def- Aug 7, 2025
2663e69
release: bump to version v0.147.5
def- Aug 7, 2025
3c063b2
adapter: Refactor table function planning in preparation for WITH ORD…
ggevay May 17, 2025
fd138a5
Rewrite `WITH ORDINALITY`
ggevay May 17, 2025
24d3653
Fix FlatMapElimination's unnest code path
ggevay Aug 8, 2025
b71c33e
Fix parse order of WITH ORDINALITY and table alias
ggevay Aug 8, 2025
dbfa977
nicer debug format for upsert keys
petrosagg Aug 10, 2025
b6dc68e
repro
petrosagg Aug 10, 2025
e5bef07
upsert: remember provisional order when replacing a tombstone
petrosagg Aug 11, 2025
33d62e3
upsert: store the order only in provisional values
petrosagg Aug 11, 2025
e5c612b
adjust expected memory sizes
petrosagg Aug 11, 2025
6d870c4
Allow setting service account name in Materialize CR
alex-hunt-materialize Aug 11, 2025
89ac961
Make the environmentd_iam_role_arn arg not required.
alex-hunt-materialize Aug 11, 2025
bc86e34
Set a restrictive security context for orchestratord
alex-hunt-materialize Aug 12, 2025
cf2ed1d
Allow setting annotations/labels on pods/serviceaccount
alex-hunt-materialize Aug 14, 2025
e973c8e
add replica fqn annotation to replica statefulset
jubrad Aug 14, 2025
c6c253e
release: bump to version v0.147.6
def- Aug 22, 2025
4b63360
add migration to v74 protos to set login for mz_system
jubrad Aug 26, 2025
6006e98
[v0.147 only] cargo test: Remove gh_9540_repro that can't run on v0.1…
def- Aug 26, 2025
7c962cc
[v0.147 only] slt: Fix up distinct_arrangements.slt
def- Aug 26, 2025
103a345
helm-chart bump: Don't introduce line breaks
def- Jun 26, 2025
f416916
Add test to demonstrate bug with many table functions in ROWS FROM + …
ggevay Aug 18, 2025
2c19f9c
Fix ROWS FROM + WITH ORDINALITY
ggevay Aug 18, 2025
bd503f0
release: bump to version v0.147.7
def- Aug 26, 2025
417cd0a
Reapply drop PG connection when client is dropped
martykulma Sep 5, 2025
269e758
Make replication slot creation more consistent to avoid races
martykulma Sep 5, 2025
36513ec
Don't need to track version any longer
martykulma Sep 5, 2025
7445dc0
storage: enable multi_replica sources by default
aljoscha Sep 11, 2025
e039b58
Select labels passed to environmentd for clusterd services
alex-hunt-materialize Sep 2, 2025
40cd08b
release: bump to version v0.147.8
SangJunBak Sep 12, 2025
b5860d4
Remove yugabyte invariant check
SangJunBak Sep 12, 2025
74491f2
release: bump to version v0.147.9
SangJunBak Sep 12, 2025
8eb9532
Remove unused import in connections.rs
SangJunBak Sep 12, 2025
203fbfd
release: bump to version v0.147.10
SangJunBak Sep 12, 2025
bff6fb9
Fix clippy import warning for snapshot.rs
SangJunBak Sep 12, 2025
778a777
release: bump to version v0.147.11
SangJunBak Sep 12, 2025
414e03e
Fix clippy errors in upsert_continual_feedback
SangJunBak Sep 12, 2025
9637804
release: bump to version v0.147.12
SangJunBak Sep 12, 2025
5ca161a
ci+tests: Fixes for coverage
def- Aug 5, 2025
ade338c
Fix case where role modification can wipe out role password (#33602)
DAlperin Sep 17, 2025
b86ea8a
release: bump to version v0.147.13
SangJunBak Sep 17, 2025
b72cf91
Revert "ci+tests: Fixes for coverage"
SangJunBak Sep 17, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 39 additions & 0 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -115,3 +115,42 @@ updates:
update-types:
- minor
- patch
- package-ecosystem: maven
directory: /test/lang/java
schedule:
interval: daily
open-pull-requests-limit: 50
labels: [A-dependencies]
allow:
- dependency-name: "org.postgresql:postgresql"
- package-ecosystem: nuget
directory: /test/lang/csharp/csharp-npgsql.csproj
schedule:
interval: daily
open-pull-requests-limit: 50
labels: [A-dependencies]
allow:
- dependency-name: "npgsql"
- package-ecosystem: npm
directory: /test/lang/js
schedule:
interval: daily
open-pull-requests-limit: 50
labels: [A-dependencies]
allow:
- dependency-name: "pg"
- dependency-name: "@types/pg"
- package-ecosystem: pip
directory: /test/lang/python
schedule:
interval: daily
open-pull-requests-limit: 50
labels: [A-dependencies]
- package-ecosystem: bundler
directory: /test/lang/ruby
schedule:
interval: daily
open-pull-requests-limit: 50
labels: [A-dependencies]
allow:
- dependency-name: "pg"
33 changes: 24 additions & 9 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -341,7 +341,7 @@ reqwest-retry = { git = "https://github.com/MaterializeInc/reqwest-middleware.gi
# Need to upstream a few PRs related to test builders.
#
# Note: All changes in our fork of tiberius should be pushed to the `mz_changes` branch.
tiberius = { git = "https://github.com/MaterializeInc/tiberius", rev = "555076bc80087d21addb929948508c4e1a3c1fa7" }
tiberius = { git = "https://github.com/MaterializeInc/tiberius", rev="64ca594cc22ed67d072c2d0110455da50539e1cd" }

# BEGIN LINT CONFIG
# DO NOT EDIT. Automatically generated by bin/gen-lints.
Expand Down
2 changes: 1 addition & 1 deletion LICENSE
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ Business Source License 1.1

Licensor: Materialize, Inc.

Licensed Work: Materialize Version 20250620
Licensed Work: Materialize Version v0.147.13
The Licensed Work is © 2025 Materialize, Inc.

Additional Use Grant: Within a single installation of the Licensed Work,
Expand Down
2 changes: 1 addition & 1 deletion ci/plugins/cloudtest/hooks/pre-exit
Original file line number Diff line number Diff line change
Expand Up @@ -117,7 +117,7 @@ sudo journalctl --merge --since "$(cat step_start_timestamp)" > journalctl-merge
mapfile -t artifacts < <(printf "run.log\nkubectl-get-logs.log\nkubectl-get-logs-previous.log\nkubectl-get-events.log\nkubectl-get-all.log\nkubectl-describe-all.log\nkubectl-pods-with-nodes.log\nkubectl-get-events-kube-system.log\nkubectl-get-all-kube-system.log\nkubectl-describe-all-kube-system.log\njournalctl-merge.log\nkail-output.log\ntrufflehog.log\n"; find . -name 'junit_*.xml')
artifacts_str=$(IFS=";"; echo "${artifacts[*]}")

bin/ci-builder run stable trufflehog --no-update --no-verification --json --exclude-detectors=coda,dockerhub,box,npmtoken filesystem "${artifacts[@]}" | trufflehog_jq_filter_logs > trufflehog.log
bin/ci-builder run stable trufflehog --no-update --no-verification --json --exclude-detectors=coda,dockerhub,box,npmtoken,github filesystem "${artifacts[@]}" | trufflehog_jq_filter_logs > trufflehog.log

unset CI_EXTRA_ARGS # We don't want extra args for the annotation
# Continue even if ci-annotate-errors fails
Expand Down
2 changes: 1 addition & 1 deletion ci/plugins/mzcompose/hooks/pre-exit
Original file line number Diff line number Diff line change
Expand Up @@ -90,7 +90,7 @@ mapfile -t artifacts < <(printf "run.log\nservices.log\njournalctl-merge.log\nne
artifacts_str=$(IFS=";"; echo "${artifacts[*]}")

echo "--- Running trufflehog to scan artifacts for secrets"
bin/ci-builder run stable trufflehog --no-update --no-verification --json --exclude-detectors=coda,dockerhub,box,npmtoken filesystem "${artifacts[@]}" | trufflehog_jq_filter_logs > trufflehog.log
bin/ci-builder run stable trufflehog --no-update --no-verification --json --exclude-detectors=coda,dockerhub,box,npmtoken,github filesystem "${artifacts[@]}" | trufflehog_jq_filter_logs > trufflehog.log

echo "Uploading log artifacts"
unset CI_EXTRA_ARGS # We don't want extra args for the annotation
Expand Down
3 changes: 3 additions & 0 deletions ci/publish-helm-charts/pipeline.template.yml
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ steps:
composition: terraform
run: aws-temporary
args: ["--tag=$CI_MZ_VERSION", --no-run-testdrive-files]
ci-builder: stable

- id: terraform-gcp-tag
label: "Terraform + Helm Chart E2E on GCP (tagged)"
Expand All @@ -43,6 +44,7 @@ steps:
composition: terraform
run: gcp-temporary
args: ["--tag=$CI_MZ_VERSION", --no-run-testdrive-files]
ci-builder: stable

- id: terraform-azure-tag
label: "Terraform + Helm Chart E2E on Azure (tagged)"
Expand All @@ -57,6 +59,7 @@ steps:
composition: terraform
run: azure-temporary
args: ["--tag=$CI_MZ_VERSION", --no-run-testdrive-files]
ci-builder: stable

- wait: ~

Expand Down
2 changes: 1 addition & 1 deletion misc/helm-charts/operator/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,6 @@ name: materialize-operator
description: Materialize Kubernetes Operator Helm Chart
type: application
version: v25.2.0-beta.1
appVersion: v0.147.0-dev.0
appVersion: v0.147.13
icon: https://materialize.com/favicon.ico
home: https://materialize.com
8 changes: 4 additions & 4 deletions misc/helm-charts/operator/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Materialize Kubernetes Operator Helm Chart

![Version: v25.2.0-beta.1](https://img.shields.io/badge/Version-v25.2.0--beta.1-informational?style=flat-square) ![Type: application](https://img.shields.io/badge/Type-application-informational?style=flat-square) ![AppVersion: v0.147.0-dev.0](https://img.shields.io/badge/AppVersion-v0.147.0--dev.0-informational?style=flat-square)
![Version: v25.2.0-beta.1](https://img.shields.io/badge/Version-v25.2.0--beta.1-informational?style=flat-square) ![Type: application](https://img.shields.io/badge/Type-application-informational?style=flat-square) ![AppVersion: v0.147.13](https://img.shields.io/badge/AppVersion-v0.147.13-informational?style=flat-square)

Materialize Kubernetes Operator Helm Chart

Expand Down Expand Up @@ -151,7 +151,7 @@ The following table lists the configurable parameters of the Materialize operato
| `operator.clusters.defaultSizes.system` | | ``"25cc"`` |
| `operator.image.pullPolicy` | Policy for pulling the image: "IfNotPresent" avoids unnecessary re-pulling of images | ``"IfNotPresent"`` |
| `operator.image.repository` | The Docker repository for the operator image | ``"materialize/orchestratord"`` |
| `operator.image.tag` | The tag/version of the operator image to be used | ``"v0.146.0"`` |
| `operator.image.tag` | The tag/version of the operator image to be used | ``"v0.147.13"`` |
| `operator.nodeSelector` | Node selector to use for the operator pod | ``nil`` |
| `operator.resources.limits` | Resource limits for the operator's CPU and memory | ``{"memory":"512Mi"}`` |
| `operator.resources.requests` | Resources requested by the operator for CPU and memory | ``{"cpu":"100m","memory":"512Mi"}`` |
Expand All @@ -177,7 +177,7 @@ Specify each parameter using the `--set key=value[,key=value]` argument to `helm

```shell
helm install my-materialize-operator \
--set operator.image.tag=v0.147.0-dev.0 \
--set operator.image.tag=v0.147.13 \
materialize/materialize-operator
```

Expand Down Expand Up @@ -212,7 +212,7 @@ metadata:
name: 12345678-1234-1234-1234-123456789012
namespace: materialize-environment
spec:
environmentdImageRef: materialize/environmentd:v0.147.0-dev.0
environmentdImageRef: materialize/environmentd:v0.147.13
backendSecretName: materialize-backend
environmentdResourceRequirements:
limits:
Expand Down
15 changes: 14 additions & 1 deletion misc/helm-charts/operator/templates/deployment.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,10 @@ spec:
labels:
{{- include "materialize-operator.selectorLabels" . | nindent 8 }}
spec:
securityContext:
fsGroup: 999
runAsGroup: 999
runAsUser: 999
serviceAccountName: {{ include "materialize-operator.serviceAccountName" . }}
{{- if .Values.operator.nodeSelector }}
nodeSelector:
Expand Down Expand Up @@ -81,7 +85,7 @@ spec:
{{- if .Values.console.enabled }}
- "--create-console"
{{- end }}
- "--console-image-tag-default=25.2.1"
- "--console-image-tag-default=25.2.3"
{{- range $key, $value := .Values.console.imageTagMapOverride }}
- "--console-image-tag-map={{ $key }}={{ $value }}"
{{- end }}
Expand Down Expand Up @@ -222,3 +226,12 @@ spec:
{{- end }}
resources:
{{- toYaml .Values.operator.resources | nindent 10 }}
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
seccompProfile:
type: RuntimeDefault
2 changes: 1 addition & 1 deletion misc/helm-charts/operator/tests/deployment_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ tests:
of: Deployment
- equal:
path: spec.template.spec.containers[0].image
value: materialize/orchestratord:v0.146.0
value: materialize/orchestratord:v0.147.13
- equal:
path: spec.template.spec.containers[0].imagePullPolicy
value: IfNotPresent
Expand Down
2 changes: 1 addition & 1 deletion misc/helm-charts/operator/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ operator:
# -- The Docker repository for the operator image
repository: materialize/orchestratord
# -- The tag/version of the operator image to be used
tag: v0.146.0
tag: v0.147.13
# -- Policy for pulling the image: "IfNotPresent" avoids unnecessary re-pulling of images
pullPolicy: IfNotPresent

Expand Down
2 changes: 1 addition & 1 deletion misc/helm-charts/testing/materialize.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ metadata:
name: 12345678-1234-1234-1234-123456789012
namespace: materialize-environment
spec:
environmentdImageRef: materialize/environmentd:v0.147.0-dev.0
environmentdImageRef: materialize/environmentd:v0.147.13
backendSecretName: materialize-backend
authenticatorKind: None
#balancerdExternalCertificateSpec:
Expand Down
2 changes: 1 addition & 1 deletion misc/images/materialized-base/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@
# deployed to production, but the version needs to be bumped whenever features
# that the console depends upon are removed (to a version of the console that
# doesn't depend on those features).
FROM materialize/console:25.2.1 AS console
FROM materialize/console:25.2.3 AS console

MZFROM ubuntu-base

Expand Down
1 change: 1 addition & 0 deletions misc/python/materialize/cli/ci_annotate_errors.py
Original file line number Diff line number Diff line change
Expand Up @@ -189,6 +189,7 @@
PRODUCT_LIMITS_FIND_IGNORE_RE = re.compile(
rb"""
( Memory\ cgroup\ out\ of\ memory
| [Oo]ut\ [Oo]f\ [Mm]emory
| limits-materialized .* \| .* fatal\ runtime\ error:\ stack\ overflow
| limits-materialized .* \| .* has\ overflowed\ its\ stack
)
Expand Down
1 change: 1 addition & 0 deletions misc/python/materialize/cli/helm_chart_version_bump.py
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@ def main() -> int:

yaml = YAML()
yaml.preserve_quotes = True
yaml.width = 4096 # Don't introduce line breaks

mods = [
(
Expand Down
1 change: 1 addition & 0 deletions misc/python/materialize/cloudtest/k8s/environmentd.py
Original file line number Diff line number Diff line change
Expand Up @@ -363,6 +363,7 @@ def env_vars(self) -> list[V1EnvVar]:
)

env = [
V1EnvVar(name="MZ_TEST_ONLY_DUMMY_SEGMENT_CLIENT", value="true"),
V1EnvVar(name="MZ_SOFT_ASSERTIONS", value="1"),
V1EnvVar(name="MZ_POD_NAME", value_from=value_from),
V1EnvVar(name="AWS_REGION", value="minio"),
Expand Down
1 change: 1 addition & 0 deletions misc/python/materialize/mzcompose/services/materialized.py
Original file line number Diff line number Diff line change
Expand Up @@ -114,6 +114,7 @@ def __init__(

environment = [
"MZ_NO_TELEMETRY=1",
"MZ_TEST_ONLY_DUMMY_SEGMENT_CLIENT=true",
f"MZ_SOFT_ASSERTIONS={int(soft_assertions)}",
# The following settings can not be baked in the default image, as they
# are enabled for testing purposes only
Expand Down
5 changes: 4 additions & 1 deletion misc/python/materialize/mzcompose/services/sql_server.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,10 @@ def __init__(
# lowercase letters, base-10 digits and/or non-alphanumeric symbols.
sa_password: str = DEFAULT_SA_PASSWORD,
name: str = "sql-server",
image: str = "mcr.microsoft.com/mssql/server",
# 2017 mssql images core on OSx, 2019 is the earliest that has passed
image: str = "mcr.microsoft.com/mssql/server:2019-CU32-ubuntu-20.04",
environment_extra: list[str] = [],
volumes_extra: list[str] = [],
) -> None:
super().__init__(
name=name,
Expand All @@ -34,6 +36,7 @@ def __init__(
# See See https://github.com/microsoft/mssql-docker/issues/802 for current status
"platform": "linux/amd64",
"ports": [1433],
"volumes": volumes_extra,
"environment": [
"ACCEPT_EULA=Y",
"MSSQL_PID=Developer",
Expand Down
1 change: 1 addition & 0 deletions misc/python/materialize/sqlsmith.py
Original file line number Diff line number Diff line change
Expand Up @@ -135,4 +135,5 @@
"exceeded recursion limit of 2048",
"key cannot be null", # expected, see PR materialize#25941
"regexp_extract must specify at least one capture group",
"array_fill with arrays not yet supported",
]
2 changes: 2 additions & 0 deletions misc/shlib/shlib.bash
Original file line number Diff line number Diff line change
Expand Up @@ -297,6 +297,8 @@ trufflehog_jq_filter_logs() {
(.Raw | contains("jdbc:postgresql://127.0.0") | not) and
(.Raw | contains("jdbc:postgresql://cockroach") | not) and
(.Raw | contains("materialize:materialize") | not) and
(.Raw | contains("ExpirationReaper") | not) and
(.Raw | contains("[email protected]") | not) and
.Raw != "[REDACTED]"
)'
}
Loading