-
Notifications
You must be signed in to change notification settings - Fork 76
feat(): upgrade to pg18 and upgrade to latest others #296
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
semoal
wants to merge
9
commits into
fly-apps:master
Choose a base branch
from
semoal:semoal/upgrade-deps-pg18
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
9 commits
Select commit
Hold shift + click to select a range
1dea9b1
feat(): upgrade to pg18 and upgrade to latest others
semoal 42bc9ee
chore: remove pg 18 due repmgr compatbility
semoal 3c609c3
Revert "chore: remove pg 18 due repmgr compatbility"
semoal 1399d1c
feat: upgrade haproxy to latest
semoal db7ca12
chore: fix conflicts
semoal 204e01d
Merge branch 'master' into semoal/upgrade-deps-pg18
semoal d52c3f3
chore: upgrade minors
semoal 1272287
chore: revert back to 2.8 haproxy
semoal ee6264f
fix: align timescale dockerfile
semoal File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| ARG PG_VERSION=15.10 | ||
| ARG PG_VERSION=15.15 | ||
| ARG PG_MAJOR_VERSION=15 | ||
| ARG VERSION=custom | ||
|
|
||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| ARG PG_VERSION=15.10 | ||
| ARG PG_VERSION=15.15 | ||
| ARG PG_MAJOR_VERSION=15 | ||
| ARG VERSION=custom | ||
|
|
||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| ARG PG_VERSION=16.6 | ||
| ARG PG_VERSION=16.11 | ||
| ARG PG_MAJOR_VERSION=16 | ||
| ARG VERSION=custom | ||
|
|
||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| ARG PG_VERSION=16.6 | ||
| ARG PG_VERSION=16.11 | ||
| ARG PG_MAJOR_VERSION=16 | ||
| ARG VERSION=custom | ||
|
|
||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| ARG PG_VERSION=17.2 | ||
| ARG PG_VERSION=17.7 | ||
| ARG PG_MAJOR_VERSION=17 | ||
| ARG VERSION=custom | ||
|
|
||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| ARG PG_VERSION=17.2 | ||
| ARG PG_VERSION=17.7 | ||
| ARG PG_MAJOR_VERSION=17 | ||
| ARG VERSION=custom | ||
|
|
||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,98 @@ | ||
| ARG PG_VERSION=18.1 | ||
| ARG PG_MAJOR_VERSION=18 | ||
| ARG VERSION=custom | ||
|
|
||
| FROM golang:1.23 AS builder | ||
|
|
||
| WORKDIR /go/src/github.com/fly-apps/fly-postgres | ||
| COPY . . | ||
|
|
||
| RUN CGO_ENABLED=0 GOOS=linux \ | ||
| go build -v -o /fly/bin/event_handler ./cmd/event_handler && \ | ||
| go build -v -o /fly/bin/failover_validation ./cmd/failover_validation && \ | ||
| go build -v -o /fly/bin/pg_unregister ./cmd/pg_unregister && \ | ||
| go build -v -o /fly/bin/start_monitor ./cmd/monitor && \ | ||
| go build -v -o /fly/bin/start_admin_server ./cmd/admin_server && \ | ||
| go build -v -o /fly/bin/start ./cmd/start && \ | ||
| go build -v -o /fly/bin/flexctl ./cmd/flexctl | ||
|
|
||
|
|
||
| COPY ./bin/* /fly/bin/ | ||
|
|
||
| FROM ubuntu:24.04 | ||
|
|
||
| ARG VERSION | ||
| ARG PG_MAJOR_VERSION | ||
| ARG PG_VERSION | ||
| ARG POSTGIS_MAJOR=3 | ||
| ARG HAPROXY_VERSION=3.3 | ||
| ARG REPMGR_VERSION=5.5.0+debpgdg-3.pgdg24.04+1 | ||
|
|
||
| ENV PGDATA=/data/postgresql | ||
| ENV PGPASSFILE=/data/.pgpass | ||
| ENV AWS_SHARED_CREDENTIALS_FILE=/data/.aws/credentials | ||
| ENV PG_MAJOR_VERSION=${PG_MAJOR_VERSION} | ||
| ENV PATH="/usr/lib/postgresql/${PG_MAJOR_VERSION}/bin:$PATH" | ||
|
|
||
|
|
||
| LABEL fly.app_role=postgres_cluster | ||
| LABEL fly.version=${VERSION} | ||
| LABEL fly.pg-version=${PG_VERSION} | ||
| LABEL fly.pg-manager=repmgr | ||
|
|
||
| # make the "en_US.UTF-8" locale so postgres will be utf-8 enabled by default | ||
| RUN set -eux; \ | ||
| if [ -f /etc/dpkg/dpkg.cfg.d/docker ]; then \ | ||
| # if this file exists, we're likely in "debian:xxx-slim", and locales are thus being excluded so we need to remove that exclusion (since we need locales) | ||
| grep -q '/usr/share/locale' /etc/dpkg/dpkg.cfg.d/docker; \ | ||
| sed -ri '/\/usr\/share\/locale/d' /etc/dpkg/dpkg.cfg.d/docker; \ | ||
| ! grep -q '/usr/share/locale' /etc/dpkg/dpkg.cfg.d/docker; \ | ||
| fi; \ | ||
| apt-get update; apt-get install -y --no-install-recommends locales; rm -rf /var/lib/apt/lists/*; \ | ||
| echo 'en_US.UTF-8 UTF-8' >> /etc/locale.gen; \ | ||
| locale-gen; \ | ||
| locale -a | grep 'en_US.utf8' | ||
| ENV LANG en_US.utf8 | ||
|
|
||
| RUN apt-get update && apt-get install --no-install-recommends -y \ | ||
| ca-certificates iproute2 curl bash dnsutils vim socat procps ssh gnupg rsync barman-cli barman barman-cli-cloud python3-setuptools cron gosu \ | ||
| && apt autoremove -y && apt clean && \ | ||
| rm -rf /var/lib/apt/lists/* /tmp/* /var/tmp/* | ||
|
|
||
| # Install PostgreSQL | ||
| RUN curl -fsSL https://www.postgresql.org/media/keys/ACCC4CF8.asc | gpg --dearmor -o /usr/share/keyrings/postgresql-archive-keyring.gpg && \ | ||
| echo "deb [signed-by=/usr/share/keyrings/postgresql-archive-keyring.gpg] http://apt.postgresql.org/pub/repos/apt/ noble-pgdg main" > /etc/apt/sources.list.d/pgdg.list && \ | ||
| apt-get update && apt-get install --no-install-recommends -y \ | ||
| postgresql-${PG_MAJOR_VERSION} \ | ||
| postgresql-client-${PG_MAJOR_VERSION} \ | ||
| postgresql-contrib-${PG_MAJOR_VERSION} \ | ||
| postgresql-${PG_MAJOR_VERSION}-repmgr=${REPMGR_VERSION} | ||
|
|
||
| # PostGIS | ||
| RUN apt-get update && apt-get install --no-install-recommends -y \ | ||
| postgresql-${PG_MAJOR_VERSION}-postgis-$POSTGIS_MAJOR \ | ||
| postgresql-${PG_MAJOR_VERSION}-postgis-$POSTGIS_MAJOR-scripts | ||
|
|
||
| # Haproxy | ||
| RUN apt-get update && apt-get install --no-install-recommends -y software-properties-common && \ | ||
| add-apt-repository ppa:vbernat/haproxy-${HAPROXY_VERSION} && \ | ||
| apt-get update && apt-get install --no-install-recommends -y \ | ||
| haproxy=$HAPROXY_VERSION.\* \ | ||
| && apt autoremove -y && apt clean | ||
|
|
||
| # Copy Go binaries from the builder stage | ||
| COPY --from=builder /fly/bin/* /usr/local/bin | ||
|
|
||
| # Copy Postgres exporter | ||
| COPY --from=wrouesnel/postgres_exporter:latest /postgres_exporter /usr/local/bin/ | ||
semoal marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
|
||
| # Move pg_rewind into path. | ||
| RUN ln -s /usr/lib/postgresql/${PG_MAJOR_VERSION}/bin/pg_rewind /usr/bin/pg_rewind | ||
|
|
||
| ADD /config/* /fly/ | ||
| RUN mkdir -p /run/haproxy/ | ||
| RUN usermod -d /data postgres | ||
|
|
||
| EXPOSE 5432 | ||
|
|
||
| CMD ["start"] | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,104 @@ | ||
| ARG PG_VERSION=18.1 | ||
| ARG PG_MAJOR_VERSION=18 | ||
| ARG VERSION=custom | ||
|
|
||
| FROM golang:1.23 AS builder | ||
|
|
||
| WORKDIR /go/src/github.com/fly-apps/fly-postgres | ||
| COPY . . | ||
|
|
||
| RUN CGO_ENABLED=0 GOOS=linux \ | ||
| go build -v -o /fly/bin/event_handler ./cmd/event_handler && \ | ||
| go build -v -o /fly/bin/failover_validation ./cmd/failover_validation && \ | ||
| go build -v -o /fly/bin/pg_unregister ./cmd/pg_unregister && \ | ||
| go build -v -o /fly/bin/start_monitor ./cmd/monitor && \ | ||
| go build -v -o /fly/bin/start_admin_server ./cmd/admin_server && \ | ||
| go build -v -o /fly/bin/start ./cmd/start && \ | ||
| go build -v -o /fly/bin/flexctl ./cmd/flexctl | ||
|
|
||
|
|
||
| COPY ./bin/* /fly/bin/ | ||
|
|
||
| FROM ubuntu:24.04 | ||
|
|
||
| ARG VERSION | ||
| ARG PG_MAJOR_VERSION | ||
| ARG PG_VERSION | ||
| ARG POSTGIS_MAJOR=3 | ||
| ARG HAPROXY_VERSION=3.3 | ||
| ARG REPMGR_VERSION=5.5.0+debpgdg-3.pgdg24.04+1 | ||
|
|
||
| ENV PGDATA=/data/postgresql | ||
| ENV PGPASSFILE=/data/.pgpass | ||
| ENV AWS_SHARED_CREDENTIALS_FILE=/data/.aws/credentials | ||
| ENV PG_MAJOR_VERSION=${PG_MAJOR_VERSION} | ||
| ENV PATH="/usr/lib/postgresql/${PG_MAJOR_VERSION}/bin:$PATH" | ||
|
|
||
| LABEL fly.app_role=postgres_cluster | ||
| LABEL fly.version=${VERSION} | ||
| LABEL fly.pg-version=${PG_VERSION} | ||
| LABEL fly.pg-manager=repmgr | ||
|
|
||
| # make the "en_US.UTF-8" locale so postgres will be utf-8 enabled by default | ||
| RUN set -eux; \ | ||
| if [ -f /etc/dpkg/dpkg.cfg.d/docker ]; then \ | ||
| # if this file exists, we're likely in "debian:xxx-slim", and locales are thus being excluded so we need to remove that exclusion (since we need locales) | ||
| grep -q '/usr/share/locale' /etc/dpkg/dpkg.cfg.d/docker; \ | ||
| sed -ri '/\/usr\/share\/locale/d' /etc/dpkg/dpkg.cfg.d/docker; \ | ||
| ! grep -q '/usr/share/locale' /etc/dpkg/dpkg.cfg.d/docker; \ | ||
| fi; \ | ||
| apt-get update; apt-get install -y --no-install-recommends locales; rm -rf /var/lib/apt/lists/*; \ | ||
| echo 'en_US.UTF-8 UTF-8' >> /etc/locale.gen; \ | ||
| locale-gen; \ | ||
| locale -a | grep 'en_US.utf8' | ||
| ENV LANG en_US.utf8 | ||
|
|
||
| RUN apt-get update && apt-get install --no-install-recommends -y \ | ||
| ca-certificates iproute2 curl bash dnsutils vim socat procps ssh gnupg rsync barman-cli barman barman-cli-cloud python3-setuptools cron gosu \ | ||
| && apt autoremove -y && apt clean && \ | ||
| rm -rf /var/lib/apt/lists/* /tmp/* /var/tmp/* | ||
|
|
||
| # Install PostgreSQL | ||
| RUN curl -fsSL https://www.postgresql.org/media/keys/ACCC4CF8.asc | gpg --dearmor -o /usr/share/keyrings/postgresql-archive-keyring.gpg && \ | ||
| echo "deb [signed-by=/usr/share/keyrings/postgresql-archive-keyring.gpg] http://apt.postgresql.org/pub/repos/apt/ noble-pgdg main" > /etc/apt/sources.list.d/pgdg.list && \ | ||
| apt-get update && apt-get install --no-install-recommends -y \ | ||
| postgresql-${PG_MAJOR_VERSION} \ | ||
| postgresql-client-${PG_MAJOR_VERSION} \ | ||
| postgresql-contrib-${PG_MAJOR_VERSION} \ | ||
| postgresql-${PG_MAJOR_VERSION}-repmgr=${REPMGR_VERSION} | ||
|
|
||
| # TimescaleDB and PostGIS | ||
| RUN echo "deb https://packagecloud.io/timescale/timescaledb/ubuntu/ jammy main" > /etc/apt/sources.list.d/timescaledb.list \ | ||
| && curl -L https://packagecloud.io/timescale/timescaledb/gpgkey | apt-key add - | ||
semoal marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
|
||
| RUN apt-get update && apt-get install --no-install-recommends -y \ | ||
| postgresql-$PG_MAJOR_VERSION-postgis-$POSTGIS_MAJOR \ | ||
| postgresql-$PG_MAJOR_VERSION-postgis-$POSTGIS_MAJOR-scripts \ | ||
| timescaledb-2-postgresql-$PG_MAJOR_VERSION \ | ||
| && apt autoremove -y && apt clean | ||
|
|
||
| # Haproxy | ||
| RUN apt-get update && apt-get install --no-install-recommends -y software-properties-common && \ | ||
| add-apt-repository ppa:vbernat/haproxy-${HAPROXY_VERSION} && \ | ||
| apt-get update && apt-get install --no-install-recommends -y \ | ||
| haproxy=$HAPROXY_VERSION.\* \ | ||
| && apt autoremove -y && apt clean | ||
|
|
||
| # Copy Go binaries from the builder stage | ||
| COPY --from=builder /fly/bin/* /usr/local/bin | ||
|
|
||
| # Copy Postgres exporter | ||
| COPY --from=wrouesnel/postgres_exporter:latest /postgres_exporter /usr/local/bin/ | ||
semoal marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
|
||
| # Move pg_rewind into path. | ||
| RUN ln -s /usr/lib/postgresql/${PG_MAJOR_VERSION}/bin/pg_rewind /usr/bin/pg_rewind | ||
|
|
||
| ADD /config/* /fly/ | ||
| RUN mkdir -p /run/haproxy/ | ||
| RUN usermod -d /data postgres | ||
|
|
||
| ENV TIMESCALEDB_ENABLED=true | ||
|
|
||
| EXPOSE 5432 | ||
|
|
||
| CMD ["start"] | ||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.