Skip to content

Commit 629c32c

Browse files
committed
trigger with docker
1 parent 04b10eb commit 629c32c

36 files changed

Lines changed: 1061 additions & 3250 deletions

docs/infrastructure.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,6 @@ graph LR;
5252
dataformTrigger --> cloud_run_logs
5353
dataform_repo_workflow --> dataform_logs
5454
bq_jobs --> bq_logs
55-
5655
```
5756

5857
## Triggering pipelines

infra/bigquery-export/.dockerignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,3 +7,4 @@ npm-debug.log
77
coverage
88
*.md
99
.DS_Store
10+
cloudbuild.yaml

infra/bigquery-export/Dockerfile

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,14 @@
11
# checkov:skip=CKV_DOCKER_3:Ensure that a user for the container has been created
2-
FROM node:current-slim
2+
FROM node:22-slim
33

4-
WORKDIR /usr/src/app
4+
# Set the working directory
5+
WORKDIR /app
56

6-
# Copy package files first for better caching
7+
# Copy package files first for better layer caching
78
COPY package*.json ./
89

9-
# Install dependencies
10-
RUN npm ci --only=production --quiet --no-fund --no-audit
10+
# Install dependencies (this layer will be cached unless package files change)
11+
RUN npm ci --only=production --quiet --no-fund --no-audit && npm cache clean --force
1112

1213
# Copy source code
1314
COPY . .

infra/bigquery-export/package.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44
"main": "index.js",
55
"scripts": {
66
"start": "node index.js",
7-
"build": "gcloud builds submit"
7+
"build": "docker build -t bigquery-export ."
88
},
99
"type": "module",
1010
"dependencies": {

infra/bigquery_export_spark/Dockerfile

Lines changed: 0 additions & 37 deletions
This file was deleted.

infra/bigquery_export_spark/requirements.txt

Lines changed: 0 additions & 2 deletions
This file was deleted.

infra/bigquery_export_spark/src/firestore.py

Lines changed: 0 additions & 158 deletions
This file was deleted.

infra/dataform-export/index.js

Lines changed: 0 additions & 72 deletions
This file was deleted.

0 commit comments

Comments
 (0)