CI/CD examples
GitHub Actions, with the license key wired in as a pipeline secret.
- name: Generate fixtures
env:
DATA_MAESTRO_LICENSE_KEY: ${{ secrets.DATA_MAESTRO_LICENSE_KEY }}
run: |
curl -L -o data-maestro-cli \
https://github.com/rschalch/data-maestro-releases/releases/latest/download/data-maestro-cli-macos-arm64
chmod +x data-maestro-cli
./data-maestro-cli generate-schema \
--output fixtures/users.csv \
schema/users.json csv 50000
Seed a test database and anonymize an incoming data dump before it touches a staging environment, in the same job:
- name: Seed staging DB + scrub incoming PII
env:
DATA_MAESTRO_LICENSE_KEY: ${{ secrets.DATA_MAESTRO_LICENSE_KEY }}
run: |
./data-maestro-cli push-db --db-type postgres --host $STAGING_HOST \
--database staging --user ci --password-env DB_PASSWORD \
--table users schema/users.json 5000
./data-maestro-cli anonymize-file incoming/customers.csv \
--output-mode overwrite --seed $GITHUB_RUN_ID
See Generation and Database commands for every flag used above.