Looking AWS Lambda Step Functions in Terraform for database migration
Project detail
Python 3 on AWS Lambda Step Functions workflow for exporting a database, loading into a clean database, scrubbing some fields (hashing certain fields to remove personally identifyable information, exporting again, and loading into a different server.
We’re open to workflow suggestions, but one requirement is that the scrubbing has to take place before the data is loaded to the new server, and the source database must remain untouched.
Deliverables
Terraform code for the necessary Python Lambda Step Functions with State Machine.
Export database
Load to temporary database
Scrub fields (probably MD5 hash, anything that cannot be un-hashed)
Export again
Load to database on different server
You can use your own sample database (which you must also provide for testing on our end) and scrub at least 2 fields of different data types in at least 3 different tables.