Web app.
Project detail
Outcome expected:
Build UI which should allow to select redshift schema (UI might have additional restrictions which schemas can be selected )which will be copied to S3 bucket in other environment.
(here we have 2 redshift databases which are in two different env. (for Ex: A1 & A2). which doesn’t have direct access to each other. So we should have to copy the schemas from A1 Redshift to A1 s3 bucket and A1 s3 bucket to A2 s3 bucket and then A2 s3 bucket to A2 redshift databases.
By click of button we would to be able to initiate copy operation
Every operation invocation must create audit record containing who performed operation when it happened, complete details of copy source and approval comments.
Unload and Copy operation progress should be viewable vi UI, and unload and copy operation log must be available for viewing and troubleshooting
Development tips:
Build UI for Schema Selection, Audit Log viewing and Copy Operation progress
API Backend to support UI and interact with AWS and Redshift
Unload of A1 schema to A2 S3
Copy of A2 S3 parquet to A2 redshift (probably lambda function)
Deployment must be automated both in A1 and A2, there might be requirement to configure one time deployment configurations e.g. IAM role in A1 which has permission to put data into A2 S3 bucket