BBER Redshift DataBase
Upgrade the database system for a New Mexico economic research group.
Migrating the current Microsoft Access DataBase (DB) at the Bureau of Business and Economic Research (BBER) at the University of New Mexico (UNM) to a SQL based database.
Redshift is a columnar DB so the required analytical processing will be much faster than the standard row-based storage used in SQL DBs. The benefits of Amazon Web Services (AWS) Redshift DB, like the ease of deployment, low price, upgradability, and availability made us choose it as a replacement. AWS Redshift is a very fast peta-byte data warehouse solution which means, we don't have to worry about future expansions.
This project is still in progress with almost 75% of the migration already done. We created a custom extract, transform and load (ETL) tool to transform the current tables in Access DB to a SQL-structured data that have:
Tables in 3rd Normal Form - 3NF (no duplicated data)
This data is then uploaded to AWS Redshift tables directly using the ETL tool, and the administrator can verify/text the data.