BBER Redshift DataBase

Upgrade the database system for a New Mexico economic research group.

Project Description

Migrating the current Microsoft Access DataBase (DB) at the Bureau of Business and Economic Research (BBER) at the University of New Mexico (UNM) to a SQL based database.

Redshift DB

Redshift is a columnar DB so the required analytical processing will be much faster than the standard row-based storage used in SQL DBs. The benefits of Amazon Web Services (AWS) Redshift DB, like the ease of deployment, low price, upgradability, and availability made us choose it as a replacement. AWS Redshift is a very fast peta-byte data warehouse solution which means, we don't have to worry about future expansions.

Project Status

This project is still in progress with almost 75% of the migration already done. We created a custom extract, transform and load (ETL) tool to transform the current tables in Access DB to a SQL-structured data that have:

  • Primary keys

  • Foreign keys

  • Join-tables

  • Tables in 3rd Normal Form - 3NF (no duplicated data)

This data is then uploaded to AWS Redshift tables directly using the ETL tool, and the administrator can verify/text the data.