Progress update: 17 October 2022
STAGE ONE
A. Infrastructure review and optimisation of framework architecture and management processes
Atlas upgrade:
- Reviewed known requirements for upgrade path and identified initial candidates for upgrade
- Fixed occurrence logging in test environment
- Ran end to end data processing in test environment using small sample dataset
- Established baseline test results for data processing prior to upgrade of data processing
Azure migration:
- Completed migration of Logger to AWS
B. Extract the NBN Atlas customised changes from the Atlas of Living Australia (ALA) platform into a separate layer
C. Reformat all dataset files still in the NBN exchange format as Darwin Core
384 datasets (5,749,291 records) from 72 data providers remain to be checked.