Senior Engineer - Backend
Identity and authentication platform • May 2022 - Present
- Re-built and deployed application to run in new geographical region to better serve U.S. customers
- Templated application to make it truly multi-region, paving way for deployment in 3 additional global regions
- Oversaw build and releases of SDKs used to integrate with platform
- Initiated and led design and development of Enterprise authentication features (SAML/EntraID), greatly improving security posture for customers
- Developed audit logging capability within product to increase observability of security-sensitive actions for customers
- Led design and development of entire billing platform enabling customers to easily bill their own customers without writing a single line of code
- Contributed across stack to improve/rebuild internal analytics, data pipelines and deployment pipelines
Principal Engineer - Cloud, Data and APIs
Analytics technology company • January 2021 - April 2022
- Owned tech strategy and evaluated which technology to use for implementing products, platforms and other initiatives
- Participated in overall planning of work for technical teams and collaborated with Product Managers, providing advice and guidance on feasibility of requested features
- Mentored other engineers and continually sought to improve engineering tooling, standards and practices across all technical streams
- Designed and built features/sub-features serving as references or bootstrap implementations for upcoming features
- Drove refactoring exercises to improve architecture and implementation of existing features
- Developed and implemented tools and practices to maintain expected functionality, performance and scalability of existing applications
Senior Software Engineer - Data Platform and Services
Financial services company • January 2020 - December 2020
- Redesigned and developed bulk data hydration pipeline that halved time to move and transform 10s of millions of records between systems
- Designed and developed data pipelines and dashboards to compare functional performance of legacy customer matching system and new customer record linkage system
- Contributed to development of near real-time customer record linkage system ensuring no duplicate customer records across organisation
- Designed and developed several data pipelines and data models to support personalised rewards programme for credit card customers
- Designed and developed data pipelines that greatly improved timeliness of email communications to personal loan customers
Technologies: Python, Snowflake, Kafka Connect, AWS ElasticSearch, Apache Airflow, AWS ECS, Kafka (MSK)
DevOps Engineer
Cloud and DevOps consultancy • April 2018 - December 2019
- Created and maintained continuous deployment pipelines built on Jenkins and Octopus Deploy for Sitecore CMS implementation
- Developed proof of concept to validate use of Kubernetes as platform to run applications using AWS EKS and AWS RDS
- Worked on proof of concept to validate use of AWS Data Services (Glue, Athena, Redshift and RDS) to replace on-premise data warehouses
- Developed CI/CD pipeline to enable R-Shiny applications to be quickly and efficiently deployed to production Kubernetes environment
- Designed and implemented solution gathering AWS security logs in real-time from multiple AWS accounts and streaming through Kinesis into centralised log aggregation product
- Implemented NoSQL data store to store meta-data about all existing AWS accounts and provided publishing interface for account creation process
Senior Consultant
Global IT consulting firm • May 2011 - March 2018
- Designed and built automated scripts using PowerShell to deploy ETL jobs to SQL Server Integration Services and migrate financial data using agile processes
- Wrote custom wrappers around Pivotal's Trilogy database testing tool for integration into Jenkins pipelines to automatically test transformed data in Oracle database
- Architected forward-thinking design to change flat relational database into unstructured graph data store capable of consuming and storing data from variety of sources
- Contributed to vision and direction of converting geocoded national address file (GNAF) into product for aggregating and matching variety of datasets
- Responsible for design of data interfaces during implementation of large collection system
Consultant
Technology consulting firm • October 2007 - April 2011
- Designed and implemented data migration processes and solutions for live migration of large data mart, including metadata migration
- Designed medium-scale end-to-end data extraction and transformation middleware solution
- Effectively managed inter-team communications for provisioning, design and development of interfaces for 15 source data providers