AWS Architect & Data Engineer
Overview
Short Summary
As a Principal Engineer since December 2020, the candidate has held a multifaceted role encompassing executive-level responsibilities, hands-on engineering, architectural leadership, and organizational influence. Key responsibilities include reviewing architecture designs, spearheading POCs for new technologies, and contributing to the development of best practices and standards for Data Engineering. Notable achievements include sole responsibility for designing and implementing Apache Spark and AWS-based backend for a data fabric project, developing infrastructure and automation POC for Data Mesh using AWS services, leading the migration from on-premise Hadoop to AWS Outpost environment, and swiftly remediating the Log4j JNDI critical vulnerability CVE-2021-44228. Additionally, the candidate played a pivotal role in urgently replacing outdated Hortonworks clusters with AWS EMR, resolving major incidents on critical data platforms, and effectively managing stakeholder expectations through engagement and knowledge sharing sessions.
Work Experience
Principal Engineer
(12/2020 - current)
Roles: Executive-level Role, Hands-on Engineer, Architect, Organisation-wide Influencer
Responsibilities:
- Review & assess architecture designs and solutions as part of the Data Engineering Architecture Forum
- Help POC and design novel ideas and previously unexplored technologies
- Help the wider technology community & leadership in the bank develop best practices and architectural standards for Data Engineering and other areas Achievements:
- I was solely responsible for designing & implementing the Apache Spark and AWS based back-end for implementation of a data fabric. I continue being the architect responsible for the project.
- Developed the infrastructure and automation POC for future vision of Data Mesh using AWS services (Lake Formation, cross account access, EMR, RedShift, Athena and others).
- Involved in the currently on-going migration from on-premise Hadoop to a new AWS Outpost environ- ment (on-prem hosted version of various AWS services).
- Led the effort to remediate the Log4j JNDI critical vulnerability CVE-2021-44228. Within 36 hours from the announcement, the team and I automated a way to remediate over 3,500 occurrences of this vulnerability.
- Designed and led the implementation of an architecture to urgently replace an outdated Hortonworks clusters to AWS EMR (in the region). This 6 months effort meant various changes and customisations to EMR itself. We managed to meet the deadline and deploy this infrastructure in UAT with full automation and monitoring.
- Played an integral role when resolving various major incidents when it comes to critical data platforms.
- Managed both senior business and CTO expectations and engaged various stakeholders, organised andpresented at various knowledge sharing sessions.
Big Data Team Lead & Architect
(11/2018 - 12/2020)
Roles: Senior Big Data Engineer, Big Data Architect, Line Manager
Responsibilities:
- Managing the Big Data R&D team (approx 20 engineers based in the Prague technology center)
- Helping design and shape projects to enable better use of modern technologies for use in Data Engineering
- Up-skilling and transitioning into a more architectural role
Achievements:
- Actively contributed to the development of various open source projects.
- Presented the Big Data R&D team and our projects at numerous international conferences
- Provided guidance and architectural designs to the Big Data R&D team
- Led the initial authoring of the Big Data training material now available as one of the materials delivered through official training programmes
- Designed the initial architecture for the Data Engineering platforms on the cloud and startedvarious projects to enable its implementation
Big Data Engineer
(08/2015 - 10/2018)
Roles: Developer and Mentor, later Lead Big Data Engineer, Line Manager
Responsibilities:
- Creating best practices in Big Data development across the corporate and investment banking
- Driving cluster and technology requirements and development of mission critical
- Architecting the Big Data Engineering solutions, platforms and visions
Achievements:
- Independently designed, developed and productionalised several Big Data applications and processes.
- Designed and implemented a Hadoop-based analytics environent from its open source components, whichstill being used for data science projects today.
- Built the Big Data R&D team in Prague from scratch aimed towards filling the missing gaps in the bigdata ecosystem from the perspective of highly regulated industries.
- Authored the initial ideas behind Big Data R&D projects such as Spline, Abris, Enceladus.
- Led the initiative behind open sourcing Spline and subsequently the rest of the team’s R&D applications.
- Actively contributed to Enceladus and various other open source projects.
- Drove the team towards writing articles, papers and presenting ABSA and our R&D projects at inter-national conferences and summits.
| Level | SENIOR |