AWS Architect & Data Engineer

Seit Dezember 2020 ist der Kandidat als Principal Engineer in einer vielschichtigen Position tätig, die Verantwortlichkeiten auf Führungsebene, praktische Ingenieursarbeit, architektonische Führung und organisatorischen Einfluss umfasst. Zu den wichtigsten Aufgaben gehören die Überprüfung von Architekturentwürfen, die Leitung von POCs für neue Technologien und die Mitwirkung an der Entwicklung von Best Practices und Standards für Data Engineering. Zu den bemerkenswerten Leistungen gehören die alleinige Verantwortung für die Entwicklung und Implementierung von Apache Spark und AWS-basiertem Backend für ein Data Fabric-Projekt, die Entwicklung von Infrastruktur- und Automatisierungs-POCs für Data Mesh unter Verwendung von AWS-Diensten, die Leitung der Migration von Hadoop vor Ort auf die AWS Outpost-Umgebung und die rasche Behebung der kritischen Log4j JNDI-Schwachstelle CVE-2021-44228. Darüber hinaus spielte der Kandidat eine entscheidende Rolle bei der dringenden Ersetzung veralteter Hortonworks-Cluster durch AWS EMR, bei der Behebung größerer Vorfälle auf kritischen Datenplattformen und bei der effektiven Verwaltung der Erwartungen von Interessengruppen durch Engagement und Wissensaustausch.

Principal Engineer

(12/2020 - current)

​

Roles: Executive-level Role, Hands-on Engineer, Architect, Organisation-wide Influencer

​

Responsibilities:

• Review & assess architecture designs and solutions as part of the Data Engineering Architecture Forum
• Help POC and design novel ideas and previously unexplored technologies
• Help the wider technology community & leadership in the bank develop best practices and architectural standards for Data Engineering and other areas Achievements:
• I was solely responsible for designing & implementing the Apache Spark and AWS based back-end for implementation of a data fabric. I continue being the architect responsible for the project.
• Developed the infrastructure and automation POC for future vision of Data Mesh using AWS services (Lake Formation, cross account access, EMR, RedShift, Athena and others).
• Involved in the currently on-going migration from on-premise Hadoop to a new AWS Outpost environ- ment (on-prem hosted version of various AWS services).
• Led the effort to remediate the Log4j JNDI critical vulnerability CVE-2021-44228. Within 36 hours from the announcement, the team and I automated a way to remediate over 3,500 occurrences of this vulnerability.
• Designed and led the implementation of an architecture to urgently replace an outdated Hortonworks clusters to AWS EMR (in the region). This 6 months effort meant various changes and customisations to EMR itself. We managed to meet the deadline and deploy this infrastructure in UAT with full automation and monitoring.
• Played an integral role when resolving various major incidents when it comes to critical data platforms.
• Managed both senior business and CTO expectations and engaged various stakeholders, organised andpresented at various knowledge sharing sessions.

​

Big Data Team Lead & Architect

(11/2018 - 12/2020)

​

Roles: Senior Big Data Engineer, Big Data Architect, Line Manager

​

Responsibilities:

• Managing the Big Data R&D team (approx 20 engineers based in the Prague technology center)
• Helping design and shape projects to enable better use of modern technologies for use in Data Engineering
• Up-skilling and transitioning into a more architectural role

​

Achievements:

• Actively contributed to the development of various open source projects.
• Presented the Big Data R&D team and our projects at numerous international conferences
• Provided guidance and architectural designs to the Big Data R&D team
• Led the initial authoring of the Big Data training material now available as one of the materials delivered through official training programmes
• Designed the initial architecture for the Data Engineering platforms on the cloud and startedvarious projects to enable its implementation

​

Big Data Engineer

(08/2015 - 10/2018)

​

Roles: Developer and Mentor, later Lead Big Data Engineer, Line Manager

​

Responsibilities:

• Creating best practices in Big Data development across the corporate and investment banking
• Driving cluster and technology requirements and development of mission critical
• Architecting the Big Data Engineering solutions, platforms and visions

​

Achievements:

• Independently designed, developed and productionalised several Big Data applications and processes.
• Designed and implemented a Hadoop-based analytics environent from its open source components, whichstill being used for data science projects today.
• Built the Big Data R&D team in Prague from scratch aimed towards filling the missing gaps in the bigdata ecosystem from the perspective of highly regulated industries.
• Authored the initial ideas behind Big Data R&D projects such as Spline, Abris, Enceladus.
• Led the initiative behind open sourcing Spline and subsequently the rest of the team’s R&D applications.
• Actively contributed to Enceladus and various other open source projects.
• Drove the team towards writing articles, papers and presenting ABSA and our R&D projects at inter-national conferences and summits.