AWS Architect & Data Engineer

Jako hlavní inženýr od prosince 2020 zastával kandidát mnohostrannou funkci zahrnující odpovědnost na výkonné úrovni, praktické inženýrství, vedení architektury a organizační vliv. Mezi klíčové odpovědnosti patří přezkoumávání návrhů architektury, vedení projektů POC pro nové technologie a přispívání k rozvoji osvědčených postupů a standardů pro datové inženýrství. Mezi významné úspěchy patří výhradní odpovědnost za návrh a implementaci Apache Spark a backendu na bázi AWS pro projekt datové struktury, vývoj infrastruktury a automatizace POC pro Data Mesh s využitím služeb AWS, vedení migrace z lokálního prostředí Hadoop do prostředí AWS Outpost a rychlé odstranění kritické zranitelnosti Log4j JNDI CVE-2021-44228. Kromě toho kandidát sehrál klíčovou roli při naléhavém nahrazení zastaralých clusterů Hortonworks systémem AWS EMR, při řešení závažných incidentů na kritických datových platformách a při efektivním řízení očekávání zúčastněných stran prostřednictvím zapojení a zasedání pro sdílení znalostí.

Principal Engineer

(12/2020 - current)

​

Roles: Executive-level Role, Hands-on Engineer, Architect, Organisation-wide Influencer

​

Responsibilities:

• Review & assess architecture designs and solutions as part of the Data Engineering Architecture Forum
• Help POC and design novel ideas and previously unexplored technologies
• Help the wider technology community & leadership in the bank develop best practices and architectural standards for Data Engineering and other areas Achievements:
• I was solely responsible for designing & implementing the Apache Spark and AWS based back-end for implementation of a data fabric. I continue being the architect responsible for the project.
• Developed the infrastructure and automation POC for future vision of Data Mesh using AWS services (Lake Formation, cross account access, EMR, RedShift, Athena and others).
• Involved in the currently on-going migration from on-premise Hadoop to a new AWS Outpost environ- ment (on-prem hosted version of various AWS services).
• Led the effort to remediate the Log4j JNDI critical vulnerability CVE-2021-44228. Within 36 hours from the announcement, the team and I automated a way to remediate over 3,500 occurrences of this vulnerability.
• Designed and led the implementation of an architecture to urgently replace an outdated Hortonworks clusters to AWS EMR (in the region). This 6 months effort meant various changes and customisations to EMR itself. We managed to meet the deadline and deploy this infrastructure in UAT with full automation and monitoring.
• Played an integral role when resolving various major incidents when it comes to critical data platforms.
• Managed both senior business and CTO expectations and engaged various stakeholders, organised andpresented at various knowledge sharing sessions.

​

Big Data Team Lead & Architect

(11/2018 - 12/2020)

​

Roles: Senior Big Data Engineer, Big Data Architect, Line Manager

​

Responsibilities:

• Managing the Big Data R&D team (approx 20 engineers based in the Prague technology center)
• Helping design and shape projects to enable better use of modern technologies for use in Data Engineering
• Up-skilling and transitioning into a more architectural role

​

Achievements:

• Actively contributed to the development of various open source projects.
• Presented the Big Data R&D team and our projects at numerous international conferences
• Provided guidance and architectural designs to the Big Data R&D team
• Led the initial authoring of the Big Data training material now available as one of the materials delivered through official training programmes
• Designed the initial architecture for the Data Engineering platforms on the cloud and startedvarious projects to enable its implementation

​

Big Data Engineer

(08/2015 - 10/2018)

​

Roles: Developer and Mentor, later Lead Big Data Engineer, Line Manager

​

Responsibilities:

• Creating best practices in Big Data development across the corporate and investment banking
• Driving cluster and technology requirements and development of mission critical
• Architecting the Big Data Engineering solutions, platforms and visions

​

Achievements:

• Independently designed, developed and productionalised several Big Data applications and processes.
• Designed and implemented a Hadoop-based analytics environent from its open source components, whichstill being used for data science projects today.
• Built the Big Data R&D team in Prague from scratch aimed towards filling the missing gaps in the bigdata ecosystem from the perspective of highly regulated industries.
• Authored the initial ideas behind Big Data R&D projects such as Spline, Abris, Enceladus.
• Led the initiative behind open sourcing Spline and subsequently the rest of the team’s R&D applications.
• Actively contributed to Enceladus and various other open source projects.
• Drove the team towards writing articles, papers and presenting ABSA and our R&D projects at inter-national conferences and summits.