Cloud Engineer
Overview
Short Summary
The candidate is a highly experienced professional with over 20 years of expertise in data processing. He has a strong focus on cloud environments and has worked with various companies on migration projects. The candidate has implemented architectures using a variety of technology stacks, including databases, APIs, and message streams. He has also worked on data warehouse systems, ML/AI models, and enterprise business intelligence tooling. The candidate has a strong background in AWS, including experience with AWS Code Pipeline, Glue, Athena, Redshift, and more. He is skilled in languages such as Python, Java, and Scala, and has experience with big data technologies like Spark, Kafka, and Hadoop. The candidate is fluent in English and has intermediate proficiency in German.
Work Experience
October 2021 – November 2021: AWS Engineer (Company name removed)
- Worked on a new data architecture to help the company scale and register millions of new users globally.
- Installed Databricks in AWS as the new platform stack, including VPC, subnets, IAM, S3, and Databricks resources.
- Helped prepare a Kubernetes cluster template for regions without cloud options, using Kafka, Kafka Connect, Spark Operator, Jupyter Hub, Python, and Scala.
- Created a reusable module based on Databricks Terraform provider for infra-as-code CICD deployable reusable stack.
- Developed a Terragunt layer over Terraform modules to speed up the CICD process across multiple regions.
- Finished early due to a decision by the financial director.
- Reference: Nigel Spencer – Head of Data (Company name removed).
April 2020 – August 2021: AWS Architect(hybrid) with AI/ML (Company name removed)
- Designed and implemented a Data Platform and Kate digital assistant as part of a larger team.
- Defined company-wide reusable standards for AWS Landing Zone, CICD, VPC, and security services integration.
- Responsible for CICD rolling updates and evaluating deployment strategies.
- Designed and led development of a central streaming data hub and related processing pipelines.
- Designed RASA Chatbot NLP layers communication flows.
- Utilized AWS Data Migration Service for legacy database systems migration.
- Implemented rolling-updates CICD processes for business API and infra-as-code.
- Worked on data quality using AWS Deequ.
- Reference: Nigel Spencer – Head of Data (Company name removed).
July 2019 – March 2020: AWS Data Engineer/Architect(hybrid) with AIML (Company name removed)
- Designed and implemented the company's future strategic energy trading platform as a streaming data lake.
- Developed data pipelines using AWS Glue, Athena, S3, and messaging subsystems.
- Implemented data quality checks using AWS Deequ.
- Designed and developed ML recommendation engines.
- Worked on integrating Spark with Kubernetes.
- Migrated and extended on-premise RASA chatbots to AWS EKS cluster.
- Enabled end-to-end encryption for cloud services.
- Worked with the Data Science team to extend and industrialize ML models.
