Cloud Engineer
Prehľad
Krátke zhrnutie
Uchádzač je skúsený odborník s viac ako 20-ročnou praxou v oblasti spracovania údajov. Výrazne sa zameriava na cloudové prostredia a spolupracoval s rôznymi spoločnosťami na projektoch migrácie. Kandidát implementoval architektúry s využitím rôznych technologických stackov vrátane databáz, API a tokov správ. Pracoval tiež na systémoch dátových skladov, modeloch ML/AI a nástrojoch pre podnikovú inteligenciu. Kandidát má silné zázemie v systéme AWS vrátane skúseností s AWS Code Pipeline, Glue, Athena, Redshift a ďalšími. Ovláda jazyky ako Python, Java a Scala a má skúsenosti s technológiami na spracovanie veľkých objemov dát, ako sú Spark, Kafka a Hadoop. Kandidát hovorí plynule anglicky a má stredne pokročilú znalosť nemčiny.
Pracovné skúsenosti
October 2021 – November 2021: AWS Engineer (Company name removed)
- Worked on a new data architecture to help the company scale and register millions of new users globally.
- Installed Databricks in AWS as the new platform stack, including VPC, subnets, IAM, S3, and Databricks resources.
- Helped prepare a Kubernetes cluster template for regions without cloud options, using Kafka, Kafka Connect, Spark Operator, Jupyter Hub, Python, and Scala.
- Created a reusable module based on Databricks Terraform provider for infra-as-code CICD deployable reusable stack.
- Developed a Terragunt layer over Terraform modules to speed up the CICD process across multiple regions.
- Finished early due to a decision by the financial director.
- Reference: Nigel Spencer – Head of Data (Company name removed).
April 2020 – August 2021: AWS Architect(hybrid) with AI/ML (Company name removed)
- Designed and implemented a Data Platform and Kate digital assistant as part of a larger team.
- Defined company-wide reusable standards for AWS Landing Zone, CICD, VPC, and security services integration.
- Responsible for CICD rolling updates and evaluating deployment strategies.
- Designed and led development of a central streaming data hub and related processing pipelines.
- Designed RASA Chatbot NLP layers communication flows.
- Utilized AWS Data Migration Service for legacy database systems migration.
- Implemented rolling-updates CICD processes for business API and infra-as-code.
- Worked on data quality using AWS Deequ.
- Reference: Nigel Spencer – Head of Data (Company name removed).
July 2019 – March 2020: AWS Data Engineer/Architect(hybrid) with AIML (Company name removed)
- Designed and implemented the company's future strategic energy trading platform as a streaming data lake.
- Developed data pipelines using AWS Glue, Athena, S3, and messaging subsystems.
- Implemented data quality checks using AWS Deequ.
- Designed and developed ML recommendation engines.
- Worked on integrating Spark with Kubernetes.
- Migrated and extended on-premise RASA chatbots to AWS EKS cluster.
- Enabled end-to-end encryption for cloud services.
- Worked with the Data Science team to extend and industrialize ML models.
