Cloud Engineer
Přehled
Krátké shrnutí
Kandidát je zkušený odborník s více než 20 lety zkušeností v oblasti zpracování dat. Zaměřuje se na cloudová prostředí a spolupracoval s různými společnostmi na projektech migrace. Kandidát implementoval architektury využívající různé technologické zásobníky, včetně databází, rozhraní API a toků zpráv. Pracoval také na systémech datových skladů, modelech ML/AI a nástrojích podnikové business intelligence. Kandidát má silné zázemí v systému AWS, včetně zkušeností s AWS Code Pipeline, Glue, Athena, Redshift a dalšími. Ovládá jazyky jako Python, Java a Scala a má zkušenosti s technologiemi pro zpracování velkých objemů dat, jako jsou Spark, Kafka a Hadoop. Kandidát hovoří plynně anglicky a má středně pokročilou znalost němčiny.
Pracovní zkušenosti
October 2021 – November 2021: AWS Engineer (Company name removed)
- Worked on a new data architecture to help the company scale and register millions of new users globally.
- Installed Databricks in AWS as the new platform stack, including VPC, subnets, IAM, S3, and Databricks resources.
- Helped prepare a Kubernetes cluster template for regions without cloud options, using Kafka, Kafka Connect, Spark Operator, Jupyter Hub, Python, and Scala.
- Created a reusable module based on Databricks Terraform provider for infra-as-code CICD deployable reusable stack.
- Developed a Terragunt layer over Terraform modules to speed up the CICD process across multiple regions.
- Finished early due to a decision by the financial director.
- Reference: Nigel Spencer – Head of Data (Company name removed).
April 2020 – August 2021: AWS Architect(hybrid) with AI/ML (Company name removed)
- Designed and implemented a Data Platform and Kate digital assistant as part of a larger team.
- Defined company-wide reusable standards for AWS Landing Zone, CICD, VPC, and security services integration.
- Responsible for CICD rolling updates and evaluating deployment strategies.
- Designed and led development of a central streaming data hub and related processing pipelines.
- Designed RASA Chatbot NLP layers communication flows.
- Utilized AWS Data Migration Service for legacy database systems migration.
- Implemented rolling-updates CICD processes for business API and infra-as-code.
- Worked on data quality using AWS Deequ.
- Reference: Nigel Spencer – Head of Data (Company name removed).
July 2019 – March 2020: AWS Data Engineer/Architect(hybrid) with AIML (Company name removed)
- Designed and implemented the company's future strategic energy trading platform as a streaming data lake.
- Developed data pipelines using AWS Glue, Athena, S3, and messaging subsystems.
- Implemented data quality checks using AWS Deequ.
- Designed and developed ML recommendation engines.
- Worked on integrating Spark with Kubernetes.
- Migrated and extended on-premise RASA chatbots to AWS EKS cluster.
- Enabled end-to-end encryption for cloud services.
- Worked with the Data Science team to extend and industrialize ML models.
