Cloud Engineer
Überblick
Kurzer Überblick
Der Kandidat ist ein sehr erfahrener Fachmann mit über 20 Jahren Erfahrung in der Datenverarbeitung. Er hat einen starken Fokus auf Cloud-Umgebungen und hat mit verschiedenen Unternehmen an Migrationsprojekten gearbeitet. Der Kandidat hat Architekturen unter Verwendung einer Vielzahl von Technologie-Stacks implementiert, darunter Datenbanken, APIs und Nachrichtenströme. Er hat auch an Data-Warehouse-Systemen, ML/AI-Modellen und Business-Intelligence-Tools für Unternehmen gearbeitet. Der Kandidat verfügt über fundierte AWS-Kenntnisse, einschließlich Erfahrung mit AWS Code Pipeline, Glue, Athena, Redshift und mehr. Er beherrscht Sprachen wie Python, Java und Scala und hat Erfahrung mit Big-Data-Technologien wie Spark, Kafka und Hadoop. Der Kandidat spricht fließend Englisch und verfügt über mittlere Kenntnisse in Deutsch.
Berufliche Erfahrung
October 2021 – November 2021: AWS Engineer (Company name removed)
- Worked on a new data architecture to help the company scale and register millions of new users globally.
- Installed Databricks in AWS as the new platform stack, including VPC, subnets, IAM, S3, and Databricks resources.
- Helped prepare a Kubernetes cluster template for regions without cloud options, using Kafka, Kafka Connect, Spark Operator, Jupyter Hub, Python, and Scala.
- Created a reusable module based on Databricks Terraform provider for infra-as-code CICD deployable reusable stack.
- Developed a Terragunt layer over Terraform modules to speed up the CICD process across multiple regions.
- Finished early due to a decision by the financial director.
- Reference: Nigel Spencer – Head of Data (Company name removed).
April 2020 – August 2021: AWS Architect(hybrid) with AI/ML (Company name removed)
- Designed and implemented a Data Platform and Kate digital assistant as part of a larger team.
- Defined company-wide reusable standards for AWS Landing Zone, CICD, VPC, and security services integration.
- Responsible for CICD rolling updates and evaluating deployment strategies.
- Designed and led development of a central streaming data hub and related processing pipelines.
- Designed RASA Chatbot NLP layers communication flows.
- Utilized AWS Data Migration Service for legacy database systems migration.
- Implemented rolling-updates CICD processes for business API and infra-as-code.
- Worked on data quality using AWS Deequ.
- Reference: Nigel Spencer – Head of Data (Company name removed).
July 2019 – March 2020: AWS Data Engineer/Architect(hybrid) with AIML (Company name removed)
- Designed and implemented the company's future strategic energy trading platform as a streaming data lake.
- Developed data pipelines using AWS Glue, Athena, S3, and messaging subsystems.
- Implemented data quality checks using AWS Deequ.
- Designed and developed ML recommendation engines.
- Worked on integrating Spark with Kubernetes.
- Migrated and extended on-premise RASA chatbots to AWS EKS cluster.
- Enabled end-to-end encryption for cloud services.
- Worked with the Data Science team to extend and industrialize ML models.
