Späť na profesionálov

Data Engineer & Team Leader
Prehľad
Krátke zhrnutie
Kandidát je skúsený vedúci dátový inžinier s odbornými znalosťami v oblasti optimalizácie procesov a postupov, vytvárania potrubí a ovládačov a poskytovania technickej podpory. Riadil viacero projektov a má skúsenosti s vývojom procesov ETL, migráciou údajov a vývojom softvéru. Má silné technické zručnosti v jazykoch ako Scala, Python, SQL a Java, ako aj skúsenosti s AWS, Spark, Databricks a rôznymi databázami. Majú tiež skúsenosti s riadením a ovládajú viacero jazykov.
Pracovné skúsenosti
Lead Engineer
(Oct 2022 – now)
- Optimization of existing processes and procedures
- Creating new pipelines,modeles,views and drivers (Django + AWS)
- Creating unit-tests for our drivers(PyTest+python)
- Technical support storage
- Writing and optimization drivers, functions
- Kept project leaders regularly updated with progress, maintaining open, productive communication.
- Managed multiple projects with differing technologies, including delegating tasks, assessing quality and sign off.
Lead Engineer
(June 2022 – now)
- Optimization of existing processes and procedures Creating new pipelines and drivers (Java + AWS)
- Creating unit-tests for our drivers(java spring+springBoot) Technical support storage
- Writing and optimization drivers, functions
- Kept project leaders regularly updated with progress, maintaining open, productive communication.
Software Engineer
(April 2021 – May 2022)
- Optimization of existing processes and procedures
- Creating new pipelines and drivers (python+Airflow+spark+AWS) Creating unit-tests for our data-drivers(scala)
- Creating a new data-notebooks(spark)
- Technical support storage
- Big Data migration process development
- Writing and optimization views, stored procedures, and functions
Software Engineer
(September 2020 – April 2021)
- ETL process development
- Preparation of data for building reports
- Data migration process development
- Writing and optimization views, stored procedures, and functions, construction and support of storage
Software Engineer
(August 2019 – September 2020)
- data collection from various sources Source DB (Oracle, Postgres); different api (Beamery api,GoogleAnalytics api and other); flat files (exel, csv, json)
- preparation, pre-processing of data before loading into the DWH (the storage is built in MS SQL server)
- creation and configuration of loading processes in the DWH (using SSIS packages and services, python-scripts, PowerShell-scripts and a .NET Application)
- the creation of procedures, functions and scripts for data transformation for their preparation for reports (in MS SQL Management Studio)
- development, support of storage performance optimization of existing processes and procedures
Software Engineer
(May 2018 – July 2019)
- ETL process development
- Preparation of data for building reports Data migration process development Development of software for the bank Work in the insurance departmen
Data Engineer & Team Leader
6538fd4c5d5159000100863b
| Zamestnanec | 8000 € / Mesačne |
| Úroveň | SENIOR |
Role
Data Engineer Team Leader
Jazyky
English
Zručnosti
.NET FrameworkAWSApplication ServerBig DataBitbucketC#C++CICDCSSCircleCICloudCode ManagementContainer Engine SoftwareContainerization SoftwareDatabaseDatabricksDevOpsDjangoDockerEntity FrameworkGitGitlabGreenplumHadoopJSONJSPJavaJava EEJavaScriptMicrosoft serversMongoDBNumpyOraclePandasPostgreSQLPowerShellPythonReportsSQLSales RepresentativeScalaShellSpringToolsWPFXMLjQuery
Lokality
Remote