Back to professionals

.NET Developer & AI Engineer & AWS Architect & AWS Engineer & Big Data Developer & C# Developer & Cloud Consultant & Cloud Engineer & Data Engineer & Data Scientist & Database Administrator & Database Development & DevOps Engineer & Javascript Developer & MS SQL Developer & Node.js Developer & Oracle Developer & Python Developer & Salesforce Administrator & Salesforce Consultant & Systems Administrator & Systems Integration Engineer

Overview


Short Summary

Experienced Senior Data Engineer with expertise in building scalable data pipelines on cloud platforms like AWS and Azure using Python. Skilled in Hadoop, Spark, Airflow, er, and Kubernetes for large-scale data infrastructure. Specialized in Machine Learning, particularly in Generative AI through the LangChain framework. Developed an AI chatbot using LangChain and OpenAI's GPT APIs to enhance customer engagement. Managed comprehensive data pipelines using AWS Glue, EMR, Spark, S3, Batch, Airflow, and Kinesis for real-time data processing and analysis.

Work Experience

Senior Data engineer

  • Developed AI chatbot using LangChain and OpenAI's GPT APIs to enhance customer engagement and support capabilities.
  • Contributed to chatbot project using Generative AI, AWS ecosystem, and LLM models to handle 100% of incoming chats.
  • Designed and managed comprehensive data pipeline using AWS Glue, EMR, Spark, S3, Batch, Airflow, and Kinesis for real-time data processing.
  • Dates: 08/2023 - Present

Data engineer

  • Designed, built, and maintained scalable data pipelines for processing large volumes of data from various sources.
  • Utilized big data technologies like Hadoop, Spark, Kafka for processing and analyzing large datasets efficiently.
  • Developed and maintained data warehouses and data lakes for storing structured and unstructured data.
  • Dates: 01/2022 - 07/2023

Education

  • Pursuing Data Science Master's Degree at PolyTech Tunis University.
  • Completed Computer Science Bachelor's Degree at Science Faculty of Tunis.
  • Obtained General Engineering Degree from Engineering Institute of Nabeul, Tunisia.
  • Dates: 09/2015 - Present

Certifications

  • AI Associate certification focusing on leveraging AI capabilities and ethics.
  • AWS Solutions Architect Associate certification for designing scalable solutions on AWS.
  • AWS Cloud Practitioner Certification for understanding cloud concepts and AWS services.
  • Dates: Various

Skills

  • Proficient in AWS, Azure, OpenAI, Python, Hadoop, Spark, Airflow, er, Kubernetes, and more.
  • Experienced in developing scalable data pipelines and utilizing big data technologies for data processing.
  • Specialized in Machine Learning, particularly in Generative AI through the LangChain framework.
  • Dates: Ongoing
Author
.NET Developer & AI Engineer +20
6632be41a9bb2500015a6b6c
Employee3000  / Per month
Freelancer220  / Per day
LevelMEDIOR
Roles
.NET Developer AI Engineer AWS Architect AWS Engineer Big Data Developer C# Developer Cloud Consultant Cloud Engineer Data Engineer Data Scientist Database Administrator Database Development DevOps Engineer Javascript Developer MS SQL Developer Node.js Developer Oracle Developer Python Developer Salesforce Administrator Salesforce Consultant Systems Administrator Systems Integration Engineer
Languages
English
Skillset
.NET CoreAI and Machine LearningAWSApache CassandraApache KafkaApache SparkApexApplication ServerArchitectAzureBig DataBigMLC#CRMCertificationsCloudContainer Engine SoftwareContainer Management SoftwareContainerization SoftwareDatabaseDatabricksDevOpsDockerE-CommerceE-Commerce PlatformsGenerative AIHadoopKubernetesLangChainLinuxMessage BrokerMicrosoft serversMongoDBNeo4jOperation SystemsPL/SQLProject ManagerPySparkPythonRedisSQLSW Tools APIsSalesForceSalesforce Commerce for B2BSalesforce Commerce for B2CScrum MasterSnowflakeTensorFlowUnix
Localities
Remote