Sergiy P.
Senior Data Engineer
Information
Available
Employment
Full-time
Part-time
Expertise
AI Data Infrastructure
Data Engineering
Data Pipelines
Big Data Processing
ETL / ELT
Data Warehousing
Streaming Data
Location
Kyiv, Ukraine
Work Experience
6+ years
Skills
Docker
MongoDB
PostgreSQL
Kafka
Python
Pandas
Spark
Airflow
Snowflake
BigQuery
Data lakes
AWS
SQL
GCP
ETL
ELT pipelines
Data Warehouses
Streaming pipelines
Languages
CV
Download PDFProfessional Summary
Senior Data Engineer with experience building data pipelines and data infrastructure for analytics and AI systems. Specializes in collecting, processing, and preparing data from various sources, designing data lakes and data warehouses, and ensuring stable data delivery to ML and AI products.
Focuses on building scalable and fault-tolerant data systems that provide businesses with relevant and structured data for decision-making and model training.
Key skills
Data Engineering
- building ETL/ELT pipelines
- batch and streaming data processing
- integration of data sources (API, databases, logs)
- preparing training datasets for ML
Big Data
- Apache Spark / PySpark
- distributed data processing
- computational optimization
Data Storage
- designing data lakes
- building data warehouses
- working with BigQuery, Snowflake, Redshift
Orchestration & Streaming
- Apache Airflow
- Kafka
- automation of data pipelines
Infrastructure
- AWS / GCP
- Docker
- building a scalable data architecture
Experience
AVADA MEDIA
Senior Data Engineer
- design and implementation of data pipelines for AI and analytics;
- collecting data from CRM, API, logs and external services;
- data processing and cleaning;
- construction of data lakes and analytical warehouses;
- preparing datasets for ML models;
- setting up batch and streaming processes;
- optimization of data processing performance;
- Integration of data infrastructure into AI projects.
Key projects
- collection and processing of audio and text data
- preparing data for call analysis
Result: a stable data stream for AI analytics
AI agent for analyzing supplier proposals
- data extraction from documents
- structuring information
Result: prepared datasets for AI analysis
- voice data processing
- integration of data flows into the system
Result: automation of call processing
AI agent for generating commercial proposals
- combining data from CRM, documents, and databases
- preparing data for generation
Result: acceleration of business processes
Education
Bachelor of Computer Science
Strengths
- Data architecture design
- Working with large volumes of data
- Pipeline and infrastructure optimization
- Understanding AI and ML processes
- Stable and scalable solutions
- Focus on business results
