Senior Data Engineer at Competera

Competera uses Big Data and Deep Learning to change the way retailers do pricing. We are known for both: cutting-edge math ‘under the hood’ and for deep expertise in the pricing domain. We are now looking for a Senior Data Engineer to better the way our data processing works.

What you will do:

• Design, build, extend, and maintain data pipelines and unified integration ETL
• Scale the data pipeline throughput using applicable instruments
• Introduce and adopt new instruments, technologies and their combinations that will allow the company to scale the data processing speed and performance in a cost-efficient way

Starter-kit needed to join the board:

• Proven experience in building data processing pipelines
• Experience with workflow automation tools (AirFlow, Prefect, Luigi, etc.)
• RDBMS, Column-oriented DBMS (writing queries, db architecture building, administration, etc.)
• Apache Spark
• Strong core Python knowledge

Pleasant extras:

• ClickHouse
• Apache Kafka
• CDC (e.g. WAL->Debezium->Kafka)
• ksqlDB
• Spark SQL
• Argo Workflows
• GCP: BigQuery, Dataproc, Data Fusion, DataFlow

You’re gonna love it, and here’s why:

• Meaningful work in an agile team of engineers, who turn business ideas into software solutions
• Freedom to choose the best suitable technologies to deliver the solution (even if it’s not in the product yet)
• Want to learn? Competera loves that and is eager to cover 60% of your training/courses fee
• Fair payout with regular performance-based reviews and stock options plan for top performers
• Remote-first ideology even after the pandemic and the war
• Working hours that adapt to your biorhythm
• Paid vacation & sick leaves (20 business days each) + 15 days off
• Partial medical insurance coverage

Let’s price the world together!

2022-08-12T08:00:46.000 2022-09-11T23:59:59.000 Full time Competera Pricing Platform