Data Engineer (DBT, Airflow, CDP), Investment Management Solution at DataArt
You seem a little late
Most likely, this vacancy is closed because it has already made someone's Mondays happy.
But don't worry - we have something to offer you!
See other open features on the site
Our client is one of the world’s top 20 investment companies headquartered in Great Britain and has branch offices in the US, Asia, and Europe. The IT environment of this company is constantly growing: there are around 30 programs and more than 60 projects currently actively developing. They are building a data marketplace that aggregates and analyzes data from multiple data feeds and systems like stock exchanges, news feeds, stock exchange brokers, internal quantitative systems, etc.
As the company moves to a new data source, this main goal of this project is to create a place that will be the golden source of data for all downstream systems and applications. The project team is doing classic ELT/ETL: it either transforms raw data from multiple sources (third-party and internal) or creates single interface for delivering data to downstream application.
Responsibilities
- Design, build, and deploy effective solutions in CDP (airflow and spark jobs)
- Design, build, and deploy DBT models
- Identify and test for bugs and bottlenecks in the ELT/ETL solution
Requirements
- 3+ years of experience developing in CDP or CDH
- 2+ years of experience with Airflow
- 2+ years of experience with Impala or Hive
- Strong knowledge of SQL
- Strong knowledge of DWH, ETL/ELT
- Professional knowledge of Python
- Experience developing in DBT
- Spoken English
Nice to have
- Proficiency in Snowflake
- Experience with Spark
We offer
• Professional Development:
— Experienced colleagues who are ready to share knowledge;
— The ability to switch projects, technology stacks, try yourself in different roles;
— More than 150 workplaces for advanced training;
— Study and practice of English: courses and communication with colleagues and clients from different countries;
— Support of speakers who make presentations at conferences and meetings of technology communities.
• The ability to focus on your work: a lack of bureaucracy and micromanagement, and convenient corporate services;
• Friendly atmosphere, concern for the comfort of specialists;
• Flexible schedule (there are core mandatory hours), the ability to work remotely upon agreement with colleagues.
Thanks!
Our editors are notified.