#vacancy Senior/Lead Data Engineer
Hello,
My name is Eugene, I'm CTO at Competera.
We're a product company from Ukraine with HQ in the US and branches in many countries, including Cyprus. The team is distributed and mostly located in Ukraine and the EU.
Our Pricing Platform is a SaaS product that utilizes complex machine learning to recommend optimal prices for retailers to help them achieve their business goals, such as increasing revenue, margin, sales, sell-off stocks, etc.
I'm looking for the right person for the role of Senior Data Engineer in the company to take ownership of our existing data pipeline and DWH and also to analyze their strengths and weaknesses against the real-life needs of the end users of the data and strategic business requirements in order to design and implement the solution that better fits our needs. We have an ELT data pipeline built on top of Google BigQuery with many complex SQLs and orchestrated by Apache Airflow DAGs. The pipeline takes about 30 tables and sometimes additional data sources as input then transforms the data and prepares artifacts for machine learning, data analytics, and data representation in the user interface. We want to offload everything from BigQuery to ClickHouse because BQ's billing model that doesn't work well in our case. Also, we're open to rethinking the data processing by introducing Apache Spark, Apache Beam, etc. if applicable. This role assumes starting delivering what the business needs right now as a single warrior Data Jedi, and leading all data engineering in the company (for now, 2 junior/middle data engineers in the service and delivery team who are doing operations), making decisions about the hiring of new data engineers for the cross-functional teams and becoming a cross-team expertise lead in everything related to data pipelines, data architecture, etc.
I would be glad to make a call to tell you more about our business and product, what problems it solves in the real world, and also about the technology under the hood, and the data preparation and processing challenges we face. I believe it would be interesting for the person who isn't looking for a boring job but eager to overcome challenges using modern technology solutions. Feel free to text me if you are interested or have any questions.
Eugene.