Middle Data Engineer - #7508450

AgileEngine is a top-ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies. Listed on Inc. 5000 among the fastest-growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment daily, there’s no better place — guaranteed! :)

What you will do

• Designing and implementing efficient data pipelines (ETLs) to integrate data from various sources into Indeed’s data platforms;
  

• Designing and implementing data model changes that align with data standards;
  

• Work with existing APIs written in Flask (python);
  

• Monitoring production data pipelines daily to ensure completion, maintain data quality, and address performance issues;
  

• Reading and interpreting system logs to evaluate system health or perform root cause analysis;
  

• Identifying pipeline issues and working with colleagues, vendors, and external teams to resolve;
  

• Clearly communicating pipeline statuses with management and stakeholders.
  

Must haves

• Ideally a bachelor’s degree in computer science, computer engineering, or an engineering discipline;
  

• 5+ years of industry experience in software development and/or data engineering with strong expertise in fast-paced and deliver-focused environments;
  

• Extensive production experience in SQL;
  

• Extensive experience building an ETL from scratch;
  

• 3+ years of experience with:
  

• Python/Flask;
  

• 3+ years of hands-on experience with big data technologies (such as Redshift, Hive, Trino/Presto, or similar technologies);
  

• Experience with modeling data;
  

• Experience in Athena;
  

• Experience with MySQL;
  

• Experience in Gitlab CI;
  

• Experience in AWS cloud platform (SQS, S3 services);
  

• Extensive experience in writing technical documentation;
  

• Upper-intermediate English level.
  

Nice to haves

• Experience in Spark;
  

• Experience in Tableau or Google Data Studio;
  

• ETL work will be in Dagster but may not be a primary focus of the individual.
  

• Professional growth
  

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.

• Competitive compensation
  

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

• A selection of exciting projects
  

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.

• Flextime
  

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.