Data Engineer
Job Details
About the Company
With operational hubs scattered across Europe, Asia, and LATAM, and its headquarters situated in San Francisco, US, the company boasts a workforce of over 1,000 adept professionals. Spanning across more than 20 countries, ALLSTARSIT offers a diverse range of skilled employees across various verticals, including AI, cybersecurity, healthcare, fintech, telecom, media, and so on.
About the Project
Our partner is revolutionizing retail with their dynamic pricing B2B SaaS platform, leading the charge in automating and optimizing pricing strategies with AI-driven insights. Their comprehensive solution, embraced by retailers and brands across over 40 markets, delivers actionable pricing recommendations that drive business growth and profitability. Since 2018, they've been empowering a wide range of industries, including consumer electronics, beauty, and apparel, to seamlessly integrate pricing strategies across online and offline channels.
Our client invites you to join our dynamic and pioneering team, where your expertise in data science will significantly influence our path forward. They are passionate about tackling real-world challenges and seek like-minded individuals eager to make a mark in the retail pricing arena. Embark on this exciting journey with us and play a key role in sculpting the future of dynamic pricing in retail.
Specialization
Headquarters
Years on the market
Team size and structure
Current technology stack
Required skills:
- A Bachelor’s or higher in Computer Science, Software Engineering or a closely related technical field, demonstrating strong analytical and coding skills.
- 3+ years of experience as a data engineer, software engineer, or similar role and using data to drive business results.
- Strong Python skills, with experience building modular, testable, and production-ready code.
- Solid understanding of databases such as SQL, including indexing best practices, and hands-on experience working with large-scale data systems (e.g., Spark, Glue, Athena).
- Practical experience with Airflow or similar orchestration frameworks, including designing, scheduling, maintaining, troubleshooting, and optimizing data workflows (DAGs).
- A solid understanding of data engineering principles: ETL/ELT design, data integrity, schema evolution, and performance optimization.
- Familiarity with AWS cloud services, including S3, Lambda, Glue, RDS, and API Gateway.
Nice-to-Haves:
- Experience with MLOps practices such as CI/CD, model and data versioning, observability, and deployment.
- Familiarity with API development frameworks (e.g., FastAPI).
- Knowledge of data validation techniques and tools (e.g., Great Expectations, data drift detection).
- Exposure to AI/ML system design, including pipelines, model evaluation metrics, and production deployment.
Scope of work:
As a Data Engineer you’ll have end-to-end ownership - from system architecture and software development to operational excellence. Specifically, you will:
- Design and implement scalable machine learning pipelines with Airflow, enabling efficient parallel execution.
- Enhance our data infrastructure by refining database schemas, developing and improving APIs for internal systems, overseeing schema migrations, managing data lifecycles, optimizing query performance, and maintaining large-scale data pipelines.
- Implement monitoring and observability, using AWS Athena and QuickSight to track performance, model accuracy, operational KPIs and alerts.
- Build and maintain data validation pipelines to ensure incoming data quality and proactively detect anomalies or drift.
- Collaborate closely with software architects, DevOps engineers, and product teams to deliver resilient, scalable, production-grade machine learning pipelines.
Why ALLSTARSIT?
More open positions
