Azure Data Engineer

Job#: 2026275

Job Description:

Join a high-performing, dynamic development team dedicated to building innovative solutions to supply chain challenges.  The ideal candidate for this Senior Data Engineer role will have expertise in Databricks, preferably in building robust ETL solutions, and in Python (PySpark) and Delta tables.  This is an exciting opportunity to contribute to our data infrastructure and play a key role in driving our organizations data initiatives forward.
Qualifications:
• Bachelors degree in Computer Science, Engineering, or a related field; or equivalent work experience.
• Proven experience (X years) as a Data Engineer or similar role, with a strong background in building and maintaining ETL pipelines.
• Expertise in Databricks, Python, PySpark, and Delta tables for data processing and manipulation.
• Hands-on experience with developing and deploying Azure-based solutions by using Azure Data Lake Storage, Azure Databricks, Azure Synapse Analytics, or other Azure services.
• Solid understanding of data modeling principles, relational databases, and data querying concepts.
• Excellent problem-solving skills and the ability to analyze complex technical issues independently.
• Strong communication skills with the ability to effectively collaborate with team members and communicate technical concepts to non-technical stakeholders.
• Experience working in an Agile or iterative development environment is a plus.
 

Key Responsibilities

• Design, build, and maintain robust and scalable ETL pipelines to efficiently extract, transform, and load data from various sources into our data lake or data warehouse.
• Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and develop solutions that meet their needs.
• Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging best practices in data engineering.
• Implement data quality checks and monitoring processes to ensure data accuracy, consistency, and integrity throughout the data lifecycle.
• Work closely with the DevOps team to deploy and manage data infrastructure on Azure, ensuring scalability, security, and compliance with company standards.
• Troubleshoot and resolve issues related to data pipelines, performance bottlenecks, and system failures in a timely manner.
• Stay up-to-date with emerging technologies and trends in data engineering and recommend innovative solutions to enhance our data platform.

 

 

 

 

 

 

 

 

EEO Employer

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [email protected] or 844-463-6178.