Sr. Data Engineer

Job#: 2024411

Job Description:

CHICAGO IL (onsite 3 days week)
Sr Data Engineer

We are seeking an experienced data engineer to contribute to a high data volume application. This critical system not only requires ongoing production maintenance but also demands enhancements through integration with Machine Learning (ML) and Master Data applications. In the future, theres a plan to migrate the existing AWS EMR application to AWS Glue.
The ideal candidate will possess robust data engineering expertise, adept at designing, developing, and fine-tuning applications. Exposure to various design patterns within the data engineering paradigm is crucial for success in this role.
Our development process adheres to an agile methodology, with Program Increment (PI) planning occurring every six weeks, equivalent to three sprints. If you are a skilled data engineer who thrives in an agile environment and has a solid background in designing and optimizing applications, we invite you to join our dynamic team.
Skill Set:
AWS Cloud Technologies:
  • Strong command of Apache Spark (3-5 years)
  • AWS EMR proficiency (3-5 years)
  • AWS Glue expertise (1-5 years)

PySpark Application Development:
  • Extensive experience in designing, developing, troubleshooting, and debugging PySpark applications
  • Proven track record in processing and handling large datasets
Performance Tuning:
  • Hands-on experience in performance tuning Spark applications
  • Skills to optimize Spark code for scalability, performance, and maintainability
Microservices Development:
  • Proficient in developing microservices using AWS Lambda, SNS, DynamoDB (1-5 years)
  • Code Management:
  • Strong proficiency in using GitHub for efficient code management and sharing
Nice to have:
  • Experience in the node.js, vue.js.
  • Experience in Databricks

 

 

 

 

 

 

 

 

EEO Employer

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [email protected] or 844-463-6178.

Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico.

Employee Type:
Contract

Location:
Rolling Meadows, IL, US

Job Type:

Date Posted:
April 10, 2024