Job#: 3041180

Job Description:

LEAD CONSULTANT

WHO WE ARE 

Everforth Apex Systems is a leading global technology and digital engineering firm dedicated to helping organizations adapt, innovate, and thrive in a world of constant change. Leveraging deep industry insights and proven expertise, we deliver end-to-end solutions that accelerate time-to-value and realize our clients’ digital visions across commercial and federal sectors.

Our comprehensive solution portfolio spans AI & data, cloud and infrastructure, digital engineering, customer experience, cybersecurity, enterprise platforms, application development, strategy, transformation, and managed services. Powered by proprietary assets, accelerators, and strong alliances with cutting-edge technology partners—including Adobe, AWS, Microsoft, Salesforce, and more—we turn complexity into progress and measurable business outcomes.

With a presence in over 70 markets across North America, Europe, and India, Everforth Apex Systems innovates alongside our customers, building and deploying tailored artificial intelligence solutions to enhance business value and improve customer experiences. As part of the commercial segment of Everforth, we are committed to driving the next wave of global IT services and digital transformation.

JOB DESCRIPTION

Everforth Apex is seeking a dynamic Lead Consultant with strong analytical skills to serve as a Data Lead Engineer and SME within Everforth Apex Systems Consulting Services. In this role, you will leverage deep expertise across the Databricks Data Intelligence Platform, Lakehouse architecture, and modern data engineering best practices to provide expert-level support and guidance in the implementation, customization, and optimization of Databricks solutions for our clients. You will own the technical direction of Databricks-based solutions, mentor engineering teams, and drive best practices in pipeline development, performance tuning, governance, data quality, and cloud-scale delivery. 

RESPONSIBLITIES

•        Lead the design and development of scalable batch and streaming data pipelines using Databricks notebooks, Lakeflow/Delta Live Tables, Workflows, serverless compute, and integration tools.

•        Demonstrate strong technical knowledge and implementation skills. Stay current on relevant technology trends and practices. Build trust and respect among internal and external stakeholders and demonstrate collaborative teamwork.

•        Produce high quality deliverables, meet project deadlines, and take responsibility for engagement success. Demonstrate a passion for quality and process improvement.

•        Demonstrate professional level consulting skills and communication/presentation skills.

•        Continually innovate, seek creative solutions, and find new ways of adding value. Listen and seek to understand the client and meet their needs, providing consultative guidance. Stay attuned to the future needs of the client and work with internal resources to identify opportunities. Proactively provide solutions and approach adversity with a solution-focused mindset.

•        Identify and evaluate new team members through professional networking and technical screening.

•        Perform assessments of clients' environments and design robust solutions and roadmaps.

•        Implement Delta Lake and Unity Catalog-managed tables for transactional, ACID-compliant data processing, optimizing performance, reliability, and governance.

•        Build and manage ETL/ELT processes using Databricks-native orchestration, declarative pipelines, automated workflows, and reusable engineering patterns.

•        Utilize PySpark, Scala, or SQL to create efficient transformation processes within Databricks environments.

•        Continuously monitor and improve pipeline performance using Databricks Jobs/Workflows, observability tools, serverless or job compute tuning, liquid clustering, and cost optimization techniques.

•        Collaborate with stakeholders and business units to define data governance practices via Unity Catalog for lineage, access controls, auditability, secure data sharing, and compliance adherence.

•        Work closely with cross-functional teams to embed DevOps and CI/CD practices within Databricks pipelines using tools such as GitLab, Databricks Asset Bundles, Terraform, or integrations with other DevOps platforms.

•        Coordinate with cross-functional teams to ensure successful project execution and stakeholder satisfaction.

JOB REQUIREMENTS

•        7+ years of experience in data engineering, including 4+ years of practical leadership with Databricks and Apache Spark.

•        Proven track record leading end-to-end pipeline development projects in cloud environments such as AWS, Azure, or GCP.

•        Consulting experience leading client engagements and managing delivery.

•        Expertise in PySpark, SQL, Delta Lake, and Spark optimization for building and tuning large-scale lakehouse pipelines.

•        Experience architecting Medallion architectures, governed lakehouse solutions, and reusable data product patterns.

•        Hands-on experience with Lakeflow/Delta Live Tables, Databricks Workflows, Unity Catalog, managed tables, and serverless compute capabilities.

•        Strong knowledge of CI/CD pipelines, version control (Git), Databricks Asset Bundles, infrastructure automation, and deployment patterns.

•        Familiarity with structured, semi-structured, batch, and streaming data integration from APIs, cloud storage, databases, and enterprise applications.

•        Familiarity with data governance, Unity Catalog, lineage, data security, access controls, and compliance practices.

•        Excellent client-facing communication, consulting, and leadership skills.

•        Bachelor’s degree in Computer Science, Information Systems, or equivalent experience.

•        Certifications in Databricks or major cloud platforms such as AWS, Azure, or GCP preferred. 

•        Background in performance tuning, predictive optimization, and cost optimization of big data and lakehouse workloads preferred.

OUR COMPREHENSIVE BENEFITS

•        Competitive Salary

•        Health, Dental and Vision Insurance

•        Health Savings Accounts (HSA) with Employer Contribution

•        Flexible Spending Accounts

•        Long and Short-Term Disability

•        Life Insurance

•        Voluntary Benefits

•        Employee Assistance Program

•        Paid Parental Leave

•        Wellness Incentives

•        Vacation and Holiday Pay

•        401(k) Retirement Plan with Employer Match

•        Employee Stock Purchase

•        Training and Advancement opportunities

•        Tuition Reimbursement

•        Birthdays Off

•        Philanthropic Opportunities

•        Referral Program

•        Partial Gym Membership Paid

•        Team Building Events

•        Discount Programs

Everforth Apex is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Everforth Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact [email protected].