Senior Data Engineer – Azure Databricks - Chicago (Hybrid)
New Yesterday
This range is provided by Evolution USA. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Base pay range $140,000.00/yr - $160,000.00/yr
Additional compensation types Annual Bonus
Direct message the job poster from Evolution USA
Hiring elite Python talent across Engineering, Data, AI & ML for New England tech companies l Founder l Vice President, USA | Tech Podcast Host I 20+… We’re hiring a Senior Data Engineer to design and deliver enterprise-grade data solutions using the latest in lakehouse and cloud technology. This is a senior-level, hands-on role offering autonomy, collaboration, and the opportunity to help lead the development of a high-performing data ecosystem.
Working with modern tools like Azure Databricks , Spark , and Delta Lake , you’ll play a critical role in building scalable data infrastructure that powers advanced analytics, BI, and data science across the organization.
What You'll Do:
As a Senior Data Engineer, you’ll be a key contributor to the architecture, development, and optimization of our data infrastructure. Your day-to-day will include:
Architect & Design robust, scalable data solutions on the Databricks Lakehouse Platform in Azure.
Develop & Maintain production-grade ELT/ETL pipelines using Spark (PySpark or Scala), SQL, notebooks, and Delta Live Tables (DLT).
Optimize performance and cost-efficiency through Delta Lake tuning, partitioning, and compute usage improvements.
Model data using medallion architecture , star-schema, and other frameworks tailored for analytics and reporting.
Collaborate with cross-functional teams—including data scientists, analysts, and engineers—to deliver high-quality data products.
Mentor & Guide junior and mid-level engineers, fostering a culture of quality and technical excellence.
Standardize & Govern data engineering practices by establishing and maintaining technical documentation and best practices.
Stay Current with emerging technologies and trends in cloud data architecture.
Your background:
5+ years of hands-on experience building modern data solutions at scale.
Deep expertise in Spark (PySpark or Scala), SQL , and data processing in Databricks .
Strong track record of delivering Lakehouse solutions using the medallion architecture in Azure.
Demonstrated success building metadata-driven ELT/ETL pipelines .
Experience with Azure Data Factory for data orchestration.
Familiarity with Lambda architectures (batch + streaming).
Background in agile development (Scrum, Kanban) and working within CI/CD frameworks.
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent hands-on experience.
Excellent communicator with strong documentation habits and a collaborative mindset.
Bonus Points For:
Experience in the insurance or finance domain.
BI and data analysis experience; ability to support end-to-end data platform development.
Familiarity with offshore coordination or hybrid team structures.
Why Join Our Client?
You’ll be part of a team that’s driving innovation through data. We offer:
A hybrid work model (1-2 days p/wk in Downtown Chicago office) that blends flexibility with meaningful in-person collaboration
Access to a modern, cloud-first tech stack
A culture centered around trust, collaboration, community, mentorship, and ownership
The chance to lead initiatives and make a lasting impact
Ready to build the next generation of data platforms with a team that values quality, autonomy, and continuous learning? We’d love to hear from you.
Seniority level Seniority level Mid-Senior level
Employment type Employment type Full-time
Job function Job function Information Technology
Industries Insurance, Insurance Agencies and Brokerages, and Data Infrastructure and Analytics
Referrals increase your chances of interviewing at Evolution USA by 2x
Inferred from the description for this job Medical insurance
Vision insurance
401(k)
Pension plan
Paid maternity leave
Paid paternity leave
Get notified about new Data Engineer jobs in Chicago, IL .
Chicago, IL $84,950.00-$124,800.00 3 days ago
Deerfield, IL $98,600.00-$157,500.00 1 month ago
Deerfield, IL $98,600.00-$157,500.00 1 month ago
Deerfield, IL $98,600.00-$157,500.00 1 month ago
Chicago, IL $100,000.00-$120,000.00 3 days ago
Chicago, IL $150,000.00-$220,000.00 1 week ago
Chicago, IL $95,600.00-$162,400.00 4 days ago
Chicago, IL $99,600.00-$139,440.00 2 weeks ago
Chicago, IL $90,000.00-$120,000.00 2 weeks ago
Glencoe, IL $75,000.00-$90,000.00 3 days ago
Chicago, IL $90,000.00-$140,000.00 3 days ago
Chicago, IL $120,000.00-$140,000.00 4 days ago
Rosemont, IL $165,000.00-$175,000.00 3 weeks ago
Chicago, IL $120,000.00-$150,000.00 3 days ago
Chicago, IL $75,000.00-$93,000.00 4 days ago
Glenview, IL $80,000.00-$120,000.00 1 week ago
Chicago, IL $150,000.00-$210,000.00 4 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
- Location:
- Chicago, IL, United States
- Salary:
- $200,000 - $250,000
- Job Type:
- FullTime
- Category:
- IT & Technology