Databricks Architect - Remote

New Yesterday

Overview Job Title: Databricks Architect Databricks Architect with expertise in building scalable data solutions on AWS Responsibilities Supply Chain, Consumer Goods / Retail domain knowledge required. Experience in modernizing (solutions and hands-on execution) enterprise data platforms from legacy to AWS cloud Deep knowledge and experience in Data Modelling (OLAP and OLTP), Data Lake, Data Warehousing, ETL/ELT pipelines on both on-premise legacy and on AWS Lead migration and modernization of legacy ETL processes from Informatica, DataStage, and SQL Server to cloud-native solutions. Design and optimize data workflows for ingestion, transformation, and analytics using AWS-native services Design and Build data pipelines and solutions using Databricks (PySpark and SparkSQL) on AWS Experience with building Medallion architecture based data estates Experience in building Databricks Delta Lake based Lakehouse using DLT, PySpark Jobs, Databricks Workflows Proficient in SQL, Python, PySpark, S3, Lambda Working knowledge of Git, CI/CD, VS Code Proficient in AWS data ingestion stack Must have knowledge and ability to scale up on Glue, Lambda, Step Functions, Spark Streaming and other services on a need basis Implementation experience of several key data concepts such as CDC (Change Data Capture), Streaming and/or Batch ingestion, Pull v/s Push paradigms, Source to Target mapping, and so on Collaborate with cross-functional teams to gather requirements and deliver scalable, secure, and high-performance data solutions. Strong semantic layer modelling and implementation experience Establish best practices for data governance, lineage, and quality across hybrid environments. Provide technical leadership and mentoring to data engineers and developers. Monitor and troubleshoot performance issues across Databricks and AWS services. Understanding of key reporting stack such as Power BI, Tableau, Alteryx, Excel BI Add-Ins a plus Certifications Databricks Certified Data Engineer Associate Application deadline Applications will be accepted until 10/17/25 Salary and Other Compensation The annual salary for this position is between $88,200 - $139,500 depending on experience and other qualifications of the successful candidate. Benefits Medical/Dental/Vision/Life Insurance Paid holidays plus Paid Time Off 401(k) plan and contributions Long-term/Short-term Disability Paid Parental Leave Employee Stock Purchase Plan Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
#J-18808-Ljbffr
Location:
San Francisco, CA, United States
Salary:
$250,000 +
Job Type:
FullTime
Category:
IT & Technology