Senior Databricks Data Engineer
Santa Monica, CA, 90292
Reference ID: 32776352
Date Posted: 07/31/2026
Job Title: Senior Databricks Data Engineer
Location-Type: Onsite, Santa Monica, CA (office relocation to Century City anticipated within approximately one year)
Start Date: ASAP
Duration: Permanent
Compensation Range: $200,000 - $225,000
Benefits: Medical premiums 100% covered, Dental and Vision premiums 100% covered, 401K with employer match up to 6%, 14 days PTO, 9 sick days annually, 11 paid holidays, $20K lifetime fertility benefit, daily catered lunch, weekly carwash service, monthly cellphone reimbursement
Visa Sponsorship: Not eligible for visa sponsorship
Job Description:
This role leads the technical design and hands-on development of an enterprise-grade Azure Databricks Lakehouse platform, delivering scalable data infrastructure and governance capabilities across the organization.
Job Summary
•Build and evolve an internal Azure Databricks Lakehouse platform using Delta Lake and standardized architectural patterns such as medallion architecture.
•Develop scalable ingestion and transformation frameworks for multiple source systems using Auto Loader, CDC incremental patterns, and Delta best practices.
•Implement curated data products with clear contracts covering schemas, SLAs, data quality rules, ownership, and documentation.
•Operationalize pipelines using Databricks Workflows, including scheduling, dependencies, retries, alerting, and run-time observability.
•Own performance and cost optimization across workloads, including cluster policies, partitioning strategies, file sizing, and caching.
•Implement and administer data governance and security using Unity Catalog, including least-privilege access patterns and audit standards.
•Mentor junior and mid-level engineers, lead architecture and design reviews, and drive adoption of platform standards and best practices.
Minimum Requirements:
•8 years of data engineering experience, including 3 years of recent, hands-on Azure Databricks experience in production environments.
•Strong proficiency in Python (PySpark) and Spark SQL for large-scale data transformation.
•Strong experience with Delta Lake, including MERGE/UPSERT, schema evolution, time travel, ACID transactions, and incremental processing.
•Solid Azure fundamentals relevant to a data platform, including ADLS Gen2, service principals, managed identities, and Azure Key Vault secrets management.
•Demonstrated ability to work cross-functionally and communicate technical decisions clearly to non-engineering stakeholders.
•Experience with financial datasets such as general ledger, subledger, and accounting line items.
Preferred Qualifications:
•Databricks Certified Data Engineer Professional certification (Associate certification also considered).
•Experience implementing Unity Catalog in an enterprise environment, including RBAC model design and audit patterns.
•Experience with CI/CD for Databricks assets using Azure DevOps or GitHub Actions, and familiarity with Terraform or asset-bundle deployment.
•Experience with streaming or near-real-time ingestion using Structured Streaming, Event Hubs, or Delta Live Tables.
•Private equity, credit, or alternative asset management industry experience.
•Bachelor's degree in computer science, data engineering, mathematics, or a related field (preferred but not required).
-
Senior Data & AI Engineer x2
Santa Monica, CA, 90401
Apply now: Senior Data & AI Engineer, location is 100% onsite in Santa Monica, CA. The start date is ASAP for this permanent position. Job Title: Senior Data & AI Engineer Location-Type: 100% onsite, five days per week in Santa Monica, CA Start Date Is...
Date Posted: 07/31/2026 Recommended
-
Lead Engineer
Los Angeles, CA, 90001
Job Title: Lead Engineer Location-Type: Onsite LA Start Date Is: ASAP Duration: (contract, perm, etc) FTE Perm Compensation Range: $130K-150K - 12% performance based Benefits: Eligible for Health, Dental, Vision, 401K, PTO Must be authorized to work in...
Date Posted: 07/31/2026 Recommended
-
Cloud Platform DevOps Engineer
Wilmington, DE, 19805
Apply now: Cloud Platform DevOps Engineer, Remote/Hybrid. Start date is ASAP for this contract position. Job Title: Cloud Platform DevOps Engineer Location-Type: East Coast Remote/Hybrid to Wilmington, DE Start Date: ASAP Duration: 6 month contract Com...
Date Posted: 07/31/2026 Recommended
-
Sr. Azure Platform & Reliability Engineer
St. Louis, MO, 63118
Apply now: Senior Azure Platform & Reliability Engineer, Onsite - St. Louis, MO. Start date is ASAP for this 6-Month Contract-to-Hire position. Job Title: Senior Azure Platform & Reliability Engineer Location-Type: Onsite, St. Louis, MO Start Date: ASA...
Date Posted: 07/31/2026 Recommended
-
DevSecOps Engineer x2
Manassas, VA, 20110
Apply now: DevSecOps Software Engineer, Onsite - Manassas, VA. Start date is ASAP for this contract position. Job Title: DevSecOps Software Engineer - Mid Level and Senior Level Positions Location-Type: Onsite, Manassas, VA Start Date: ASAP Duration: 3...
Date Posted: 07/31/2026 Recommended
-
Lead Data Engineer
Los Angeles, CA, 91608
Apply now: Lead Data Engineer / Delivery Lead, location is in LA. The start date is ASAP for this contract position. Job Title: Lead Data Engineer / Delivery Lead Location-Type: LA Start Date Is: ASAP Duration: Contract Compensation Range: $130-150K Be...
Date Posted: 07/31/2026 Recommended
-
Sr Elastic Engineer
Hampton, VA, 23665
Apply now: Sr. Elastic Engineer, location is Hybrid. The start date is ASAP for this permanent position. Job Title: Sr. Elastic Engineer Location-Type: Hybrid 3 days a week in either Hanscom, MA or Hampton, VA Start Date Is: July 6th Duration: Permanen...
Date Posted: 07/31/2026 Recommended
-
Solutions and Development Engineer
Conshohocken, PA, 19428
Job Title: Solutions and Development Engineer Location: Hybrid – 3 Days Onsite in Conshohocken, PA Employment Type: Full-Time, Permanent Compensation: $95k - $110k Benefits: Eligible for Health, Dental, Vision, 401K, PTO Must be authorized to work in t...
Date Posted: 07/31/2026 Recommended
-
Manager IT Ops and End User Support
Santa Monica, CA, 90401
Apply now: Manager, IT Operations & End User Support, location is Onsite (Santa Monica, CA). The start date is ASAP for this permanent position. Job Title: Manager, IT Operations & End User Support Location-Type: Onsite (Santa Monica, CA) Start Date Is...
Date Posted: 07/31/2026 Recommended
-
BTP QA Engineer
Rockville, MD, 20852
Job Title: SAP Business Technology Platform (BTP) Quality Engineer Location-Type: Fully Remote (U.S. - EST Preferred) Start Date Is: End of August 2026 Position Type: Contract (12 Months) Hourly Rate: $50/hr - 60/hr W2 Benefits: Eligible for Health, De...
Date Posted: 07/31/2026 Recommended
-
Data Engineer
New York, NY, 10001
Apply now: Data Engineer (AVP Level), location is Hybrid (3 days/week onsite in NYC). The start date is ASAP (targeting end of summer) for this long-term contract-to-hire position. Job Title: Data Engineer (AVP Level) Location-Type: Hybrid (3 days/week...
Date Posted: 07/31/2026 Recommended
-
Endpoint Engineer
Charlotte, NC, 28262
Job Title: Endpoint Security Engineer Location-Type: Remote with monthly onsite travel to Charlotte, NC required (travel expenses covered by client); local candidates may work hybrid from Charlotte, NC Start Date: ASAP Duration: Contract, 6 months (pot...
Date Posted: 07/31/2026 Recommended
-
Principal DevOps Engineer
Los Angeles, CA, 90015
Apply now: Principal DevOps Engineer, location is Onsite 5x a week (Los Angeles, CA). The start date is ASAP for this permanent position. Job Title: Principal DevOps Engineer Location-Type: Onsite 5x a week in Los Angeles, CA Start Date Is: ASAP Durati...
Date Posted: 07/31/2026 Recommended
-
Senior AI Data Engineer
New York, NY, 10016
Job Title: Data Engineer Location-Type: NYC Hybrid (7 days onsite/ month) Start Date Is: Mid August Duration: 6 Month Contract Compensation Range: $65-72/hour W2 Benefits: Eligible for Health, Dental, Vision, 401K Must be authorized to work in the U.S....
Date Posted: 07/31/2026 Recommended
-
Infrastructure Security Engineer
Charlotte, NC, 28262
Job Title: Infrastructure Security Engineer Location-Type: Remote with required travel (minimum monthly, travel expenses covered by the client), OR Local Hybrid, Charlotte, NC (onsite as needed) Start Date: ASAP Duration: Contract, 6 months, with poten...
Date Posted: 07/31/2026 Recommended
-
Electrical Engineer
Danvers, MA, 01923
Apply now: Senior Electrical Engineer, location is Onsite. The start date is ASAP for this 12 month contract position. Job Title: Senior Electrical Engineer Location-Type: Onsite (5 days/week) Start Date Is: ASAP Duration: 12 Month Contract Compensatio...
Date Posted: 07/31/2026 Recommended
-
Staff Engineer
Baltimore, MD, 21224
Apply now: Staff Engineer, location is Remote (with hybrid conversion). The start date is July 2026 for this 6-month contract-to-hire position. Job Title: Staff Engineer Location-Type: Hybrid (The role is 100% Remote during the contract period. When co...
Date Posted: 07/31/2026 Recommended
-
IT Operations Engineer
Somerville, MA, 02145
Apply now: IT Operations Engineer, location is Hybrid (3 days onsite in Somerville, MA). The start date is ASAP for this 4–6 month contract position. Job Title: IT Operations Engineer Location-Type: Hybrid (3 days onsite – Somerville, MA) Start Date Is...
Date Posted: 07/31/2026 Recommended
-
Network Engineer
Burbank, CA, 91504
Job Title: Network Engineer Location-Type: Onsite in Burbank, CA Start Date Is: ASAP Duration: (contract, perm, etc) 6 Month Contract to Hire (will convert to FTE) Compensation Range: 68-75$/hr W2 Benefits: Eligible for Health, Dental, Vision, 401K Mus...
Date Posted: 07/31/2026 Recommended
-
Principal Mobile Engineer
Atlanta, GA, 30342
Apply now: Principal Mobile Engineer, location is Hybrid (4 days/week onsite in Atlanta, GA). The start date is ASAP for this permanent position. Job Title: Principal Mobile Engineer Location-Type: Hybrid (4 days/week onsite – Atlanta, GA) Start Date I...
Date Posted: 07/31/2026 Recommended
-
Lead Software Engineer
Irving, TX, 75062
Job Title: Lead Software Engineer Location-Type: Irving, TX- Hybrid 3 days onsite Start Date Is: June 22 Duration: 6 month contract to hire Compensation Range: $65-73/HR Benefits: Eligible for Health, Dental, Vision, 401K Must be authorized to work in ...
Date Posted: 07/31/2026 Recommended
-
Lead Software Engineer
Charlotte, NC, 28262
Job Title: Lead Software Engineer Location-Type: Irving, TX- Hybrid 3 days onsite Start Date Is: June 22 Duration: 6 month contract to hire Compensation Range: $65-73/hr W2 Benefits: Eligible for Health, Dental, Vision, 401K Must be authorized to work ...
Date Posted: 07/31/2026 Recommended
-
Lead Software Engineer
tempe, AZ, 85284
Job Title: Lead Software Engineer Location-Type: Wilmington, DE - Hybrid 3 days onsite Start Date Is: June 22 Duration: 6 month contract to hire Compensation Range: $65-73/HR W2 Benefits: Eligible for Health, Dental, Vision, 401K Must be authorized to ...
Date Posted: 07/31/2026 Recommended
-
Marketing Manager
Atlanta, GA, 30305
Job Title: Marketing Manager Location-Type: Hybrid, Atlanta, GA (Buckhead, 3 days/week in office) Start Date: ASAP Duration: Permanent Compensation Range: $80,000 - $90,000k Benefits: Health insurance, dental insurance, vision, paid time off, performan...
Date Posted: 07/31/2026 Recommended
-
Signal/Image Process Engineer
Manassas, VA, 20110
Apply now: Signal/Image Process Engineer, Onsite - Manassas, VA. Start date is ASAP (late August / early September) for this 6-month Contract-to-Hire position. Job Title: Signal/Image Process Engineer Location-Type: Onsite, Manassas, VA (5 days/week or...
Date Posted: 07/31/2026 Recommended
-
Web Developer
Denver, CO, 80218
Apply now: Web Developer, Remote. Start date is September 14 for this contract position. Job Title: Web Developer Location-Type: Remote Start Date: Asap Duration: Contract, approximately 2 months at 40 hrs/week or 4 months at 20 hrs/week Compensation R...
Date Posted: 07/31/2026 Recommended
-
Community Manager
Camden, NJ, 08103
Job Title: Community Manager Location: Hybrid – Camden, NJ (3 days onsite: Monday, Tuesday, Thursday) Duration: 12-Month Contract Start Date: ASAP Compensation: $23–27/hour W2 Benefits: Eligible for Health, Dental, Vision, and 401(k) Visa Sponsorship: ...
Date Posted: 07/31/2026 Recommended
-
Data Analyst
NYC, NY, 10019
Apply now: Data Analyst, Hybrid ( New York, NY). Start date is ASAP for this 6-month contract position. Job Title: Data Analyst Location-Type: Hybrid, New York, NY 10019 Start Date: ASAP Duration: Contract, 6 months Compensation Range: $55-58/hr on W2 ...
Date Posted: 07/31/2026 Recommended
-
Principal Software Engineer - SRE
Boston, MA, 02110
Apply now: Principal Software Engineer – SRE, location is Remote (ET time zone; CT considered if working ET hours), with quarterly onsite travel to the Boston office. The start date is TBD for this permanent position. Job Title: Principal Software Engi...
Date Posted: 07/31/2026 Recommended
-
Lead Software Engineer
Baltimore, MD, 21202
Apply now: Lead Software Engineer, location is Hybrid. The start date is June 22 or June 29 for this 6 month contract-to-hire position. Job Title: Lead Software Engineer Location-Type: Hybrid (3 Days A Week Onsite - at one of the following locations; B...
Date Posted: 07/31/2026 Recommended