DataBricks Architect Job at Abidi Group LLC, Houston, TX

WEpjeUZuaWhUTUk4UzlHYkRjTTc5dDlO
  • Abidi Group LLC
  • Houston, TX

Job Description

Technical Expertise:

  • Data bricks Mastery:  Deep, expert-level knowledge of the Data bricks Platform, including:
    • Unity Catalog:  Designing and implementing data governance and security.
    • Delta Lake & Delta Live Tables:  Architecture and building reliable, scalable data pipelines.
    • Performance & Cost Optimization:  Expertise in tuning Spark jobs, optimizing cluster usage, and managing platform costs.
    • MLOps:  Strong, practical understanding of the machine learning lifecycle on Data bricks using tools like MLflow.
    • Data bricks SQL:  Knowledge of designing and optimizing analytical workloads.
    • Mosaic AI:  Knowledge of designing and optimizing AI Agents.
  • Cloud & Infrastructure:  Deep knowledge of cloud architecture and services on AWS. Strong command of Infrastructure as Code (Terraform, YAML).
  • Data Engineering & Programming:  Strong background in data modeling, ETL/ELT development, and advanced, hands-on programming skills in Python and SQL.
  • CI/CD & Automation:  Experience with designing and implementing CI/CD pipelines (preferably with GitHub Actions) for data and ML workloads.
  • Severability:  Familiarity with implementing monitoring, logging, and alerting for data platforms.
  • Automation:  The platform is ephemeral, and all changes are implemented using Terraform and Python. Expertise in Terraform and Python is a must.

Job Tags

Contract work,

Similar Jobs

NP Now

Addiction Medicine Physician - J1, Psychiatric Based Job at NP Now

 ...Growing Private Practice is looking to hire an Addiction Medicine physician with Psychiatric background to work in an outpatient setting in Bakersfield, CA! Join a psychiatric practice serving patients who struggle with mental disorders in Bakersfield, California.... 

B.E.L. Associates, Inc.

Breast Radiology with 100K signing bonus and beautiful women's center - western PA Job at B.E.L. Associates, Inc.

 ...willing to incorporate Diagnostic IMaging into this job if that is preferred by the Radiologist. The Womens' Imaging does do 3D mammography, breast ultrasound, MRI, breast localizations, and biopsy.Complete modern comprehensive breast center in western Pennsylvania across... 

Silver Knights Chess Academy

After School Teacher Job at Silver Knights Chess Academy

 ...After School Teacher Make a positive difference in the lives of elementary school children by teaching them to play chess after school...  ...schedule, for example, an Uber or Lyft driver, a student, or a retired person looking for a part-time job. You will receive... 

Otra Travels

Vacation Planner Job at Otra Travels

 ...Vacation Plannerwith a kind heart is needed to book vacations. Our number one goal is to help our clients to send them on their dream vacations post-pandemic. We love to book wedding parties, so that they can have a memorable wedding for years to come. We can even set... 

Safe Harbor Home Care

Caregiver Mira Mesa No Experience Necessary Job at Safe Harbor Home Care

 ...Mesa, Poway and other areas Immediately! Pay starting at $20-23 an hour! Job Description Summary Personal Care Attendant-Caregivers provide non-medical service and assistance to a client in their home and communities, who, because of advanced age or physical or...