Lead Data Engineer - Databricks Job at Apptad Inc, Remote

UmdpVDZaSHl2QW1xWW9YMmtpcFM2SGVwYVE9PQ==
  • Apptad Inc
  • Remote

Job Description

Lead Data Engineer Databricks
Location: USA/Remote

For this position, we are specifically looking for candidates with at least 5 years of strong hands-on experience in Databricks, along with deep expertise in Medallion architecture , pipeline optimization, PySpark/SQL, DBU optimization across all-purpose and job clusters, and data ingestion from a variety of source systems. We are also prioritizing experience with parsing JSON/XML, ingesting data from APIs into Delta tables, Auto Loader functionality, publishing data to AWS components such as S3, SQS, and SNS, working with relational and non-relational databases, and strong proficiency with Unity Catalog. Familiarity with declarative pipelines, DBUtils commands, and broader AWS services is also valued

Job Tags

Similar Jobs

Andritz

Production Scheduler Job at Andritz

 ...that are shaping the future of the world we live in. GENERAL DESCRIPTION Reporting to the Customer Service Manager the production scheduler at the Neenah plant is primarily responsible for planning, coordinating, and optimizing the scheduling of rolls to support... 

Hyatt Hotels

Laundry Attendant Job at Hyatt Hotels

 ...of our caring and attentive associates who are focused on providing efficient service and meaningful experiences. The Laundry Attendant is responsible for processing hotel and guest laundry, including pressing, sorting and folding. Laundry Attendants use... 

Bass Pro Shops

Retail Manager - Camping & Fishing Job at Bass Pro Shops

 ...world class customer service and ensures a pleasant and productive shopping experience for all customers. Meets or exceeds all financial...  ...~ Paid holidays ~ Paid vacation ~ Paid sick time ~ Bass Pro Cares Fund ~ And more! Bass Pro Shops is an equal opportunity... 

Super Soccer Stars

Youth Soccer Instructor Job at Super Soccer Stars

 ...diverse and pluralistic workplace that is committed to teaching and working in a multicultural environment where differences are valued...  ...to specific developmental levels No coaching or soccer experience required! Benefits Flexible schedule... 

BJC Healthcare

BJC Independence Center - Community Support Specialist II Job at BJC Healthcare

Additional Information About the Role Independence Center (IC) is an internationally recognized, community-based behavioral health organization for adults in St Louis living with a mental illness. Our mission is to provide all the services and resources a person living...