Explore 1M+ Live Opportunities.
Direct applications, high-package MNC listings, and exclusive insider referrals updated daily across 50+ niches worldwide.
Live Jobs|Remote & Onsite|Apply in 1 Click
Join Our WhatsApp Job ChannelDirect applications, high-package MNC listings, and exclusive insider referrals updated daily across 50+ niches worldwide.
Quantum Integrators · Raritan, New Jersey
Position - Databricks Architect
Location - Raritan, NJ
Duration - Full Time
We are seeking an experienced
Databricks Architect
to design, architect, and implement scalable data platforms using the Databricks Lakehouse architecture. The ideal candidate will have extensive experience in modern data engineering, cloud platforms, and enterprise data architecture within the
Life Sciences industry . This role requires close collaboration with business and technical stakeholders to deliver secure, scalable, and compliant data solutions.
Key
Design and implement enterprise-scale data platforms using Databricks.
Architect end-to-end data solutions, including data ingestion, transformation, storage, and analytics.
Develop scalable ETL/ELT pipelines using Apache Spark and Databricks.
Design and optimize Delta Lake architectures for performance and reliability.
Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.
Define data governance, security, and best practices for the Databricks environment.
Optimize workloads for cost, scalability, and performance.
Lead architecture reviews, technical design sessions, and code reviews.
Mentor data engineers and establish development standards.
Integrate Databricks with enterprise data sources, APIs, and reporting platforms.
Support production deployments, troubleshooting, and performance tuning.
Ensure data solutions align with Life Sciences regulatory and compliance requirements, where applicable.
Required
Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
Experience working in the Life Sciences industry (pharmaceutical, biotechnology, medical devices, or healthcare).
Strong expertise in Apache Spark (PySpark/Scala/Spark SQL).
Strong understanding of data lakehouse architecture, data warehousing, and data modeling.
Databricks Certified Professional Data Engineer or Databricks Certified Solutions Architect.
Knowledge of streaming technologies such as Kafka or Spark Structured Streaming.
Familiarity with Life Sciences data standards and regulatory environments (e.g., GxP, FDA 21 CFR Part 11, HIPAA, where applicable).
Databricks
Apache Spark
PySpark
Python
SQL
Delta Lake
Unity Catalog
Databricks Workflows
Azure Databricks / AWS Databricks
Azure Data Factory / AWS Glue
Git
CI/CD
Data Lakehouse Architecture
Data Modeling
Performance Tuning
Strong leadership and architectural decision-making abilities.
Ability to engage effectively with business, IT, and executive stakeholders.
Ability to mentor and guide technical teams.
Work Model
Full-time
Onsite
Experience working directly with business stakeholders in a Life Sciences environment is highly preferred.
Details
| Company | Quantum Integrators |
| Location | Raritan, New Jersey |
| Type | FULL TIME |
| Niche | Full-time |