Azure Data Bricks Architect

Job Role: Azure Data Bricks Architect
Location: Tampa, FL
Duration: 12+ months

Job Description:

• Design and implement scalable data platforms and pipelines using Databricks (including Spark, Delta Lake, MLflow, etc.).
• Work with stakeholders to develop modern data architectures that meet business requirements.
• Lead the migration from legacy platforms to the Databricks Lakehouse architecture.
• Establish data governance, quality, and security standards in collaboration with InfoSec and Compliance teams.
• Optimize data ingestion, transformation, and consumption processes.
• Mentor data engineers and developers on best practices for using Databricks.
• Integrate Databricks with enterprise tools such as Power BI, Tableau, Kafka, Snowflake, and others. Develop and implement machine learning/Al workflows within a Databricks environment.
• Collaborate with cloud architects to ensure a robust infrastructure setup on AWS, Azure, or Google Cloud Platform. Produce technical documentation, architectural diagrams, and data models.

Qualifications**

• Over 8 years of experience in data engineering or architectural roles.
• More than 5 years of experience in architecting solutions with Databricks.
• Expertise in Apache Spark, Delta Lake, MLflow, and Lakehouse architecture.
• Proficiency in SQL, Python, and/or Scala.
• Practical experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Strong understanding of distributed computing, performance tuning, and data security.
• Experience with CI/CD pipelines, DevOps tools, and orchestration tools like Airflow or Data Factory.

Preferred Qualifications

• Databricks Certified Data Engineer or Solutions Architect.
• Knowledge of MLOPs and deploying machine learning models into production.
• Experience with data mesh, data fabric, or similar enterprise data architectures.
• Experience in public sector, healthcare, or financial services is advantageous.

Education : At least a bachelor s degree (or equivalent experience) in Computer Science, Software/Electronics Engineering, Information Systems, or a closely related field is required.