Innovation Starts Here

At Code1 Tech, we drive innovations that shape the future of enterprise technology. Our expertise spans Data Engineering, AI/ML, Cloud Solutions, and Full-Stack Development. We empower businesses with cutting-edge technology solutions, enabling digital transformation at scale. Join us to build impactful products with a passionate team of engineers and innovators.

We are looking for an experienced Databricks Engineer with 6–7 years of experience in designing and developing scalable data engineering solutions. The ideal candidate should have strong expertise in the Databricks platform, Apache Spark, and real-time streaming technologies. You will be responsible for building high-performance data pipelines, processing large-scale datasets, and enabling advanced analytics in a cloud environment.

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks and Apache Spark.
• Build and maintain real-time data processing solutions using Structured Streaming or Spark Streaming.
• Develop and optimize Delta Lake architecture for high-performance data processing.
• Integrate data from multiple sources including APIs, databases, messaging systems, and cloud storage.
• Collaborate with Data Architects, Data Scientists, and Business Analysts to deliver data solutions.
• Optimize Spark jobs for performance, scalability, and cost efficiency.
• Implement data quality checks, monitoring, logging, and error-handling mechanisms.
• Manage batch and streaming workloads in production environments.
• Ensure data security, governance, and compliance with organizational standards.
• Troubleshoot production issues and provide timely resolution.
• Participate in code reviews, documentation, and best practice implementation.

• Strong experience with Azure Databricks or Databricks on AWS/GCP.
• Expertise in Apache Spark (PySpark/Scala Spark).
• Mandatory hands-on experience with Structured Streaming or Spark Streaming.
• Strong programming skills in Python (preferred) or Scala.
• Experience with Delta Lake, Delta Live Tables (DLT), and Unity Catalog.
• Knowledge of Apache Kafka, Event Hubs, or similar streaming platforms.
• Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform (GCP).
• Strong SQL skills for data transformation and optimization.
• Experience with CI/CD pipelines and version control tools such as Git and Azure DevOps.
• Knowledge of orchestration tools such as Azure Data Factory (ADF), Apache Airflow, or similar.
• Familiarity with data warehousing concepts and dimensional modeling.
• Experience in performance tuning, partitioning, caching, and query optimization.
• Understanding of data governance, security, and access management.

• Databricks Certification.
• Experience with Lakehouse architecture.
• Knowledge of Infrastructure as Code (Terraform/Bicep) is an added advantage.
• Excellent analytical, troubleshooting, and communication skills.
• Experience working in Agile/Scrum environments.