We are seeking a skilled Azure Cloud with Databricks Developer to join our team for an exciting migration project. The ideal candidate should have hands-on experience with Azure Cloud, Databricks, and big data technologies such as Scala, Spark, Hadoop, and Java. This role involves developing and maintaining scalable data solutions, optimizing cloud environments, and driving data migration efforts to cloud platforms. The candidate will work closely with cross-functional teams to ensure a seamless transition and implementation of solutions.
Key Responsibilities:
- Lead the migration of data workloads from legacy systems to Azure Cloud and Databricks, ensuring smooth transition and minimal disruption.
- Develop and optimize data pipelines using Scala, Spark, and Hadoop in a cloud environment.
- Implement and fine-tune ETL processes to handle large-scale data transformations and migrations.
- Collaborate with cloud infrastructure teams to optimize the cloud environment for performance and scalability.
- Use Azure Databricks for building and maintaining scalable data models and processing large datasets efficiently.
- Develop applications using Java to enhance data processing workflows and applications.
- Work closely with cross-functional teams to understand business requirements and translate them into data solutions.
- Maintain a high level of coding standards, perform code reviews, and follow Agile methodologies.
- Ensure data integrity and security throughout the migration process.
- Optimize the performance of cloud-based solutions, ensuring data retrieval, processing, and storage meet business requirements.
Qualifications:
Must-Have:
- 4+ years of experience with Azure Cloud and Databricks for data processing and migration projects.
- Hands-on experience with Scala, Spark, Hadoop, and Java in big data environments.
- Proficiency in building data pipelines and working with ETL processes in cloud environments.
- Strong understanding of Azure Cloud services, particularly Azure Databricks.
- Experience in migrating large datasets from legacy systems to cloud-based platforms.
- Familiarity with cloud security and best practices for data management in Azure.
- Strong problem-solving skills and the ability to optimize data solutions for performance.
- Excellent communication and teamwork abilities, with a focus on delivering business-oriented solutions.
Good-to-Have:
- Azure certifications (e.g., Microsoft Certified: Azure Data Engineer).
- Experience with containerization using Docker and orchestration with Kubernetes.
- Familiarity with CI/CD pipelines for data-driven applications.
- Knowledge of NoSQL databases for scalable data storage.
In Brief:
- Title: Azure Cloud + Databricks Developer (Migration Project)
- Qualification: Bachelor’s degree in Computer Science, Engineering, or related field. Strong hands-on experience with Azure Cloud, Databricks, Scala, Spark, Hadoop, and Java.
- Experience Needed: 4+ years in Azure Cloud, Databricks, Scala, Spark, Hadoop, and Java.
- No. of Openings: 5
- Joining Type: Immediate / Onboarding within 1 week after interview