Certification required-DP-100 / DP-200 / AZ-900 Cetification MandatoryRequirements : 3+ years of hands-on experience in Azure Databricks platform .
Delta lake, Time travel design patterns.
Lambda Data ArchitectureExperience in Azure Cloud Platform.
ADLS, Blob , ADF ).Understanding of big data file formats like JSON, Avro, Parquet and other prevalent big data file formatsExperience with Python, PySpark, Scala, Spark to write data pipelines and data processing layersDemonstrate expertise in writing complex, highly-optimized SQL queries across large data setsExperience with Data Governance ( Data Quality, Metadata Management, Security, etc.
Strong SQL skills and proven experience in working with large datasets and relational databases.Understanding Data Warehouse design principles (Tabular, MD).
Experience in working with big data tools / environment to automate production pipelinesFamiliarity with Azure Synapse and SnowflakeExperience with data visual analysis and BI tools (matplotlib Â and Power BI) Skills : - Microsoft Windows Azure, Data engineering, Cloud Computing and "databricks"