*** Direct Client Requirement *****
Title: ETL Data bricks with Cloud Technologies expert
Duration: Long Term
Interview Type: Skype and Phone
Work Status: Successful applicants must be legally authorized to work in the U.S.
Job Type: C2C,C2H ,W2
Experience: 8 YEARS
The ideal candidate is skilled in data wrangling and comfortable implementing emerging technologies.
Overall experience of 8+ years
Experience in Azure Cloud Platform. (ADLS, Blob).
Excellent understanding of big data file formats like JSON, Avro, Parquet and other prevalent big data file formats
Experience developing big data applications using Spark, HDFS, etc.
Experience in Azure Databricks platform.
Expertise in Python, PySpark, Spark
Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development
Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low-latency, and fault-tolerance in every system built.
Experience with Java, Python, Hive and Spark to write data pipelines and data processing layers
Demonstrates expertise in writing complex, highly-optimized SQL queries across large data sets
Experience with Cloud Technologies (Azure)
Provides and supports the implementation and operations of streaming and batch data pipelines and analytical solutions
Performance tuning experience of systems working with large data sets
Experience with Data Governance ( Data Quality, Metadata Management, Security, etc.)
Good to have development experience on RESTful API data service
Apply here or Please send to email@example.com
Position Keywords: Spark , Cloud Technologies , Azure Databricks , ADLS , Python , big data , Azure Cloud Platform , analytical solutions , data processing , Blob , HDFS , Data Governance , Hive , RESTful , PySpark , implement , JSON , Java , SQL queries
Pay Rate: DOE
Job Duration: long term
% Travel Required: None
Job Posted by: Consulting Services
Job ID: TM52
Work Authorization: Successful applicants must be legally authorized to work in the U.S