Under Development Features: Talent Bank/Pool, VMS Intigration, Analytics, Social Integration, Reports, API Integration, Resource and Timesheets Management, Company Admin

Under Development Features: Talent Bank/Pool, VMS, Analytics, Social/API Integration, Company Admin

ETL Data bricks with Cloud Technologies expert (1046 views)

NYC,NY
January 17, 2020

*** Direct Client Requirement *****

Title: ETL Data bricks with Cloud Technologies expert

Location: NYC,NY

Duration: Long Term

Rate: DOE

Interview Type: Skype and Phone

Work Status:  Successful applicants must be legally authorized to work in the U.S.

Job Type: C2C,C2H ,W2

Experience: 8 YEARS

JD :

The ideal candidate is skilled in data wrangling and comfortable implementing emerging technologies.

Requirements:

Overall experience of 8+ years

Experience in Azure Cloud Platform. (ADLS, Blob).

Excellent understanding of big data file formats like JSON, Avro, Parquet and other prevalent big data file formats

Experience developing big data applications using Spark, HDFS, etc.

Experience in Azure Databricks platform.

Expertise in Python, PySpark, Spark

Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development

Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low-latency, and fault-tolerance in every system built.

Experience with Java, Python, Hive and Spark to write data pipelines and data processing layers

Demonstrates expertise in writing complex, highly-optimized SQL queries across large data sets

Experience with Cloud Technologies (Azure)

Provides and supports the implementation and operations of streaming and batch data pipelines and analytical solutions

Performance tuning experience of systems working with large data sets

Experience with Data Governance ( Data Quality, Metadata Management, Security, etc.)

Good to have development experience on RESTful API data service

Thanks

Siva

siva@sohanit.com

PH:402-241-9606

Apply here or Please send to resumes@sohanit.com

Position Keywords: Spark , Cloud Technologies , Azure Databricks , ADLS , Python , big data , Azure Cloud Platform , analytical solutions , data processing , Blob , HDFS , Data Governance , Hive , RESTful , PySpark , implement , JSON , Java , SQL queries

Pay Rate: DOE

Job Duration: long term

% Travel Required: None

Job Posted by: Consulting Services

Job ID: TM52

Work Authorization: Successful applicants must be legally authorized to work in the U.S

Don't have time now?
Get a reminder in your inbox