Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

V29EVS9iUUkzY0dzT3RwYXVqWkxaOTMxaWc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Compass Group

SHIFT SUPERVISOR (FULL TIME) Job at Compass Group

 ...We have an opening for full time SHIFT SUPERVISOR positions. Location : 3M Hutchinson - 915 Adams Street Southeast, Hutchinson...  ...applications accepted only . Schedule :Full time schedule. First Shift; Sunday - Thursday 6:00 am - 2:30 pm,Second shift; Monday... 

Aerotek

Cabinet Assembler (Automotive Industry) Job at Aerotek

 ...where you can build your skills, to long-term opportunities where you can play a vital role solving for companies' construction, manufacturing and maintenance challenges. Our 1,500+ experienced recruiters across 250+ offices work relentlessly to put our workforce in a... 

CoperUniversity Health Care

ED REGISTRAR Job at CoperUniversity Health Care

 ...copays. Medical terminology knowledge also preferred.~Proficiency in Flowcast scheduling, registration and visit management, and EPIC ED application a plus.Education Requirements~High School Diploma or Equivalent required.Special Requirements~Must be... 

UPS

Automotive Power Mechanic Job at UPS

 ...help you become better every day. We know what it takes to lead UPS into tomorrow-people with a unique combination of skill + passion...  ....Automotive Technicians must be willing to work 2ndor 3rdshifts, including Monday through Friday, Sunday through Thursday as well... 

Toker's Guide

Cannabis Delivery Job at Toker's Guide

 ...Toker's Guide ( tokersguide.com ( is a DC-based start-up and cannabis review site that is rapidly growing. As a part of a new growth...  ...positions. This description is for a Maryland-based cannabisdispensary that is looking for responsible delivery drivers to distribute...