Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

eE9DZ08zbk5mZkRvaGwyZlRzTlk3WjhVb1E9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

The Semler Agency

Work From Home Insurance Agent Job at The Semler Agency

 ...various forms of life and health insurance, mortgage protection, and...  ...well as in-person training. Work with warm leads from families...  ...and can work from their home either part-time or full-time...  ...Entrepreneur Magazine FAQ: ~ Nationwide company (work in your area)... 

Leidos

Short Term or As Needed Coverage , MFLC Counselor, San Diego Area, CA Job at Leidos

 ...at a moment's notice.Leidos seeks passionate licensed mental healthcare providers ready to embrace a flexible PRN-type schedule, stepping...  ...Members and their families in San Diego, CA. This is an interim position with the MFLC Program and provides an opportunity to... 

PwC

Deals - FS Financial Due Diligence, Manager Save for Later Remove job Job at PwC

 ...knowledge, and experiences you need to lead and deliver value at this level include but are not limited to: Analyse and identify the...  ...how we work: PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship... 

J's Auto Service

Auto Mechanic Job at J's Auto Service

 ...Accelerate Your Career with JS Auto Service! Position: Automotive Mechanic Location: Hatfield, PA Schedule: Monday to Friday, 8:30 AM - 5:15 PM (45-minute lunch break) Pay Rate: $25.00 to $35.00+ per hour, based on experience and skill level, plus... 

K.A. Recruiting, Inc.

Psychiatric Nurse Practitioner or PMHNP Job at K.A. Recruiting, Inc.

PSYCHIATRIC NURSE PRACTITIONER NEEDED ON NORTH SHORE full time, permanent position extremely competitive compensation excellent benefits PMHNP and two years experience required provides for biopsychosocial clinical evaluations, examinations, and diagnosis DON"T WAIT...