Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

eE9DZ08zbk5mZkRvaGwyZlRzTlk3WjhVb1E9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

New York State Civil Service

Office Assistant 2 (NY HELPS) Job at New York State Civil Service

 ...NY HELP Yes Agency Parks, Recreation & Historic Preservation, Office of Title Office Assistant 2 (NY HELPS) Occupational Category Clerical, Secretarial, Office Aide Salary Grade 09 Bargaining Unit ASU - Administrative Services Unit (CSEA) Salary... 

Balfour & Co.

Los Angeles - Photographers needed Job at Balfour & Co.

 ...role involves capturing memorable images of students during commencement ceremonies. This...  ...-Ability to stand for up to 4 hours at a time -Reliable transportation to and from all...  ...forward you, their information. Employment Type: Part-Time Salary: $ 25.00 Per Hour

jobgether

Solution Architect, Data Science - REMOTE Job at jobgether

 ...looking for a Solution Architect, Data Science. In this role, you will have the opportunity...  ...techniques. Drive adoption of modern computing platforms using NVIDIA's Accelerated...  ...Flexible working conditions supporting remote work. Why Apply Through Jobgether?We... 

Hyatt Regency Birmingham - The Wynfrey Hotel

Banquet Set-Up Houseperson Job at Hyatt Regency Birmingham - The Wynfrey Hotel

Banquet Set-Up House PersonAs a Banquet Setup House Person, youll be responsible for setting up, breaking down, and resetting banquet and meeting spaces according to event specifications. Youll work closely with the banquet and events team to ensure all furniture, ...

White Force Outsourcing Pvt Ltd

QA Tester Job at White Force Outsourcing Pvt Ltd

 ...for QA Tester To run various tests on new software products to ensure that programs satisfy all specifications and requirements. To identify any problems and run debugging programs to fix issues. To run additional tests before products are issued for sale to...