Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TVFSeUNucWZxdFpMUElqcndTL2VmTFc0WEE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Union Beer Distributors

On Premise Beer Sales Representative Job at Union Beer Distributors

 ...Union Beer Distributors is currently looking for an entry-level Sales Representative to sell, promote and grow our ever-expanding...  ...offered an extensive portfolio of world class beer, cider, kombucha, wine, spirits, and non-alcoholic beverages. The company is committed... 

LanceSoft

Travel Clinical Lab Scientist (CLS) Job at LanceSoft

 ...Job Description LanceSoft is seeking a travel Clinical Lab Scientist (CLS) for a travel job in NAPA, California. Job Description & Requirements ~ Specialty: Clinical Lab Scientist (CLS)~ Discipline: Allied Health Professional ~ Start Date: 01/26/2026~ Duration... 

The University of Tennessee

Director of Marketing, UTC Athletics Job at The University of Tennessee

 ...outreach, promotions, and branding efforts of the Chattanooga Mocs Athletics Department. Responsibilities Develops and executes...  ...marketing and promotions, or an equivalent combination of education, training, and experience. Preferred : A master's degree and 3+... 

Olon USA LLC

Plant Operator Job at Olon USA LLC

 ...premier CDMO specializing in drug substance development to commercialization for the pharmaceutical industry, is seeking a skilled Plant Operator. In this role, you will be pivotal in operating and maintaining our state-of-the-art chemical processing equipment, adhering... 

STS Technical Services

Aircraft Structures Technician Job at STS Technical Services

 ...safety regulations Safeguard customer aircraft, components, and parts at all times Comply with all Federal, OSHA, state, and local safety and...  ...control surface repairs Ability to obtain and maintain airport security clearance (AOA badge) Strong working knowledge of FARs...