Data Engineer Job at NTT DATA, Inc., Indiana

cWR4Zk5GTnhrYVowWDhVdEtrTVl5NjNFR0E9PQ==
  • NTT DATA, Inc.
  • Indiana

Job Description

Diverse Data Engineering activities on Azure Data platform.

·        Build & Deliver Data pipeline connecting various enterprise data sources both RDBMS, NoSQL & APIs. Develop data mappings to existing data sources.

·        Design and develop big data processing notebooks using Azure Databricks

·        Scripting and programming using programming languages such as Python, PySpark etc.

·        Lead the data identification, data analysis efforts for data sources and work directly with data owner teams

·        Lead a team of junior Data Engineers in an Agile/Scrum setting

·        Develop data requirements for new data sources.

·        Design and development of data extraction, data ingestion, data quality rules implementation

·        Understand the data model, transform data to target schema from relational and semi structured source data.

·        Clean and process the data for Machine Learning consumption.

·        Provide Business Intelligence (PowerBI) and Data Warehousing (DW) solutions and support by leveraging project standards and leading analytics platforms

·        Evaluate and define functional requirements for BI and DW solutions

·        Design and development of data extraction, data ingestion, data quality rules implementation

·        Involvement in architecture and design of data

·        Work with Data Governance team to implement Data Quality and Security guidelines

·        Work with DevOps team to implement CI/CD pipelines

Required Skills :-

5+ years overall experience preferably in data domain (data analysis, database developer)

Minimum 5 years’ experience as a cloud-based Data Engineer

Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Databricks, Delta Lake, Azure Data Lake Storage, Blob Storage, Azure Data Factory

Minimum 2 years’ experience on Analytics Visualization tools like Power BI, Qlik Sense etc.

Strong knowledge of Big Data and Analytics, including Apache Spark, Delta Lake

Good understanding of data integration and warehousing (ETL, ELT) processes

Strong knowledge of Database concepts, SQL and experience in working with Database clients like, TOAD, SQL developer, SQL Server Management Studio

Good knowledge of NoSQL/ Document DB.

Good understanding of Enterprise Information Model and Enterprise Data Warehouse

Proficient in analyzing business requirements and mapping them to technical requirements

Data Analysis and Interpretation, and Data Issue Debugging Skills

Good knowledge of DevOps tools and processes as it applies to Data Engineering

has context menu

Job Tags

Similar Jobs

Chick-fil-A

Back of House Team Member Job at Chick-fil-A

Must be at least 16 years old. At Chick-fil-A, the Back of House Team Member role is more than just a job; it's an opportunity. In addition...  ...more limited schedule. ~$12.30/hr positions are available for 15 year old Team Members with 4pm to 7pm shift availability on a... 

Dorman Products

Electronics Assembler Job at Dorman Products

 ...Job Summary Electronics Assemblers/Testers are responsible for re-assembly, parts changing, inspection and testing of electronic components. Primary Duties Learn & follow detailed work instructions Contributes to team effort by accomplishing related duties... 

Huntington Health, an affiliate of Cedars-Sinai

Registered Nurse First Assistant Per Diem Job at Huntington Health, an affiliate of Cedars-Sinai

 ...The Registered Nurse First Assistant (RNFA) is a frontline perioperative registered nurse leader who functions in an expanded role, working in collaboration with the surgeon and health care team members to achieve optimal patient outcomes and improve efficiency of operations... 

NP Now

Outpatient Setting - Psychiatric Mental Health Nurse Practitioner / PMHNP Job at NP Now

Mission-Driven organization is looking to hire a Psychiatric Mental Health Nurse Practitioner/PMHNP to work in an outpatient setting in the Chehalis, Longview, and Grey Harbor Washington area! Open to New Graduates with psych experience! And Sign-on Bonus! \\ Psychiatric... 

Merck & Co.

Senior Talent Acquisition Advisor - Hybrid Job at Merck & Co.

 ...including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance Search Firm Representatives Please Read Carefully- Merck & Co., Inc., Rahway, NJ, USA, also known as Merck Sharp & Dohme LLC, Rahway, NJ, USA, does not accept unsolicited assistance from...