Loading...
Share this Job

Data Engineer

Location: 

White Plains, NY, US

Summary

At NYPA, IT is providing digital capabilities and driving innovation throughout the organization to achieve its VISION2030 Strategy and goals. The right individual will share our passion of digital technology, transformation, and enjoy working in a dynamic and agile environment based on high collaboration culture.

NYPA is looking for a technologist to help advance our Analytics platform and capability into the future. The Data Engineer will work with the Data Services team to design, develop and manage big data centric solutions that meet the strategic business and technology direction of the organization.

Responsibilities

• Design and develop Big data solutions using AWS, Spark and Data Bricks that are flexible, extensible, elastic, secure and reliable at large scale

• Work with Lead Data Engineer to provide guidance and direction to project teams ensuring compliance with coding standards and best practices

• Collaborate with Data Governance team to capture and manage meta data, and implement data quality rules

• Building and managing data pipelines, and promoting to production

• Continuously learn and be at the leading edge of Data Integration, Cloud, Containerization and other industry trends

• Work with stakeholders including product, data and business teams to assist with data-related technical issues and support their data infrastructure needs

• Follow Cyber security guidelines and polices to monitor the company's data security and privacy

Knowledge, Skills and Abilities

• Experience in traditional and cloud data management components (MS SQL, RDS, Athena, or similar)
• Experience in metadata driven ingestion framework, building data pipelines and data sets
• Familiarity with DevOps and Agile methodologies
• Strong analytical skills
• Understanding of cloud security policies and concepts
• Experience in Collibra and Trillium is a plus
• Experience with ETL tools: Talend, Pentaho, or similar tools
 

Education, Experience and Certifications

• Bachelor of Science Degree in Computer Science or IT Engineering
• Minimum of 2 years of Data Engineering experience
• Experience in building micro services using AWS Lambda and similar technologies
• Experience with any one of the big data tools such as: Spark, Kafka, StreamSets, Hadoop
• Scripting experience with JavaScript, pySpark, Python, T-SQL or other similar languages
• Cloud certification (AWS/Google) is preferred

Physical Requirements

 

The New York Power Authority is an Equal Opportunity Employer                       

New York is Powered by You

We are a team of over 1,900 energy technologists, IT specialists, business experts, hydro engineers, and other professionals leading the energy revolution. With state-of-the-art technology, advanced R&D, and a modernized infrastructure, we provide New Yorkers with low-cost, clean, reliable power — and we are well on the way to becoming the first fully digital utility in the country. At NYPA, you will be empowered to think big, do good, and transform the energy industry.

NYPA on Forbes "Best of" - again!

NYPA is ranked by Forbes as one of America's Best Midsize Employers 2019 - for the second year in a row. Browse today and apply...

 

 

 

 

 

 

 


Nearest Major Market: White Plains
Nearest Secondary Market: New York City

Job Segment: Database, Engineer, SQL, Computer Science, Technology, Engineering