Senior Data Engineer

Company: Barclays
Location: Albany
Posted on: March 20, 2023

Job Description:

SENIOR DATA ENGINEERAs a Barclays Senior Data Engineer, you will be joining our expanding Surveillance development team in Whippany office. You will be involved in holistic surveillance build out which will require excellent understanding and hands-on experience in big data (Hadoop - Cloudera stack) technologies like hive, spark, Kafka, Angular JS to architect, develop and support sophisticated analytics pipeline using Machine Learning algorithms.--Barclays is one of the world's largest and most respected financial institutions, with 329 years of success, quality and innovation behind us. We offer careers that provide endless opportunity - helping millions of individuals and businesses thrive, and creating financial and digital solutions that the world now takes for granted.WHAT WILL YOU BE DOING?

• Designing, and developing analytical model using Big Data Technologies like Hadoop, Spark/Scala, Hive, python, Kafka, and the like--
• Building of graph ingestion process and support graph User-Interface development using DataStax, Gremlin, D3, Angular
• Designing robust code from the point of view of performance, reuse and supportability, proper controls, consistent with best practices and with appropriate documentation
• Supporting the migration of Hadoop cluster which includes migration of feeds, ETL processes (Ab-Initio), scripts, Autosys, and machine learning models/code
• Implementing the organization mandated SDLC /Agile processes and built in controls for consistent delivery
• Demonstrating a proactive attitude while identifying or approaching a problem
• Showing the ability to identify the root cause, coming up with an efficient solution and if needed appropriately escalate issues and risks
• Discussing requirements and testing details with Tech Lead, Data Scientist, QA and business stakeholdersWHAT WE'RE --LOOKING FOR:
  • Minimum 4-year college degree with hands-on experience as a big data developer 5+ years with a proven record of multiple successful deliveries
  • Experience with Hadoop (3+ years), Spark/Scala (3+ years), Python (2+ years), Angular (2+ years), Graph technologies (2+ years), Kafka (1+ year)
  • Hands-on in UNIX (3+ years), Autosys (2+ years), and Java (2+ years)
  • Experience in a variety of database technologies mainly Hive, Impala, Oracle or SQL serverSKILLS THAT WILL HELP YOU IN THE ROLE:
    • Excellent analytical skills and compliance business knowledge and extremely organized and should have good oral and written communication skills
    • Ability to influence architecture/design and communicate effectively to Senior management and stakeholders
    • Hands-on experience in Ab-Initio ETL tool and Tableau business intelligence tool
    • Experience working with global team which included Data Scientist, Business analyst and developersWHERE WILL YOU BE WORKING?At Barclays, we are proud to be redefining the future of finance and here at Whippany we are defining the future of the workplace and the future of the way we work and live. We are creating a unique community, one of four strategic tech-enabled hubs that will redefine opportunity for everyone who works here. Whatever you do at Whippany, you'll have every chance to build a world-class career in this world-class environment.

Keywords: Barclays, Albany , Senior Data Engineer, Accounting, Auditing , Albany, New York