S&P Global Sr. Distributed Systems Engineer in Cambridge, Massachusetts

The Team:

Grid computing team is responsible for the development of distributed computing system, Hadoop ecosystem based one, used as a backbone of the analytics as well as content based applications. The group is also responsible for optimization of the application running directly on the distributed computing ecosystem.

The Impact:

The role, as part of the Grid computing team, will play a vital part in delivering quality cutting edge technology, tailored to specific content and analytics business solutions.

What s in it for you:

The role gives opportunity to be part of an expert group of elite distributed systems developers, who have cutting edge expertise in distributed system engineering and development, and applying these systems to problems in the business space.

Responsibilities:

  • Distributed system implementation and development within the Apache Hadoop ecosystem

  • Apache Spark application optimization and development

  • Distributed system Application development integration and debugging

  • Linux shell application centric tools development and automation

  • Application and system integration activities with different languages on Linux

  • Distributed system and application debugging and problem resolutions

What We re Looking For:

  • Linux engineering and development

    • 3-5 Years experience with one or more from the distributed systems technologies list:*
  • AKKA,

  • SGE,

  • EGO-Symphony, LSF ( Platform Computing,IBM )

  • GridServer (DataSynapse,TIBCO)

  • Apache Spark

  • Apache Ignite

  • Globus toolkit

  • beowulf clusters

    • Hadoop ecosystem - Massively distributed NoSQL systems
  • Any Open Source Grid software

    • 5-7 years experience with C - C AND Java.
  • 2-3 years distributed programming experience with any middleware technology.

  • *nix proficiency, shell scripting and OS system internals understandings, (kernel compilation is admirable experience)

  • Development knowledge for Linux and Windows environments

    • Network protocol knowledge TCP - IP as well as socket - network or distributed middleware programming experience in C - C and Java (GO is also a good experience)

    • Multithreading experience C - C and Java

  • Knowledge about and experience with compartmentalization technologies ( Docker or alike )

    • 2-3 years experience in working with 100 computational devices configured as a distributed cluster - grid infrastructure
  • Logic oriented thinking and ability to focus fast on important data out of seemingly unrelated data streams

  • Interest in building and experimenting with massively distributed systems and applications.

To all recruitment agencies:

S&P Global does not accept unsolicited agency resumes. Please do not forward such resumes to any S&P Global employee, office location or website. S&P Global will not be responsible for any fees related to such resumes.

S&P Global is an equal opportunity employer committed to making all employment decisions without regard to race - ethnicity, gender, pregnancy, gender identity or expression, color, creed, religion, national origin, age, disability, marital status (including domestic partnerships and civil unions), sexual orientation, military veteran status, unemployment status, or any other basis prohibited by federal, state or local law. Only electronic job submissions will be considered for employment.

If you need an accommodation during the application process due to a disability, please send an email to:

EEO.Compliance@spglobal.com and your request will be forwarded to the appropriate person.

The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law.