Senior Staff Engineer - (Linux,AWS,Terraform,Big Data) - Experian Group : Job Details

Senior Staff Engineer - (Linux,AWS,Terraform,Big Data)

Experian Group

Job Location : New York,NY, USA

Posted on : 2025-07-11T01:03:40Z

Job Description :

Qualifications:

  • 5+ years of experience with Linux, networking, and security fundamentals.
  • Experience with AWS cloud platform and infrastructure.
  • 5+ years of experience working with infrastructure as code using Terraform or Ansible.
  • Experience managing large BigData clusters in production (e.g., Cloudera, Hortonworks, EMR).
  • Knowledge of observability tools such as Prometheus, InfluxDB, Dynatrace, Grafana, Splunk.
  • Expertise in Hadoop Distributed File System (HDFS) and Hadoop YARN.
  • Familiarity with Hadoop file formats like ORC, Parquet, Avro.
  • Experience with Hive (Tez), Hive LLAP, Presto, Spark.
  • Ability to understand query plans and optimize SQL performance on Hive and Spark.
  • Support experience with Spark using Python (PySpark) and R (SparklyR, SparkR).
  • Proficiency in scripting languages such as Shell and Python.
  • Experience collaborating with Data Analysts and Data Scientists, and familiarity with analytical tools like SAS, R-Studio, JupyterHub, H2O.
  • Ability to read and understand Java, Python, R, Scala code; proficiency in at least one scripting language.
  • Reporting to a Senior Manager or Director.

Preferred skills:

  • Experience with container systems (Docker) and orchestration (Kubernetes, EKS).
  • Experience with workflow tools like Airflow, Oozie.
  • Knowledge of libraries like Pandas, Numpy, Scipy, PyTorch.
  • Experience with Packer, Chef, Jenkins, or similar tools.
  • Knowledge of Active Directory and Windows OS VDI platforms like Citrix, AWS Workspaces.

About Experian:

Experian is a global data and technology company providing data, analytics, and software solutions across various industries including financial services, healthcare, automotive, and more. We are committed to diversity, innovation, and creating a positive impact worldwide.

We are a FTSE 100 company with 22,500 employees across 32 countries, headquartered in Dublin, Ireland. Learn more at experianplc.com.

Experience and Skills:

  • Bachelor of Engineering or equivalent degree.

Additional Information:

We value our people and focus on DEI, work/life balance, development, and wellness. Recognized as a Great Place To Work and other awards. We are an Equal Opportunity employer and support diversity and inclusion.

Benefits:

We offer comprehensive benefits supporting work/life balance, health, and wellbeing.

#LI-Onsite

Learn more about working at Experian

#J-18808-Ljbffr
Apply Now!

Similar Jobs ( 0)