AWS/Spark Data & AI Engineer | Remote
: Job Details :

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from ISoftech Inc

Talent Acquisition Specialist at Tanvi IT Solutions Inc

100% remote

USC/GC's Only

Job Description:

We are seeking a highly skilled and experienced AWS/Spark Data & AI Engineer with a strong background in Python and artificial intelligence to join our client's team. The ideal candidate will be responsible for designing, developing, and deploying scalable data pipelines and AI solutions on the AWS cloud platform. This role requires a deep understanding of big data technologies, machine learning concepts, and a proven ability to leverage Python to build robust and efficient data and AI applications.

Responsibilities:

• Design, develop, and maintain large-scale, distributed data pipelines using Apache Spark, PySpark, and AWS services like AWS Glue, EMR, S3, and Redshift.
• Implement ETL (Extract, Transform, Load) processes to ingest, transform, and load data from various sources into data lakes and data warehouses.
• Develop, train, and deploy machine learning and AI models using Python and relevant libraries (e.g., scikit-learn, TensorFlow, PyTorch).
• Collaborate with data scientists and business stakeholders to understand data requirements and translate them into technical solutions.
• Optimize and fine-tune Spark jobs and other data processing applications for performance, scalability, and cost-efficiency.
• Ensure data quality, integrity, and security across all data processing and storage systems.
• Troubleshoot and resolve issues related to data pipelines, Spark jobs, and AWS infrastructure.
• Stay up-to-date with the latest trends and technologies in big data, cloud computing, and artificial intelligence.
• Participate in code reviews and contribute to a culture of engineering excellence and best practices.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Proven professional experience with AWS cloud services, particularly those related to data engineering (S3, Glue, EMR, Redshift, Lambda).
• Extensive experience with Apache Spark and PySpark for big data processing and analytics.
• Advanced proficiency in Python for data manipulation, scripting, and application development.
• Strong understanding of AI/Machine Learning concepts, algorithms, and practical experience in building and deploying ML models.
• Experience with big data frameworks and technologies (e.g., Hadoop, Hive).
• Solid knowledge of data warehousing concepts, data modeling, and ETL processes.
• Proficiency in SQL and working with relational and NoSQL databases.
• Excellent problem-solving, analytical, and communication skills.
• Ability to work both independently and collaboratively in a fast-paced environment.

Seniority level

• Seniority levelMid-Senior level

Employment type

• Employment typeContract

Job function

• Job functionInformation Technology
• IndustriesIT Services and IT Consulting

Referrals increase your chances of interviewing at ISoftech Inc by 2x

Get notified about new Artificial Intelligence Engineer jobs in District of Columbia, United States.

Washington, DC $180,000.00-$200,000.00 5 months ago

Senior Public Sector Research Scientist, Machine Learning

Washington, DC $100,000.00-$120,000.00 1 month ago

Sr Full Stack Software Engineer - AWS CDK, REACT, TypeScript

Washington, DC $130,000.00-$150,000.00 2 weeks ago

Senior Software Engineer, Backend (Batch Infrastructure)Senior Staff Software Engineer, Backend (Search & Discovery)

Washington, DC $150,000.00-$230,000.00 1 week ago

Washington, DC $136,000.00-$204,000.00 4 days ago

District of Columbia, United States $90,000.00-$145,000.00 8 months ago

District of Columbia, United States $120,000.00-$166,000.00 8 months ago

Washington, DC $150,000.00-$170,000.00 2 months ago

Software Engineer II, Backend (Consumer Authentication)Software Development Engineer II, Guidance (C++)

Washington, DC $157,675.00-$213,325.00 2 weeks ago

Staff Software Engineer, Backend (Streaming)

Washington, DC $69,400.00-$158,000.00 1 week ago

Senior Software Developer I - Drupal Developer

Washington, DC $115,000.00-$135,000.00 1 month ago

Staff Software Engineer (Batch Infrastructure)

Washington, DC $69,300.00-$158,000.00 2 weeks ago

Senior Full Stack Developer (Python, React)

Washington, DC $114,000.00-$140,000.00 1 week ago

Salesforce Developer with ACTIVE Secret or Public Trust- Remote

Washington, DC $81,094.00-$137,860.00 1 week ago

Washington, DC $171,900.00-$249,100.00 6 days ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr