Remote Opportunity - Python-PySpark Developer Job at IT America Inc, Illinois

N3pPSDZEWlBidHgxTW1WSzcvQkN5NmRm
  • IT America Inc
  • Illinois

Job Description

Position: Python/PySpark Developer

Location: Remote

Duration: Long term contract

Job Summary

We are seeking a skilled and experienced Python/PySpark Developer with hands-on expertise in Databricks, Cloud platforms (AWS, Azure, or GCP), and CI/CD pipelines. The ideal candidate will design and develop scalable data pipelines, work on big data processing frameworks, and contribute to modern data architecture initiatives.

Key Responsibilities

  • Design, develop, and maintain data pipelines using PySpark and Python.
  • Proficiency in working with SQL, and relational and non-relational databases.
  • Work with Databricks to build scalable and high-performance ETL/ELT workflows.
  • Integrate and process structured and unstructured data from various sources.
  • Deploy solutions on any major cloud platforms (AWS, Azure, or GCP).
  • Implement CI/CD pipelines to automate build, test, and deployment processes.
  • Optimize data workflows for performance and cost efficiency.
  • Collaborate with Data Engineers, Data Scientists, and DevOps teams.
  • Maintain documentation of design decisions, architecture, and implementations.
  • Troubleshoot and resolve data pipeline issues in a timely manner.

Required Skills

  • 10+ years of experience with Python and PySpark.
  • Proficiency in working with SQL, and relational and non-relational databases.
  • Strong experience with Databricks (Delta Lake, notebooks, jobs, clusters, etc.).
  • Experience with one or more cloud platforms (AWS, Azure, GCP).
  • Solid understanding of CI/CD tools (e.g., GitHub Actions, Jenkins, Azure DevOps).
  • Experience with data orchestration tools (e.g., Airflow, Databricks Workflows).
  • Familiarity with data lake, data warehouse, and big data concepts.
  • Knowledge of version control systems like Git.
  • Strong problem-solving and debugging skills.

Preferred Qualifications

  • Experience with Terraform, Docker, or Kubernetes.
  • Exposure to machine learning pipelines or MLOps is a plus.
  • Certifications in Databricks or any Cloud Platform are a bonus.

Education

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Job Tags

Contract work, Remote job,

Similar Jobs

Family Choice Healthcare

Personal Care Aide/ Home Health Aide Job at Family Choice Healthcare

 ...uncommon events Skills & Character Traits: Commitment to health & safety Able to do housework and cooking Well-organized and...  ...is one of the fastest-growing, most respected, non-medical home-care services in the mid-Atlantic Region. We are passionate about... 

DRiV Incorporated

Manufacturing Engineer Job at DRiV Incorporated

 ...one of the worlds leading designer, manufacturers and marketers of automotive products for...  ...Summary Responsible for applying engineering principles and analytical techniques to...  ...ranges between $67,000.00 to $113,000.00. Additional incentives may be provided as part of... 

WORLDWIDE GOLF SHOPS LLC

Social Media Manager Job at WORLDWIDE GOLF SHOPS LLC

 ...Join the Leader in Golf Retail: Social Media Manager Role at Worldwide Golf Location: Santa Ana, CA (In-Office) Position: Full-Time Are you a passionate and creative Social Media Manager with a love for golf and a knack for storytelling? Worldwide Golf, a... 

Genesis of Milford

Experienced Automotive Sales Manager Job at Genesis of Milford

Description of the Role:We are seeking an experienced Automotive Sales Manager to join our team at Genesis of Milford. As a Sales Manager, you will be responsible for leading and managing a team of sales professionals in achieving sales targets and providing exceptional... 

Sonesta Essentials Hotel Overland Park

Hotel Front Desk Receptionist Job at Sonesta Essentials Hotel Overland Park

We are searching for an enthusiastic, service-focused hotel front desk agent to join our guest services team. Youll welcome guests...  ...the hospitality industry as a hotel front desk agent, hotel receptionist, or guest service specialist preferred Well-versed in taking...